Oct 16 09:39:41 user nova-compute[74342]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=74342) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=74342) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=74342) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Oct 16 09:39:41 user nova-compute[74342]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.022s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:39:41 user nova-compute[74342]: INFO nova.virt.driver [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] Loading compute driver 'libvirt.LibvirtDriver'
Oct 16 09:39:41 user nova-compute[74342]: INFO nova.compute.provider_config [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] Acquiring lock "singleton_lock" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] Acquired lock "singleton_lock" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] Releasing lock "singleton_lock" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] Full set of CONF: {{(pid=74342) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ******************************************************************************** {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] Configuration options gathered from: {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ================================================================================ {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] allow_resize_to_same_host      = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] arq_binding_timeout            = 300 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] backdoor_port                  = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] backdoor_socket                = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] block_device_allocate_retries  = 300 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] block_device_allocate_retries_interval = 5 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cert                           = self.pem {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] compute_monitors               = [] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] config_dir                     = [] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] config_drive_format            = iso9660 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] config_source                  = [] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] console_host                   = user {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] control_exchange               = nova {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cpu_allocation_ratio           = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] daemon                         = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] debug                          = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] default_access_ip_network_name = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] default_availability_zone      = nova {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] default_ephemeral_format       = ext4 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] default_green_pool_size        = 1000 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] default_schedule_zone          = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] disk_allocation_ratio          = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] enable_new_services            = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] enabled_apis                   = ['osapi_compute'] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] enabled_ssl_apis               = [] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] flat_injected                  = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] force_config_drive             = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] force_raw_images               = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] graceful_shutdown_timeout      = 5 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] heal_instance_info_cache_interval = 60 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] host                           = user {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] instance_build_timeout         = 0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] instance_delete_interval       = 300 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] instance_format                = [instance: %(uuid)s]  {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] instance_name_template         = instance-%08x {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] instance_usage_audit           = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] instance_usage_audit_period    = month {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] internal_service_availability_zone = internal {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] key                            = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] live_migration_retry_count     = 30 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] log_config_append              = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] log_dir                        = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] log_file                       = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] log_options                    = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] log_rotate_interval            = 1 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] log_rotate_interval_type       = days {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] log_rotation_type              = none {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] long_rpc_timeout               = 1800 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] max_concurrent_builds          = 10 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] max_concurrent_live_migrations = 1 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] max_concurrent_snapshots       = 5 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] max_local_block_devices        = 3 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] max_logfile_count              = 30 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] max_logfile_size_mb            = 200 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] maximum_instance_delete_attempts = 5 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] metadata_listen                = 0.0.0.0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] metadata_listen_port           = 8775 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] metadata_workers               = 3 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] migrate_max_retries            = -1 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] mkisofs_cmd                    = genisoimage {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] my_ip                          = 10.0.0.210 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] network_allocate_retries       = 0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] osapi_compute_listen_port      = 8774 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] osapi_compute_unique_server_name_scope =  {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] osapi_compute_workers          = 3 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] password_length                = 12 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] periodic_enable                = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] periodic_fuzzy_delay           = 60 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] pointer_model                  = ps2mouse {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] preallocate_images             = none {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] publish_errors                 = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] pybasedir                      = /opt/stack/nova {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ram_allocation_ratio           = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] rate_limit_burst               = 0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] rate_limit_except_level        = CRITICAL {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] rate_limit_interval            = 0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] reboot_timeout                 = 0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] reclaim_instance_interval      = 0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] record                         = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] reimage_timeout_per_gb         = 60 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] report_interval                = 120 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] rescue_timeout                 = 0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] reserved_host_cpus             = 0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] reserved_host_disk_mb          = 0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] reserved_host_memory_mb        = 512 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] reserved_huge_pages            = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] resize_confirm_window          = 0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] resize_fs_using_block_device   = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] resume_guests_state_on_host_boot = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] rpc_response_timeout           = 60 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] run_external_periodic_tasks    = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] running_deleted_instance_action = reap {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] running_deleted_instance_poll_interval = 1800 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] running_deleted_instance_timeout = 0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] scheduler_instance_sync_interval = 120 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] service_down_time              = 720 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] servicegroup_driver            = db {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] shelved_offload_time           = 0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] shelved_poll_interval          = 3600 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] shutdown_timeout               = 0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] source_is_ipv6                 = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ssl_only                       = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] state_path                     = /opt/stack/data/nova {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] sync_power_state_interval      = 600 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] sync_power_state_pool_size     = 1000 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] syslog_log_facility            = LOG_USER {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] tempdir                        = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] timeout_nbd                    = 10 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] transport_url                  = **** {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] update_resources_interval      = 0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] use_cow_images                 = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] use_eventlog                   = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] use_journal                    = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] use_json                       = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] use_rootwrap_daemon            = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] use_stderr                     = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] use_syslog                     = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vcpu_pin_set                   = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vif_plugging_is_fatal          = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vif_plugging_timeout           = 0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] virt_mkfs                      = [] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] volume_usage_poll_interval     = 0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] watch_log_file                 = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] web                            = /usr/share/spice-html5 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_concurrency.disable_process_locking = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api.auth_strategy              = keystone {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api.compute_link_prefix        = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api.dhcp_domain                = novalocal {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api.enable_instance_password   = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api.glance_link_prefix         = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api.instance_list_per_project_cells = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api.list_records_by_skipping_down_cells = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api.local_metadata_per_cell    = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api.max_limit                  = 1000 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api.metadata_cache_expiration  = 15 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api.neutron_default_tenant_id  = default {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api.use_forwarded_for          = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api.use_neutron_default_nets   = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api.vendordata_dynamic_targets = [] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api.vendordata_jsonfile_path   = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.backend                  = dogpile.cache.memcached {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.backend_argument         = **** {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.config_prefix            = cache.oslo {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.dead_timeout             = 60.0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.debug_cache_backend      = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.enable_retry_client      = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.enable_socket_keepalive  = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.enabled                  = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.expiration_time          = 600 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.hashclient_retry_attempts = 2 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.memcache_dead_retry      = 300 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.memcache_password        =  {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.memcache_pool_maxsize    = 10 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.memcache_sasl_enabled    = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.memcache_username        =  {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.proxies                  = [] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.retry_attempts           = 2 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.retry_delay              = 0.0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.socket_keepalive_count   = 1 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.socket_keepalive_idle    = 1 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.socket_keepalive_interval = 1 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.tls_allowed_ciphers      = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.tls_cafile               = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.tls_certfile             = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.tls_enabled              = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cache.tls_keyfile              = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cinder.auth_section            = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cinder.auth_type               = password {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cinder.cafile                  = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cinder.certfile                = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cinder.collect_timing          = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cinder.cross_az_attach         = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cinder.debug                   = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cinder.endpoint_template       = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cinder.http_retries            = 3 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cinder.insecure                = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cinder.keyfile                 = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cinder.os_region_name          = RegionOne {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cinder.split_loggers           = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cinder.timeout                 = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] compute.cpu_dedicated_set      = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] compute.cpu_shared_set         = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] compute.image_type_exclude_list = [] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] compute.max_concurrent_disk_ops = 0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] compute.max_disk_devices_to_attach = -1 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] compute.resource_provider_association_refresh = 300 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] compute.shutdown_retry_interval = 10 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] conductor.workers              = 3 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] console.allowed_origins        = [] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] console.ssl_ciphers            = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] console.ssl_minimum_version    = default {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] consoleauth.token_ttl          = 600 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cyborg.cafile                  = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cyborg.certfile                = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cyborg.collect_timing          = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cyborg.connect_retries         = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cyborg.connect_retry_delay     = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cyborg.endpoint_override       = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cyborg.insecure                = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cyborg.keyfile                 = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cyborg.max_version             = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cyborg.min_version             = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cyborg.region_name             = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cyborg.service_name            = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cyborg.service_type            = accelerator {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cyborg.split_loggers           = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cyborg.status_code_retries     = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cyborg.status_code_retry_delay = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cyborg.timeout                 = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] cyborg.version                 = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] database.backend               = sqlalchemy {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] database.connection            = **** {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] database.connection_debug      = 0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] database.connection_parameters =  {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] database.connection_recycle_time = 3600 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] database.connection_trace      = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] database.db_inc_retry_interval = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] database.db_max_retries        = 20 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] database.db_max_retry_interval = 10 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] database.db_retry_interval     = 1 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] database.max_overflow          = 50 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] database.max_pool_size         = 5 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] database.max_retries           = 10 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] database.mysql_wsrep_sync_wait = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] database.pool_timeout          = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] database.retry_interval        = 10 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] database.slave_connection      = **** {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] database.sqlite_synchronous    = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api_database.backend           = sqlalchemy {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api_database.connection        = **** {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api_database.connection_debug  = 0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api_database.connection_parameters =  {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api_database.connection_recycle_time = 3600 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api_database.connection_trace  = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api_database.db_inc_retry_interval = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api_database.db_max_retries    = 20 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api_database.db_max_retry_interval = 10 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api_database.db_retry_interval = 1 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api_database.max_overflow      = 50 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api_database.max_pool_size     = 5 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api_database.max_retries       = 10 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api_database.pool_timeout      = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api_database.retry_interval    = 10 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api_database.slave_connection  = **** {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] api_database.sqlite_synchronous = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] devices.enabled_mdev_types     = [] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ephemeral_storage_encryption.enabled = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] glance.api_servers             = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] glance.cafile                  = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] glance.certfile                = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] glance.collect_timing          = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] glance.connect_retries         = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] glance.connect_retry_delay     = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] glance.debug                   = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] glance.default_trusted_certificate_ids = [] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] glance.enable_certificate_validation = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] glance.enable_rbd_download     = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] glance.endpoint_override       = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] glance.insecure                = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] glance.keyfile                 = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] glance.max_version             = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] glance.min_version             = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] glance.num_retries             = 3 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] glance.rbd_ceph_conf           =  {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] glance.rbd_connect_timeout     = 5 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] glance.rbd_pool                =  {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] glance.rbd_user                =  {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] glance.region_name             = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] glance.service_name            = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] glance.service_type            = image {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] glance.split_loggers           = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] glance.status_code_retries     = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] glance.status_code_retry_delay = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] glance.timeout                 = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] glance.verify_glance_signatures = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] glance.version                 = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] guestfs.debug                  = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] hyperv.config_drive_cdrom      = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] hyperv.config_drive_inject_password = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] hyperv.enable_instance_metrics_collection = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] hyperv.enable_remotefx         = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] hyperv.instances_path_share    =  {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] hyperv.iscsi_initiator_list    = [] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] hyperv.limit_cpu_features      = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] hyperv.power_state_check_timeframe = 60 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] hyperv.use_multipath_io        = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] hyperv.volume_attach_retry_count = 10 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] hyperv.vswitch_name            = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] mks.enabled                    = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] image_cache.manager_interval   = 2400 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] image_cache.precache_concurrency = 1 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] image_cache.remove_unused_base_images = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] image_cache.subdirectory_name  = _base {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ironic.api_max_retries         = 60 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ironic.api_retry_interval      = 2 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ironic.auth_section            = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ironic.auth_type               = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ironic.cafile                  = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ironic.certfile                = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ironic.collect_timing          = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ironic.conductor_group         = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ironic.connect_retries         = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ironic.connect_retry_delay     = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ironic.endpoint_override       = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ironic.insecure                = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ironic.keyfile                 = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ironic.max_version             = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ironic.min_version             = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ironic.peer_list               = [] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ironic.region_name             = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ironic.serial_console_state_timeout = 10 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ironic.service_name            = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ironic.service_type            = baremetal {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ironic.split_loggers           = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ironic.status_code_retries     = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ironic.status_code_retry_delay = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ironic.timeout                 = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ironic.version                 = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] key_manager.fixed_key          = **** {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] barbican.barbican_api_version  = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] barbican.barbican_endpoint     = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] barbican.barbican_endpoint_type = public {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] barbican.barbican_region_name  = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] barbican.cafile                = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] barbican.certfile              = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] barbican.collect_timing        = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] barbican.insecure              = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] barbican.keyfile               = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] barbican.number_of_retries     = 60 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] barbican.retry_delay           = 1 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] barbican.send_service_user_token = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] barbican.split_loggers         = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] barbican.timeout               = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] barbican.verify_ssl            = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] barbican.verify_ssl_path       = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] barbican_service_user.auth_section = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] barbican_service_user.auth_type = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] barbican_service_user.cafile   = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] barbican_service_user.certfile = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] barbican_service_user.collect_timing = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] barbican_service_user.insecure = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] barbican_service_user.keyfile  = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] barbican_service_user.split_loggers = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] barbican_service_user.timeout  = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vault.approle_role_id          = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vault.approle_secret_id        = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vault.cafile                   = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vault.certfile                 = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vault.collect_timing           = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vault.insecure                 = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vault.keyfile                  = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vault.kv_mountpoint            = secret {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vault.kv_path                  = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vault.kv_version               = 2 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vault.namespace                = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vault.root_token_id            = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vault.split_loggers            = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vault.ssl_ca_crt_file          = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vault.timeout                  = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vault.use_ssl                  = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] keystone.auth_section          = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] keystone.auth_type             = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] keystone.cafile                = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] keystone.certfile              = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] keystone.collect_timing        = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] keystone.connect_retries       = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] keystone.connect_retry_delay   = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] keystone.endpoint_override     = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] keystone.insecure              = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] keystone.keyfile               = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] keystone.max_version           = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] keystone.min_version           = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] keystone.region_name           = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] keystone.service_name          = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] keystone.service_type          = identity {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] keystone.split_loggers         = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] keystone.status_code_retries   = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] keystone.status_code_retry_delay = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] keystone.timeout               = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] keystone.version               = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.connection_uri         =  {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.cpu_mode               = custom {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: WARNING oslo_config.cfg [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.cpu_power_governor_high = performance {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.cpu_power_governor_low = powersave {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.cpu_power_management   = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.device_detach_attempts = 8 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.device_detach_timeout  = 20 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.disk_cachemodes        = [] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.disk_prefix            = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.enabled_perf_events    = [] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.file_backed_memory     = 0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.gid_maps               = [] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.hw_disk_discard        = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.hw_machine_type        = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.images_rbd_glance_store_name =  {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.images_rbd_pool        = rbd {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.images_type            = default {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.images_volume_group    = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.inject_key             = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.inject_partition       = -2 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.inject_password        = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.iscsi_iface            = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.iser_use_multipath     = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.live_migration_bandwidth = 0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.live_migration_downtime = 500 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.live_migration_inbound_addr = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.live_migration_permit_post_copy = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.live_migration_scheme  = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.live_migration_timeout_action = abort {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.live_migration_tunnelled = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: WARNING oslo_config.cfg [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Oct 16 09:39:41 user nova-compute[74342]: live_migration_uri is deprecated for removal in favor of two other options that
Oct 16 09:39:41 user nova-compute[74342]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Oct 16 09:39:41 user nova-compute[74342]: and ``live_migration_inbound_addr`` respectively.
Oct 16 09:39:41 user nova-compute[74342]: ).  Its value may be silently ignored in the future.
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.live_migration_with_native_tls = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.max_queues             = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.nfs_mount_options      = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.num_memory_encrypted_guests = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.num_pcie_ports         = 0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.pmem_namespaces        = [] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.quobyte_client_cfg     = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.rbd_secret_uuid        = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.rbd_user               = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.remote_filesystem_transport = ssh {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.rescue_image_id        = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.rescue_kernel_id       = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.rescue_ramdisk_id      = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.rx_queue_size          = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.smbfs_mount_options    =  {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.snapshot_compression   = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.snapshot_image_format  = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.sparse_logical_volumes = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.swtpm_enabled          = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.swtpm_group            = tss {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.swtpm_user             = tss {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.sysinfo_serial         = unique {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.tb_cache_size          = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.tx_queue_size          = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.uid_maps               = [] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.use_virtio_for_bridges = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.virt_type              = kvm {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.volume_clear           = zero {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.volume_clear_size      = 0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.volume_use_multipath   = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.vzstorage_cache_path   = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.vzstorage_mount_user   = stack {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] neutron.auth_section           = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] neutron.auth_type              = password {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] neutron.cafile                 = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] neutron.certfile               = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] neutron.collect_timing         = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] neutron.connect_retries        = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] neutron.connect_retry_delay    = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] neutron.default_floating_pool  = public {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] neutron.endpoint_override      = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] neutron.extension_sync_interval = 600 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] neutron.http_retries           = 3 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] neutron.insecure               = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] neutron.keyfile                = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] neutron.max_version            = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] neutron.min_version            = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] neutron.ovs_bridge             = br-int {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] neutron.physnets               = [] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] neutron.region_name            = RegionOne {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] neutron.service_metadata_proxy = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] neutron.service_name           = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] neutron.service_type           = network {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] neutron.split_loggers          = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] neutron.status_code_retries    = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] neutron.status_code_retry_delay = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] neutron.timeout                = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] neutron.version                = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] notifications.bdms_in_notifications = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] notifications.default_level    = INFO {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] notifications.notification_format = unversioned {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] notifications.notify_on_state_change = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] pci.alias                      = [] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] pci.device_spec                = [] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] pci.report_in_placement        = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.auth_section         = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.auth_type            = password {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.cafile               = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.certfile             = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.collect_timing       = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.connect_retries      = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.connect_retry_delay  = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.default_domain_id    = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.default_domain_name  = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.domain_id            = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.domain_name          = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.endpoint_override    = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.insecure             = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.keyfile              = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.max_version          = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.min_version          = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.password             = **** {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.project_domain_id    = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.project_domain_name  = Default {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.project_id           = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.project_name         = service {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.region_name          = RegionOne {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.service_name         = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.service_type         = placement {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.split_loggers        = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.status_code_retries  = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.status_code_retry_delay = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.system_scope         = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.timeout              = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.trust_id             = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.user_domain_id       = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.user_domain_name     = Default {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.user_id              = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.username             = placement {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] placement.version              = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] quota.cores                    = 20 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] quota.count_usage_from_placement = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] quota.injected_file_content_bytes = 10240 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] quota.injected_file_path_length = 255 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] quota.injected_files           = 5 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] quota.instances                = 10 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] quota.key_pairs                = 100 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] quota.metadata_items           = 128 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] quota.ram                      = 51200 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] quota.recheck_quota            = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] quota.server_group_members     = 10 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] quota.server_groups            = 10 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] rdp.enabled                    = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] scheduler.image_metadata_prefilter = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] scheduler.max_attempts         = 3 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] scheduler.max_placement_results = 1000 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] scheduler.query_placement_for_image_type_support = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] scheduler.workers              = 3 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] filter_scheduler.host_subset_size = 1 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] filter_scheduler.isolated_hosts = [] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] filter_scheduler.isolated_images = [] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] filter_scheduler.pci_in_placement = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] filter_scheduler.track_instance_changes = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] metrics.required               = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] metrics.weight_multiplier      = 1.0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] metrics.weight_setting         = [] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] serial_console.enabled         = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] serial_console.port_range      = 10000:20000 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] serial_console.serialproxy_port = 6083 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] service_user.auth_section      = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] service_user.auth_type         = password {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] service_user.cafile            = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] service_user.certfile          = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] service_user.collect_timing    = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] service_user.insecure          = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] service_user.keyfile           = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] service_user.send_service_user_token = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] service_user.split_loggers     = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] service_user.timeout           = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] spice.agent_enabled            = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] spice.enabled                  = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] spice.html5proxy_port          = 6082 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] spice.image_compression        = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] spice.jpeg_compression         = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] spice.playback_compression     = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] spice.server_listen            = 127.0.0.1 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] spice.streaming_mode           = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] spice.zlib_compression         = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] upgrade_levels.baseapi         = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] upgrade_levels.cert            = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] upgrade_levels.compute         = auto {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] upgrade_levels.conductor       = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] upgrade_levels.scheduler       = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vendordata_dynamic_auth.auth_section = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vendordata_dynamic_auth.auth_type = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vendordata_dynamic_auth.cafile = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vendordata_dynamic_auth.certfile = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vendordata_dynamic_auth.insecure = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vendordata_dynamic_auth.keyfile = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vendordata_dynamic_auth.timeout = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vmware.api_retry_count         = 10 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vmware.ca_file                 = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vmware.cache_prefix            = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vmware.cluster_name            = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vmware.connection_pool_size    = 10 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vmware.console_delay_seconds   = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vmware.datastore_regex         = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vmware.host_ip                 = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vmware.host_password           = **** {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vmware.host_port               = 443 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vmware.host_username           = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vmware.insecure                = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vmware.integration_bridge      = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vmware.maximum_objects         = 100 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vmware.pbm_default_policy      = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vmware.pbm_enabled             = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vmware.pbm_wsdl_location       = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vmware.serial_port_proxy_uri   = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vmware.serial_port_service_uri = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vmware.task_poll_interval      = 0.5 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vmware.use_linked_clone        = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vmware.vnc_keymap              = en-us {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vmware.vnc_port                = 5900 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vmware.vnc_port_total          = 10000 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vnc.auth_schemes               = ['none'] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vnc.enabled                    = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vnc.novncproxy_port            = 6080 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vnc.server_listen              = 0.0.0.0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vnc.vencrypt_ca_certs          = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vnc.vencrypt_client_cert       = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vnc.vencrypt_client_key        = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] workarounds.disable_rootwrap   = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] workarounds.enable_numa_live_migration = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] workarounds.libvirt_disable_apic = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:41 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] wsgi.client_socket_timeout     = 900 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] wsgi.default_pool_size         = 1000 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] wsgi.keep_alive                = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] wsgi.max_header_line           = 16384 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] wsgi.ssl_ca_file               = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] wsgi.ssl_cert_file             = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] wsgi.ssl_key_file              = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] wsgi.tcp_keepidle              = 600 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] zvm.ca_file                    = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] zvm.cloud_connector_url        = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] zvm.reachable_timeout          = 300 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_policy.enforce_new_defaults = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_policy.enforce_scope      = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_policy.policy_default_rule = default {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_policy.policy_file        = policy.yaml {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] profiler.connection_string     = messaging:// {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] profiler.enabled               = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] profiler.es_doc_type           = notification {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] profiler.es_scroll_size        = 10000 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] profiler.es_scroll_time        = 2m {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] profiler.filter_error_trace    = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] profiler.hmac_keys             = **** {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] profiler.sentinel_service_name = mymaster {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] profiler.socket_timeout        = 0.1 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] profiler.trace_requests        = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] profiler.trace_sqlalchemy      = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] profiler_jaeger.process_tags   = {} {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] profiler_jaeger.service_name_prefix = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] profiler_otlp.service_name_prefix = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] remote_debug.host              = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] remote_debug.port              = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.ssl      = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_notifications.retry = -1 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_messaging_notifications.transport_url = **** {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_limit.auth_section        = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_limit.auth_type           = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_limit.cafile              = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_limit.certfile            = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_limit.collect_timing      = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_limit.connect_retries     = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_limit.connect_retry_delay = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_limit.endpoint_id         = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_limit.endpoint_override   = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_limit.insecure            = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_limit.keyfile             = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_limit.max_version         = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_limit.min_version         = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_limit.region_name         = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_limit.service_name        = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_limit.service_type        = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_limit.split_loggers       = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_limit.status_code_retries = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_limit.status_code_retry_delay = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_limit.timeout             = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_limit.valid_interfaces    = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_limit.version             = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_reports.file_event_handler = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] oslo_reports.log_dir           = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vif_plug_ovs_privileged.group  = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] vif_plug_ovs_privileged.user   = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] os_vif_linux_bridge.flat_interface = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] os_vif_ovs.isolate_vif         = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] os_vif_ovs.per_port_bridge     = False {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] os_brick.lock_path             = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] privsep_osbrick.capabilities   = [21] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] privsep_osbrick.group          = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] privsep_osbrick.helper_command = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] privsep_osbrick.user           = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] nova_sys_admin.group           = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] nova_sys_admin.helper_command  = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] nova_sys_admin.user            = None {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG oslo_service.service [None req-f54151d8-1834-4692-84b0-9dd263279d49 None None] ******************************************************************************** {{(pid=74342) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Oct 16 09:39:42 user nova-compute[74342]: INFO nova.service [-] Starting compute node (version 0.0.0)
Oct 16 09:39:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Connecting to libvirt: qemu:///system {{(pid=74342) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f2b880811e0> {{(pid=74342) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Oct 16 09:39:42 user nova-compute[74342]: libvirt:  error : internal error: could not initialize domain event timer
Oct 16 09:39:42 user nova-compute[74342]: WARNING nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Oct 16 09:39:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f2b880811e0> {{(pid=74342) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Starting native event thread {{(pid=74342) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Starting green dispatch thread {{(pid=74342) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Oct 16 09:39:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Starting connection event dispatch thread {{(pid=74342) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Oct 16 09:39:42 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Connection event '1' reason 'None'
Oct 16 09:39:42 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 16 09:39:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.mount [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Initialising _HostMountState generation 0 {{(pid=74342) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Oct 16 09:39:49 user nova-compute[74342]: INFO nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Libvirt host capabilities <capabilities>
Oct 16 09:39:49 user nova-compute[74342]:   <host>
Oct 16 09:39:49 user nova-compute[74342]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Oct 16 09:39:49 user nova-compute[74342]:     <cpu>
Oct 16 09:39:49 user nova-compute[74342]:       <arch>x86_64</arch>
Oct 16 09:39:49 user nova-compute[74342]:       <model>IvyBridge-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <vendor>Intel</vendor>
Oct 16 09:39:49 user nova-compute[74342]:       <microcode version='1070'/>
Oct 16 09:39:49 user nova-compute[74342]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Oct 16 09:39:49 user nova-compute[74342]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature name='ss'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature name='vmx'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature name='pcid'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature name='osxsave'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature name='hypervisor'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature name='arat'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature name='tsc_adjust'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature name='md-clear'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature name='stibp'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature name='arch-capabilities'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature name='ssbd'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature name='invtsc'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature name='rsba'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature name='skip-l1dfl-vmentry'/>
Oct 16 09:39:49 user nova-compute[74342]:       <pages unit='KiB' size='4'/>
Oct 16 09:39:49 user nova-compute[74342]:       <pages unit='KiB' size='2048'/>
Oct 16 09:39:49 user nova-compute[74342]:     </cpu>
Oct 16 09:39:49 user nova-compute[74342]:     <power_management>
Oct 16 09:39:49 user nova-compute[74342]:       <suspend_mem/>
Oct 16 09:39:49 user nova-compute[74342]:       <suspend_disk/>
Oct 16 09:39:49 user nova-compute[74342]:       <suspend_hybrid/>
Oct 16 09:39:49 user nova-compute[74342]:     </power_management>
Oct 16 09:39:49 user nova-compute[74342]:     <iommu support='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     <migration_features>
Oct 16 09:39:49 user nova-compute[74342]:       <live/>
Oct 16 09:39:49 user nova-compute[74342]:       <uri_transports>
Oct 16 09:39:49 user nova-compute[74342]:         <uri_transport>tcp</uri_transport>
Oct 16 09:39:49 user nova-compute[74342]:         <uri_transport>rdma</uri_transport>
Oct 16 09:39:49 user nova-compute[74342]:       </uri_transports>
Oct 16 09:39:49 user nova-compute[74342]:     </migration_features>
Oct 16 09:39:49 user nova-compute[74342]:     <topology>
Oct 16 09:39:49 user nova-compute[74342]:       <cells num='2'>
Oct 16 09:39:49 user nova-compute[74342]:         <cell id='0'>
Oct 16 09:39:49 user nova-compute[74342]:           <memory unit='KiB'>8140616</memory>
Oct 16 09:39:49 user nova-compute[74342]:           <pages unit='KiB' size='4'>2035154</pages>
Oct 16 09:39:49 user nova-compute[74342]:           <pages unit='KiB' size='2048'>0</pages>
Oct 16 09:39:49 user nova-compute[74342]:           <distances>
Oct 16 09:39:49 user nova-compute[74342]:             <sibling id='0' value='10'/>
Oct 16 09:39:49 user nova-compute[74342]:             <sibling id='1' value='20'/>
Oct 16 09:39:49 user nova-compute[74342]:           </distances>
Oct 16 09:39:49 user nova-compute[74342]:           <cpus num='6'>
Oct 16 09:39:49 user nova-compute[74342]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Oct 16 09:39:49 user nova-compute[74342]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Oct 16 09:39:49 user nova-compute[74342]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Oct 16 09:39:49 user nova-compute[74342]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Oct 16 09:39:49 user nova-compute[74342]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Oct 16 09:39:49 user nova-compute[74342]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Oct 16 09:39:49 user nova-compute[74342]:           </cpus>
Oct 16 09:39:49 user nova-compute[74342]:         </cell>
Oct 16 09:39:49 user nova-compute[74342]:         <cell id='1'>
Oct 16 09:39:49 user nova-compute[74342]:           <memory unit='KiB'>8255068</memory>
Oct 16 09:39:49 user nova-compute[74342]:           <pages unit='KiB' size='4'>2063767</pages>
Oct 16 09:39:49 user nova-compute[74342]:           <pages unit='KiB' size='2048'>0</pages>
Oct 16 09:39:49 user nova-compute[74342]:           <distances>
Oct 16 09:39:49 user nova-compute[74342]:             <sibling id='0' value='20'/>
Oct 16 09:39:49 user nova-compute[74342]:             <sibling id='1' value='10'/>
Oct 16 09:39:49 user nova-compute[74342]:           </distances>
Oct 16 09:39:49 user nova-compute[74342]:           <cpus num='6'>
Oct 16 09:39:49 user nova-compute[74342]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Oct 16 09:39:49 user nova-compute[74342]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Oct 16 09:39:49 user nova-compute[74342]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Oct 16 09:39:49 user nova-compute[74342]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Oct 16 09:39:49 user nova-compute[74342]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Oct 16 09:39:49 user nova-compute[74342]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Oct 16 09:39:49 user nova-compute[74342]:           </cpus>
Oct 16 09:39:49 user nova-compute[74342]:         </cell>
Oct 16 09:39:49 user nova-compute[74342]:       </cells>
Oct 16 09:39:49 user nova-compute[74342]:     </topology>
Oct 16 09:39:49 user nova-compute[74342]:     <cache>
Oct 16 09:39:49 user nova-compute[74342]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Oct 16 09:39:49 user nova-compute[74342]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Oct 16 09:39:49 user nova-compute[74342]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Oct 16 09:39:49 user nova-compute[74342]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Oct 16 09:39:49 user nova-compute[74342]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Oct 16 09:39:49 user nova-compute[74342]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Oct 16 09:39:49 user nova-compute[74342]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Oct 16 09:39:49 user nova-compute[74342]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Oct 16 09:39:49 user nova-compute[74342]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Oct 16 09:39:49 user nova-compute[74342]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Oct 16 09:39:49 user nova-compute[74342]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Oct 16 09:39:49 user nova-compute[74342]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Oct 16 09:39:49 user nova-compute[74342]:     </cache>
Oct 16 09:39:49 user nova-compute[74342]:     <secmodel>
Oct 16 09:39:49 user nova-compute[74342]:       <model>apparmor</model>
Oct 16 09:39:49 user nova-compute[74342]:       <doi>0</doi>
Oct 16 09:39:49 user nova-compute[74342]:     </secmodel>
Oct 16 09:39:49 user nova-compute[74342]:     <secmodel>
Oct 16 09:39:49 user nova-compute[74342]:       <model>dac</model>
Oct 16 09:39:49 user nova-compute[74342]:       <doi>0</doi>
Oct 16 09:39:49 user nova-compute[74342]:       <baselabel type='kvm'>+64055:+108</baselabel>
Oct 16 09:39:49 user nova-compute[74342]:       <baselabel type='qemu'>+64055:+108</baselabel>
Oct 16 09:39:49 user nova-compute[74342]:     </secmodel>
Oct 16 09:39:49 user nova-compute[74342]:   </host>
Oct 16 09:39:49 user nova-compute[74342]:   <guest>
Oct 16 09:39:49 user nova-compute[74342]:     <os_type>hvm</os_type>
Oct 16 09:39:49 user nova-compute[74342]:     <arch name='alpha'>
Oct 16 09:39:49 user nova-compute[74342]:       <wordsize>64</wordsize>
Oct 16 09:39:49 user nova-compute[74342]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>clipper</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <domain type='qemu'/>
Oct 16 09:39:49 user nova-compute[74342]:     </arch>
Oct 16 09:39:49 user nova-compute[74342]:     <features>
Oct 16 09:39:49 user nova-compute[74342]:       <cpuselection/>
Oct 16 09:39:49 user nova-compute[74342]:       <deviceboot/>
Oct 16 09:39:49 user nova-compute[74342]:       <disksnapshot default='on' toggle='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     </features>
Oct 16 09:39:49 user nova-compute[74342]:   </guest>
Oct 16 09:39:49 user nova-compute[74342]:   <guest>
Oct 16 09:39:49 user nova-compute[74342]:     <os_type>hvm</os_type>
Oct 16 09:39:49 user nova-compute[74342]:     <arch name='armv6l'>
Oct 16 09:39:49 user nova-compute[74342]:       <wordsize>32</wordsize>
Oct 16 09:39:49 user nova-compute[74342]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>integratorcp</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>borzoi</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>spitz</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>nuri</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>musca-b1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>versatileab</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>kzm</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>musca-a</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>smdkc210</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>sx1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>z2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>tosa</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>sabrelite</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>realview-eb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>n810</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>n800</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>versatilepb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>terrier</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mainstone</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>midway</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>musicpal</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>microbit</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>cubieboard</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>verdex</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>netduino2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>raspi2b</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>cheetah</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>highbank</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>akita</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>connex</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>collie</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>raspi0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <domain type='qemu'/>
Oct 16 09:39:49 user nova-compute[74342]:     </arch>
Oct 16 09:39:49 user nova-compute[74342]:     <features>
Oct 16 09:39:49 user nova-compute[74342]:       <cpuselection/>
Oct 16 09:39:49 user nova-compute[74342]:       <deviceboot/>
Oct 16 09:39:49 user nova-compute[74342]:       <disksnapshot default='on' toggle='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     </features>
Oct 16 09:39:49 user nova-compute[74342]:   </guest>
Oct 16 09:39:49 user nova-compute[74342]:   <guest>
Oct 16 09:39:49 user nova-compute[74342]:     <os_type>hvm</os_type>
Oct 16 09:39:49 user nova-compute[74342]:     <arch name='armv7l'>
Oct 16 09:39:49 user nova-compute[74342]:       <wordsize>32</wordsize>
Oct 16 09:39:49 user nova-compute[74342]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>integratorcp</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>borzoi</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>spitz</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>nuri</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>musca-b1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>versatileab</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>kzm</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>musca-a</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>smdkc210</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>sx1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>z2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>tosa</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>sabrelite</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>realview-eb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>n810</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>n800</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>versatilepb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>terrier</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mainstone</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>midway</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>musicpal</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>microbit</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>cubieboard</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>verdex</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>netduino2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>raspi2b</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>cheetah</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>highbank</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>akita</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>connex</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>collie</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>raspi0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <domain type='qemu'/>
Oct 16 09:39:49 user nova-compute[74342]:     </arch>
Oct 16 09:39:49 user nova-compute[74342]:     <features>
Oct 16 09:39:49 user nova-compute[74342]:       <cpuselection/>
Oct 16 09:39:49 user nova-compute[74342]:       <deviceboot/>
Oct 16 09:39:49 user nova-compute[74342]:       <disksnapshot default='on' toggle='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     </features>
Oct 16 09:39:49 user nova-compute[74342]:   </guest>
Oct 16 09:39:49 user nova-compute[74342]:   <guest>
Oct 16 09:39:49 user nova-compute[74342]:     <os_type>hvm</os_type>
Oct 16 09:39:49 user nova-compute[74342]:     <arch name='aarch64'>
Oct 16 09:39:49 user nova-compute[74342]:       <wordsize>64</wordsize>
Oct 16 09:39:49 user nova-compute[74342]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>integratorcp</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>ast2600-evb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>borzoi</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>spitz</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>virt-2.7</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>nuri</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>romulus-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-3.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-5.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>npcm750-evb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>virt-2.10</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>rainier-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mps3-an547</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>virt-2.8</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>musca-b1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>versatileab</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>kzm</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>musca-a</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-3.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-5.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>smdkc210</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>sx1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>virt-2.11</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>imx25-pdk</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>virt-2.9</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>orangepi-pc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>z2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-5.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>tosa</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mps2-an500</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>virt-2.12</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>mps2-an521</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>sabrelite</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mps2-an511</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>canon-a1100</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>realview-eb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>emcraft-sf2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>realview-pb-a8</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>sbsa-ref</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-4.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>raspi1ap</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>palmetto-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>sx1-v1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>n810</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>g220a-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>n800</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>tacoma-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-4.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>quanta-gsj</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>versatilepb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>terrier</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mainstone</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-4.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>mps3-an524</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>kudo-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>vexpress-a9</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>midway</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>musicpal</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>lm3s811evb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>lm3s6965evb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>microbit</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mps2-an505</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mps2-an385</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-6.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>raspi3ap</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>cubieboard</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>verdex</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>netduino2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mps2-an386</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-6.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>raspi3b</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>raspi2b</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>vexpress-a15</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2'>fuji-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='512'>virt-6.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>cheetah</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>virt-2.6</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>ast2500-evb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>highbank</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>akita</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>connex</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>netduinoplus2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>collie</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>raspi0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <domain type='qemu'/>
Oct 16 09:39:49 user nova-compute[74342]:     </arch>
Oct 16 09:39:49 user nova-compute[74342]:     <features>
Oct 16 09:39:49 user nova-compute[74342]:       <acpi default='on' toggle='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:       <cpuselection/>
Oct 16 09:39:49 user nova-compute[74342]:       <deviceboot/>
Oct 16 09:39:49 user nova-compute[74342]:       <disksnapshot default='on' toggle='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     </features>
Oct 16 09:39:49 user nova-compute[74342]:   </guest>
Oct 16 09:39:49 user nova-compute[74342]:   <guest>
Oct 16 09:39:49 user nova-compute[74342]:     <os_type>hvm</os_type>
Oct 16 09:39:49 user nova-compute[74342]:     <arch name='cris'>
Oct 16 09:39:49 user nova-compute[74342]:       <wordsize>32</wordsize>
Oct 16 09:39:49 user nova-compute[74342]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>axis-dev88</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <domain type='qemu'/>
Oct 16 09:39:49 user nova-compute[74342]:     </arch>
Oct 16 09:39:49 user nova-compute[74342]:     <features>
Oct 16 09:39:49 user nova-compute[74342]:       <cpuselection/>
Oct 16 09:39:49 user nova-compute[74342]:       <deviceboot/>
Oct 16 09:39:49 user nova-compute[74342]:       <disksnapshot default='on' toggle='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     </features>
Oct 16 09:39:49 user nova-compute[74342]:   </guest>
Oct 16 09:39:49 user nova-compute[74342]:   <guest>
Oct 16 09:39:49 user nova-compute[74342]:     <os_type>hvm</os_type>
Oct 16 09:39:49 user nova-compute[74342]:     <arch name='i686'>
Oct 16 09:39:49 user nova-compute[74342]:       <wordsize>32</wordsize>
Oct 16 09:39:49 user nova-compute[74342]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>x-remote</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>isapc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>microvm</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <domain type='qemu'/>
Oct 16 09:39:49 user nova-compute[74342]:       <domain type='kvm'/>
Oct 16 09:39:49 user nova-compute[74342]:     </arch>
Oct 16 09:39:49 user nova-compute[74342]:     <features>
Oct 16 09:39:49 user nova-compute[74342]:       <pae/>
Oct 16 09:39:49 user nova-compute[74342]:       <nonpae/>
Oct 16 09:39:49 user nova-compute[74342]:       <acpi default='on' toggle='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:       <apic default='on' toggle='no'/>
Oct 16 09:39:49 user nova-compute[74342]:       <cpuselection/>
Oct 16 09:39:49 user nova-compute[74342]:       <deviceboot/>
Oct 16 09:39:49 user nova-compute[74342]:       <disksnapshot default='on' toggle='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     </features>
Oct 16 09:39:49 user nova-compute[74342]:   </guest>
Oct 16 09:39:49 user nova-compute[74342]:   <guest>
Oct 16 09:39:49 user nova-compute[74342]:     <os_type>hvm</os_type>
Oct 16 09:39:49 user nova-compute[74342]:     <arch name='m68k'>
Oct 16 09:39:49 user nova-compute[74342]:       <wordsize>32</wordsize>
Oct 16 09:39:49 user nova-compute[74342]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mcf5208evb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>an5206</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>virt-6.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>q800</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>virt-6.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>next-cube</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>virt-6.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <domain type='qemu'/>
Oct 16 09:39:49 user nova-compute[74342]:     </arch>
Oct 16 09:39:49 user nova-compute[74342]:     <features>
Oct 16 09:39:49 user nova-compute[74342]:       <cpuselection/>
Oct 16 09:39:49 user nova-compute[74342]:       <deviceboot/>
Oct 16 09:39:49 user nova-compute[74342]:       <disksnapshot default='on' toggle='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     </features>
Oct 16 09:39:49 user nova-compute[74342]:   </guest>
Oct 16 09:39:49 user nova-compute[74342]:   <guest>
Oct 16 09:39:49 user nova-compute[74342]:     <os_type>hvm</os_type>
Oct 16 09:39:49 user nova-compute[74342]:     <arch name='microblaze'>
Oct 16 09:39:49 user nova-compute[74342]:       <wordsize>32</wordsize>
Oct 16 09:39:49 user nova-compute[74342]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <domain type='qemu'/>
Oct 16 09:39:49 user nova-compute[74342]:     </arch>
Oct 16 09:39:49 user nova-compute[74342]:     <features>
Oct 16 09:39:49 user nova-compute[74342]:       <cpuselection/>
Oct 16 09:39:49 user nova-compute[74342]:       <deviceboot/>
Oct 16 09:39:49 user nova-compute[74342]:       <disksnapshot default='on' toggle='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     </features>
Oct 16 09:39:49 user nova-compute[74342]:   </guest>
Oct 16 09:39:49 user nova-compute[74342]:   <guest>
Oct 16 09:39:49 user nova-compute[74342]:     <os_type>hvm</os_type>
Oct 16 09:39:49 user nova-compute[74342]:     <arch name='microblazeel'>
Oct 16 09:39:49 user nova-compute[74342]:       <wordsize>32</wordsize>
Oct 16 09:39:49 user nova-compute[74342]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>petalogix-ml605</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <domain type='qemu'/>
Oct 16 09:39:49 user nova-compute[74342]:     </arch>
Oct 16 09:39:49 user nova-compute[74342]:     <features>
Oct 16 09:39:49 user nova-compute[74342]:       <cpuselection/>
Oct 16 09:39:49 user nova-compute[74342]:       <deviceboot/>
Oct 16 09:39:49 user nova-compute[74342]:       <disksnapshot default='on' toggle='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     </features>
Oct 16 09:39:49 user nova-compute[74342]:   </guest>
Oct 16 09:39:49 user nova-compute[74342]:   <guest>
Oct 16 09:39:49 user nova-compute[74342]:     <os_type>hvm</os_type>
Oct 16 09:39:49 user nova-compute[74342]:     <arch name='mips'>
Oct 16 09:39:49 user nova-compute[74342]:       <wordsize>32</wordsize>
Oct 16 09:39:49 user nova-compute[74342]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='16'>malta</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mipssim</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <domain type='qemu'/>
Oct 16 09:39:49 user nova-compute[74342]:     </arch>
Oct 16 09:39:49 user nova-compute[74342]:     <features>
Oct 16 09:39:49 user nova-compute[74342]:       <cpuselection/>
Oct 16 09:39:49 user nova-compute[74342]:       <deviceboot/>
Oct 16 09:39:49 user nova-compute[74342]:       <disksnapshot default='on' toggle='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     </features>
Oct 16 09:39:49 user nova-compute[74342]:   </guest>
Oct 16 09:39:49 user nova-compute[74342]:   <guest>
Oct 16 09:39:49 user nova-compute[74342]:     <os_type>hvm</os_type>
Oct 16 09:39:49 user nova-compute[74342]:     <arch name='mipsel'>
Oct 16 09:39:49 user nova-compute[74342]:       <wordsize>32</wordsize>
Oct 16 09:39:49 user nova-compute[74342]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='16'>malta</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mipssim</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <domain type='qemu'/>
Oct 16 09:39:49 user nova-compute[74342]:     </arch>
Oct 16 09:39:49 user nova-compute[74342]:     <features>
Oct 16 09:39:49 user nova-compute[74342]:       <cpuselection/>
Oct 16 09:39:49 user nova-compute[74342]:       <deviceboot/>
Oct 16 09:39:49 user nova-compute[74342]:       <disksnapshot default='on' toggle='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     </features>
Oct 16 09:39:49 user nova-compute[74342]:   </guest>
Oct 16 09:39:49 user nova-compute[74342]:   <guest>
Oct 16 09:39:49 user nova-compute[74342]:     <os_type>hvm</os_type>
Oct 16 09:39:49 user nova-compute[74342]:     <arch name='mips64'>
Oct 16 09:39:49 user nova-compute[74342]:       <wordsize>64</wordsize>
Oct 16 09:39:49 user nova-compute[74342]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='16'>malta</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mipssim</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>pica61</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>magnum</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <domain type='qemu'/>
Oct 16 09:39:49 user nova-compute[74342]:     </arch>
Oct 16 09:39:49 user nova-compute[74342]:     <features>
Oct 16 09:39:49 user nova-compute[74342]:       <cpuselection/>
Oct 16 09:39:49 user nova-compute[74342]:       <deviceboot/>
Oct 16 09:39:49 user nova-compute[74342]:       <disksnapshot default='on' toggle='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     </features>
Oct 16 09:39:49 user nova-compute[74342]:   </guest>
Oct 16 09:39:49 user nova-compute[74342]:   <guest>
Oct 16 09:39:49 user nova-compute[74342]:     <os_type>hvm</os_type>
Oct 16 09:39:49 user nova-compute[74342]:     <arch name='mips64el'>
Oct 16 09:39:49 user nova-compute[74342]:       <wordsize>64</wordsize>
Oct 16 09:39:49 user nova-compute[74342]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='16'>malta</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='16'>loongson3-virt</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mipssim</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>pica61</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>magnum</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='16'>boston</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>fuloong2e</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <domain type='qemu'/>
Oct 16 09:39:49 user nova-compute[74342]:     </arch>
Oct 16 09:39:49 user nova-compute[74342]:     <features>
Oct 16 09:39:49 user nova-compute[74342]:       <cpuselection/>
Oct 16 09:39:49 user nova-compute[74342]:       <deviceboot/>
Oct 16 09:39:49 user nova-compute[74342]:       <disksnapshot default='on' toggle='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     </features>
Oct 16 09:39:49 user nova-compute[74342]:   </guest>
Oct 16 09:39:49 user nova-compute[74342]:   <guest>
Oct 16 09:39:49 user nova-compute[74342]:     <os_type>hvm</os_type>
Oct 16 09:39:49 user nova-compute[74342]:     <arch name='ppc'>
Oct 16 09:39:49 user nova-compute[74342]:       <wordsize>32</wordsize>
Oct 16 09:39:49 user nova-compute[74342]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>g3beige</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mac99</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='32'>ppce500</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>pegasos2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>sam460ex</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>bamboo</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>40p</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>ref405ep</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>taihu</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <domain type='qemu'/>
Oct 16 09:39:49 user nova-compute[74342]:     </arch>
Oct 16 09:39:49 user nova-compute[74342]:     <features>
Oct 16 09:39:49 user nova-compute[74342]:       <cpuselection/>
Oct 16 09:39:49 user nova-compute[74342]:       <deviceboot/>
Oct 16 09:39:49 user nova-compute[74342]:       <disksnapshot default='on' toggle='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     </features>
Oct 16 09:39:49 user nova-compute[74342]:   </guest>
Oct 16 09:39:49 user nova-compute[74342]:   <guest>
Oct 16 09:39:49 user nova-compute[74342]:     <os_type>hvm</os_type>
Oct 16 09:39:49 user nova-compute[74342]:     <arch name='ppc64'>
Oct 16 09:39:49 user nova-compute[74342]:       <wordsize>64</wordsize>
Oct 16 09:39:49 user nova-compute[74342]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2048'>powernv9</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>taihu</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2048'>powernv10</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='32'>ppce500</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>40p</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>pegasos2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>bamboo</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>g3beige</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mac99</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>sam460ex</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>ref405ep</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2048'>powernv8</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <domain type='qemu'/>
Oct 16 09:39:49 user nova-compute[74342]:     </arch>
Oct 16 09:39:49 user nova-compute[74342]:     <features>
Oct 16 09:39:49 user nova-compute[74342]:       <cpuselection/>
Oct 16 09:39:49 user nova-compute[74342]:       <deviceboot/>
Oct 16 09:39:49 user nova-compute[74342]:       <disksnapshot default='on' toggle='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     </features>
Oct 16 09:39:49 user nova-compute[74342]:   </guest>
Oct 16 09:39:49 user nova-compute[74342]:   <guest>
Oct 16 09:39:49 user nova-compute[74342]:     <os_type>hvm</os_type>
Oct 16 09:39:49 user nova-compute[74342]:     <arch name='ppc64le'>
Oct 16 09:39:49 user nova-compute[74342]:       <wordsize>64</wordsize>
Oct 16 09:39:49 user nova-compute[74342]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2048'>powernv9</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>taihu</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='15'>mpc8544ds</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2048'>powernv10</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='32'>ppce500</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>40p</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>pegasos2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>bamboo</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>g3beige</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>virtex-ml507</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>mac99</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>sam460ex</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>ref405ep</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2048'>powernv8</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <domain type='qemu'/>
Oct 16 09:39:49 user nova-compute[74342]:     </arch>
Oct 16 09:39:49 user nova-compute[74342]:     <features>
Oct 16 09:39:49 user nova-compute[74342]:       <cpuselection/>
Oct 16 09:39:49 user nova-compute[74342]:       <deviceboot/>
Oct 16 09:39:49 user nova-compute[74342]:       <disksnapshot default='on' toggle='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     </features>
Oct 16 09:39:49 user nova-compute[74342]:   </guest>
Oct 16 09:39:49 user nova-compute[74342]:   <guest>
Oct 16 09:39:49 user nova-compute[74342]:     <os_type>hvm</os_type>
Oct 16 09:39:49 user nova-compute[74342]:     <arch name='riscv32'>
Oct 16 09:39:49 user nova-compute[74342]:       <wordsize>32</wordsize>
Oct 16 09:39:49 user nova-compute[74342]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='8'>spike</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>opentitan</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='5'>sifive_u</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>sifive_e</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='8'>virt</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <domain type='qemu'/>
Oct 16 09:39:49 user nova-compute[74342]:     </arch>
Oct 16 09:39:49 user nova-compute[74342]:     <features>
Oct 16 09:39:49 user nova-compute[74342]:       <cpuselection/>
Oct 16 09:39:49 user nova-compute[74342]:       <deviceboot/>
Oct 16 09:39:49 user nova-compute[74342]:       <disksnapshot default='on' toggle='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     </features>
Oct 16 09:39:49 user nova-compute[74342]:   </guest>
Oct 16 09:39:49 user nova-compute[74342]:   <guest>
Oct 16 09:39:49 user nova-compute[74342]:     <os_type>hvm</os_type>
Oct 16 09:39:49 user nova-compute[74342]:     <arch name='riscv64'>
Oct 16 09:39:49 user nova-compute[74342]:       <wordsize>64</wordsize>
Oct 16 09:39:49 user nova-compute[74342]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='8'>spike</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='5'>sifive_u</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>shakti_c</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>sifive_e</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='8'>virt</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <domain type='qemu'/>
Oct 16 09:39:49 user nova-compute[74342]:     </arch>
Oct 16 09:39:49 user nova-compute[74342]:     <features>
Oct 16 09:39:49 user nova-compute[74342]:       <cpuselection/>
Oct 16 09:39:49 user nova-compute[74342]:       <deviceboot/>
Oct 16 09:39:49 user nova-compute[74342]:       <disksnapshot default='on' toggle='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     </features>
Oct 16 09:39:49 user nova-compute[74342]:   </guest>
Oct 16 09:39:49 user nova-compute[74342]:   <guest>
Oct 16 09:39:49 user nova-compute[74342]:     <os_type>hvm</os_type>
Oct 16 09:39:49 user nova-compute[74342]:     <arch name='s390x'>
Oct 16 09:39:49 user nova-compute[74342]:       <wordsize>64</wordsize>
Oct 16 09:39:49 user nova-compute[74342]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <domain type='qemu'/>
Oct 16 09:39:49 user nova-compute[74342]:     </arch>
Oct 16 09:39:49 user nova-compute[74342]:     <features>
Oct 16 09:39:49 user nova-compute[74342]:       <cpuselection/>
Oct 16 09:39:49 user nova-compute[74342]:       <deviceboot/>
Oct 16 09:39:49 user nova-compute[74342]:       <disksnapshot default='on' toggle='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     </features>
Oct 16 09:39:49 user nova-compute[74342]:   </guest>
Oct 16 09:39:49 user nova-compute[74342]:   <guest>
Oct 16 09:39:49 user nova-compute[74342]:     <os_type>hvm</os_type>
Oct 16 09:39:49 user nova-compute[74342]:     <arch name='sh4'>
Oct 16 09:39:49 user nova-compute[74342]:       <wordsize>32</wordsize>
Oct 16 09:39:49 user nova-compute[74342]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>shix</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>r2d</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <domain type='qemu'/>
Oct 16 09:39:49 user nova-compute[74342]:     </arch>
Oct 16 09:39:49 user nova-compute[74342]:     <features>
Oct 16 09:39:49 user nova-compute[74342]:       <cpuselection/>
Oct 16 09:39:49 user nova-compute[74342]:       <deviceboot/>
Oct 16 09:39:49 user nova-compute[74342]:       <disksnapshot default='on' toggle='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     </features>
Oct 16 09:39:49 user nova-compute[74342]:   </guest>
Oct 16 09:39:49 user nova-compute[74342]:   <guest>
Oct 16 09:39:49 user nova-compute[74342]:     <os_type>hvm</os_type>
Oct 16 09:39:49 user nova-compute[74342]:     <arch name='sh4eb'>
Oct 16 09:39:49 user nova-compute[74342]:       <wordsize>64</wordsize>
Oct 16 09:39:49 user nova-compute[74342]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>shix</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>r2d</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <domain type='qemu'/>
Oct 16 09:39:49 user nova-compute[74342]:     </arch>
Oct 16 09:39:49 user nova-compute[74342]:     <features>
Oct 16 09:39:49 user nova-compute[74342]:       <cpuselection/>
Oct 16 09:39:49 user nova-compute[74342]:       <deviceboot/>
Oct 16 09:39:49 user nova-compute[74342]:       <disksnapshot default='on' toggle='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     </features>
Oct 16 09:39:49 user nova-compute[74342]:   </guest>
Oct 16 09:39:49 user nova-compute[74342]:   <guest>
Oct 16 09:39:49 user nova-compute[74342]:     <os_type>hvm</os_type>
Oct 16 09:39:49 user nova-compute[74342]:     <arch name='sparc'>
Oct 16 09:39:49 user nova-compute[74342]:       <wordsize>32</wordsize>
Oct 16 09:39:49 user nova-compute[74342]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>SS-5</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>SS-20</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>LX</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>SPARCClassic</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>leon3_generic</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>SPARCbook</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>SS-4</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>SS-600MP</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>SS-10</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>Voyager</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <domain type='qemu'/>
Oct 16 09:39:49 user nova-compute[74342]:     </arch>
Oct 16 09:39:49 user nova-compute[74342]:     <features>
Oct 16 09:39:49 user nova-compute[74342]:       <cpuselection/>
Oct 16 09:39:49 user nova-compute[74342]:       <deviceboot/>
Oct 16 09:39:49 user nova-compute[74342]:       <disksnapshot default='on' toggle='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     </features>
Oct 16 09:39:49 user nova-compute[74342]:   </guest>
Oct 16 09:39:49 user nova-compute[74342]:   <guest>
Oct 16 09:39:49 user nova-compute[74342]:     <os_type>hvm</os_type>
Oct 16 09:39:49 user nova-compute[74342]:     <arch name='sparc64'>
Oct 16 09:39:49 user nova-compute[74342]:       <wordsize>64</wordsize>
Oct 16 09:39:49 user nova-compute[74342]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>sun4u</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>niagara</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>sun4v</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <domain type='qemu'/>
Oct 16 09:39:49 user nova-compute[74342]:     </arch>
Oct 16 09:39:49 user nova-compute[74342]:     <features>
Oct 16 09:39:49 user nova-compute[74342]:       <cpuselection/>
Oct 16 09:39:49 user nova-compute[74342]:       <deviceboot/>
Oct 16 09:39:49 user nova-compute[74342]:       <disksnapshot default='on' toggle='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     </features>
Oct 16 09:39:49 user nova-compute[74342]:   </guest>
Oct 16 09:39:49 user nova-compute[74342]:   <guest>
Oct 16 09:39:49 user nova-compute[74342]:     <os_type>hvm</os_type>
Oct 16 09:39:49 user nova-compute[74342]:     <arch name='x86_64'>
Oct 16 09:39:49 user nova-compute[74342]:       <wordsize>64</wordsize>
Oct 16 09:39:49 user nova-compute[74342]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-artful</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>x-remote</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='1'>isapc</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-disco</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-impish</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-focal</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>microvm</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <domain type='qemu'/>
Oct 16 09:39:49 user nova-compute[74342]:       <domain type='kvm'/>
Oct 16 09:39:49 user nova-compute[74342]:     </arch>
Oct 16 09:39:49 user nova-compute[74342]:     <features>
Oct 16 09:39:49 user nova-compute[74342]:       <acpi default='on' toggle='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:       <apic default='on' toggle='no'/>
Oct 16 09:39:49 user nova-compute[74342]:       <cpuselection/>
Oct 16 09:39:49 user nova-compute[74342]:       <deviceboot/>
Oct 16 09:39:49 user nova-compute[74342]:       <disksnapshot default='on' toggle='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     </features>
Oct 16 09:39:49 user nova-compute[74342]:   </guest>
Oct 16 09:39:49 user nova-compute[74342]:   <guest>
Oct 16 09:39:49 user nova-compute[74342]:     <os_type>hvm</os_type>
Oct 16 09:39:49 user nova-compute[74342]:     <arch name='xtensa'>
Oct 16 09:39:49 user nova-compute[74342]:       <wordsize>32</wordsize>
Oct 16 09:39:49 user nova-compute[74342]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>sim</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='32'>kc705</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='32'>ml605</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='32'>virt</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='32'>lx200</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='32'>lx60</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <domain type='qemu'/>
Oct 16 09:39:49 user nova-compute[74342]:     </arch>
Oct 16 09:39:49 user nova-compute[74342]:     <features>
Oct 16 09:39:49 user nova-compute[74342]:       <cpuselection/>
Oct 16 09:39:49 user nova-compute[74342]:       <deviceboot/>
Oct 16 09:39:49 user nova-compute[74342]:       <disksnapshot default='on' toggle='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     </features>
Oct 16 09:39:49 user nova-compute[74342]:   </guest>
Oct 16 09:39:49 user nova-compute[74342]:   <guest>
Oct 16 09:39:49 user nova-compute[74342]:     <os_type>hvm</os_type>
Oct 16 09:39:49 user nova-compute[74342]:     <arch name='xtensaeb'>
Oct 16 09:39:49 user nova-compute[74342]:       <wordsize>32</wordsize>
Oct 16 09:39:49 user nova-compute[74342]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='4'>sim</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='32'>kc705</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='32'>ml605</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='32'>ml605-nommu</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='32'>virt</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='32'>lx60-nommu</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='32'>lx200</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='32'>lx200-nommu</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='32'>lx60</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <machine maxCpus='32'>kc705-nommu</machine>
Oct 16 09:39:49 user nova-compute[74342]:       <domain type='qemu'/>
Oct 16 09:39:49 user nova-compute[74342]:     </arch>
Oct 16 09:39:49 user nova-compute[74342]:     <features>
Oct 16 09:39:49 user nova-compute[74342]:       <cpuselection/>
Oct 16 09:39:49 user nova-compute[74342]:       <deviceboot/>
Oct 16 09:39:49 user nova-compute[74342]:       <disksnapshot default='on' toggle='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     </features>
Oct 16 09:39:49 user nova-compute[74342]:   </guest>
Oct 16 09:39:49 user nova-compute[74342]: </capabilities>
Oct 16 09:39:49 user nova-compute[74342]: 
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=74342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=74342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=74342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=74342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=74342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=74342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=74342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=74342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=74342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Getting domain capabilities for i686 via machine types: {'pc', 'ubuntu', 'q35', 'ubuntu-q35'} {{(pid=74342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Oct 16 09:39:49 user nova-compute[74342]: <domainCapabilities>
Oct 16 09:39:49 user nova-compute[74342]:   <path>/usr/bin/qemu-system-i386</path>
Oct 16 09:39:49 user nova-compute[74342]:   <domain>kvm</domain>
Oct 16 09:39:49 user nova-compute[74342]:   <machine>pc-i440fx-6.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:   <arch>i686</arch>
Oct 16 09:39:49 user nova-compute[74342]:   <vcpu max='255'/>
Oct 16 09:39:49 user nova-compute[74342]:   <iothreads supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:   <os supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:     <enum name='firmware'/>
Oct 16 09:39:49 user nova-compute[74342]:     <loader supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='type'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>rom</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>pflash</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='readonly'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>yes</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>no</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='secure'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>no</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </loader>
Oct 16 09:39:49 user nova-compute[74342]:   </os>
Oct 16 09:39:49 user nova-compute[74342]:   <cpu>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='host-passthrough' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='hostPassthroughMigratable'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>off</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='maximum' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='maximumMigratable'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>on</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>off</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='host-model' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <vendor>Intel</vendor>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ss'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='vmx'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='pcid'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='hypervisor'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='arat'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='umip'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='md-clear'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='stibp'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ssbd'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ibpb'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ibrs'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='amd-stibp'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='disable' name='erms'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='disable' name='lm'/>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='custom' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>qemu64</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>qemu32</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>phenom</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>pentium3</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>pentium2</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>pentium</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>n270</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>kvm64</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>kvm32</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>coreduo</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>core2duo</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>athlon</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Westmere-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Westmere</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Snowridge</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Server</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Client</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>SandyBridge</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Penryn</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G5</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G4</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G3</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G2</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G1</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Nehalem-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Nehalem</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>IvyBridge</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Icelake-Server</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC-Rome</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC-Milan</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Dhyana</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Cooperlake</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Conroe</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>486</model>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:   </cpu>
Oct 16 09:39:49 user nova-compute[74342]:   <memoryBacking supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:     <enum name='sourceType'>
Oct 16 09:39:49 user nova-compute[74342]:       <value>file</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>anonymous</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>memfd</value>
Oct 16 09:39:49 user nova-compute[74342]:     </enum>
Oct 16 09:39:49 user nova-compute[74342]:   </memoryBacking>
Oct 16 09:39:49 user nova-compute[74342]:   <devices>
Oct 16 09:39:49 user nova-compute[74342]:     <disk supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='diskDevice'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>disk</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>cdrom</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>floppy</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>lun</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='bus'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>ide</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>fdc</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>scsi</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>usb</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>sata</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='model'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-non-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </disk>
Oct 16 09:39:49 user nova-compute[74342]:     <graphics supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='type'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>sdl</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>vnc</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>spice</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>egl-headless</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </graphics>
Oct 16 09:39:49 user nova-compute[74342]:     <video supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='modelType'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>vga</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>cirrus</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>vmvga</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>qxl</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>none</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>bochs</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>ramfb</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </video>
Oct 16 09:39:49 user nova-compute[74342]:     <hostdev supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='mode'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>subsystem</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='startupPolicy'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>default</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>mandatory</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>requisite</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>optional</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='subsysType'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>usb</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>pci</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>scsi</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='capsType'/>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='pciBackend'/>
Oct 16 09:39:49 user nova-compute[74342]:     </hostdev>
Oct 16 09:39:49 user nova-compute[74342]:     <rng supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='model'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-non-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='backendModel'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>random</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>egd</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>builtin</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </rng>
Oct 16 09:39:49 user nova-compute[74342]:     <filesystem supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='driverType'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>path</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>handle</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtiofs</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </filesystem>
Oct 16 09:39:49 user nova-compute[74342]:     <tpm supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='model'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>tpm-tis</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>tpm-crb</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='backendModel'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>passthrough</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>emulator</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </tpm>
Oct 16 09:39:49 user nova-compute[74342]:   </devices>
Oct 16 09:39:49 user nova-compute[74342]:   <features>
Oct 16 09:39:49 user nova-compute[74342]:     <gic supported='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     <vmcoreinfo supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <genid supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <backingStoreInput supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <backup supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <sev supported='no'/>
Oct 16 09:39:49 user nova-compute[74342]:   </features>
Oct 16 09:39:49 user nova-compute[74342]: </domainCapabilities>
Oct 16 09:39:49 user nova-compute[74342]:  {{(pid=74342) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Oct 16 09:39:49 user nova-compute[74342]: <domainCapabilities>
Oct 16 09:39:49 user nova-compute[74342]:   <path>/usr/bin/qemu-system-i386</path>
Oct 16 09:39:49 user nova-compute[74342]:   <domain>kvm</domain>
Oct 16 09:39:49 user nova-compute[74342]:   <machine>pc-i440fx-jammy</machine>
Oct 16 09:39:49 user nova-compute[74342]:   <arch>i686</arch>
Oct 16 09:39:49 user nova-compute[74342]:   <vcpu max='255'/>
Oct 16 09:39:49 user nova-compute[74342]:   <iothreads supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:   <os supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:     <enum name='firmware'/>
Oct 16 09:39:49 user nova-compute[74342]:     <loader supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='type'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>rom</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>pflash</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='readonly'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>yes</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>no</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='secure'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>no</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </loader>
Oct 16 09:39:49 user nova-compute[74342]:   </os>
Oct 16 09:39:49 user nova-compute[74342]:   <cpu>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='host-passthrough' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='hostPassthroughMigratable'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>off</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='maximum' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='maximumMigratable'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>on</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>off</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='host-model' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <vendor>Intel</vendor>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ss'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='vmx'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='pcid'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='hypervisor'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='arat'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='umip'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='md-clear'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='stibp'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ssbd'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ibpb'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ibrs'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='amd-stibp'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='disable' name='erms'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='disable' name='lm'/>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='custom' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>qemu64</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>qemu32</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>phenom</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>pentium3</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>pentium2</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>pentium</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>n270</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>kvm64</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>kvm32</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>coreduo</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>core2duo</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>athlon</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Westmere-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Westmere</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Snowridge</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Server</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Client</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>SandyBridge</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Penryn</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G5</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G4</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G3</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G2</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G1</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Nehalem-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Nehalem</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>IvyBridge</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Icelake-Server</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC-Rome</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC-Milan</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Dhyana</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Cooperlake</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Conroe</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>486</model>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:   </cpu>
Oct 16 09:39:49 user nova-compute[74342]:   <memoryBacking supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:     <enum name='sourceType'>
Oct 16 09:39:49 user nova-compute[74342]:       <value>file</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>anonymous</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>memfd</value>
Oct 16 09:39:49 user nova-compute[74342]:     </enum>
Oct 16 09:39:49 user nova-compute[74342]:   </memoryBacking>
Oct 16 09:39:49 user nova-compute[74342]:   <devices>
Oct 16 09:39:49 user nova-compute[74342]:     <disk supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='diskDevice'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>disk</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>cdrom</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>floppy</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>lun</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='bus'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>ide</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>fdc</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>scsi</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>usb</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>sata</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='model'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-non-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </disk>
Oct 16 09:39:49 user nova-compute[74342]:     <graphics supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='type'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>sdl</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>vnc</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>spice</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>egl-headless</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </graphics>
Oct 16 09:39:49 user nova-compute[74342]:     <video supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='modelType'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>vga</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>cirrus</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>vmvga</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>qxl</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>none</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>bochs</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>ramfb</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </video>
Oct 16 09:39:49 user nova-compute[74342]:     <hostdev supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='mode'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>subsystem</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='startupPolicy'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>default</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>mandatory</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>requisite</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>optional</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='subsysType'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>usb</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>pci</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>scsi</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='capsType'/>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='pciBackend'/>
Oct 16 09:39:49 user nova-compute[74342]:     </hostdev>
Oct 16 09:39:49 user nova-compute[74342]:     <rng supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='model'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-non-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='backendModel'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>random</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>egd</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>builtin</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </rng>
Oct 16 09:39:49 user nova-compute[74342]:     <filesystem supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='driverType'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>path</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>handle</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtiofs</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </filesystem>
Oct 16 09:39:49 user nova-compute[74342]:     <tpm supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='model'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>tpm-tis</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>tpm-crb</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='backendModel'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>passthrough</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>emulator</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </tpm>
Oct 16 09:39:49 user nova-compute[74342]:   </devices>
Oct 16 09:39:49 user nova-compute[74342]:   <features>
Oct 16 09:39:49 user nova-compute[74342]:     <gic supported='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     <vmcoreinfo supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <genid supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <backingStoreInput supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <backup supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <sev supported='no'/>
Oct 16 09:39:49 user nova-compute[74342]:   </features>
Oct 16 09:39:49 user nova-compute[74342]: </domainCapabilities>
Oct 16 09:39:49 user nova-compute[74342]:  {{(pid=74342) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Oct 16 09:39:49 user nova-compute[74342]: <domainCapabilities>
Oct 16 09:39:49 user nova-compute[74342]:   <path>/usr/bin/qemu-system-i386</path>
Oct 16 09:39:49 user nova-compute[74342]:   <domain>kvm</domain>
Oct 16 09:39:49 user nova-compute[74342]:   <machine>pc-q35-6.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:   <arch>i686</arch>
Oct 16 09:39:49 user nova-compute[74342]:   <vcpu max='288'/>
Oct 16 09:39:49 user nova-compute[74342]:   <iothreads supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:   <os supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:     <enum name='firmware'/>
Oct 16 09:39:49 user nova-compute[74342]:     <loader supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='type'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>rom</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>pflash</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='readonly'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>yes</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>no</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='secure'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>no</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </loader>
Oct 16 09:39:49 user nova-compute[74342]:   </os>
Oct 16 09:39:49 user nova-compute[74342]:   <cpu>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='host-passthrough' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='hostPassthroughMigratable'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>off</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='maximum' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='maximumMigratable'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>on</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>off</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='host-model' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <vendor>Intel</vendor>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ss'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='vmx'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='pcid'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='hypervisor'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='arat'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='umip'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='md-clear'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='stibp'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ssbd'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ibpb'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ibrs'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='amd-stibp'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='disable' name='erms'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='disable' name='lm'/>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='custom' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>qemu64</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>qemu32</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>phenom</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>pentium3</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>pentium2</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>pentium</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>n270</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>kvm64</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>kvm32</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>coreduo</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>core2duo</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>athlon</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Westmere-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Westmere</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Snowridge</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Server</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Client</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>SandyBridge</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Penryn</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G5</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G4</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G3</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G2</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G1</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Nehalem-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Nehalem</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>IvyBridge</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Icelake-Server</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC-Rome</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC-Milan</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Dhyana</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Cooperlake</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Conroe</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>486</model>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:   </cpu>
Oct 16 09:39:49 user nova-compute[74342]:   <memoryBacking supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:     <enum name='sourceType'>
Oct 16 09:39:49 user nova-compute[74342]:       <value>file</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>anonymous</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>memfd</value>
Oct 16 09:39:49 user nova-compute[74342]:     </enum>
Oct 16 09:39:49 user nova-compute[74342]:   </memoryBacking>
Oct 16 09:39:49 user nova-compute[74342]:   <devices>
Oct 16 09:39:49 user nova-compute[74342]:     <disk supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='diskDevice'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>disk</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>cdrom</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>floppy</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>lun</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='bus'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>fdc</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>scsi</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>usb</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>sata</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='model'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-non-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </disk>
Oct 16 09:39:49 user nova-compute[74342]:     <graphics supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='type'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>sdl</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>vnc</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>spice</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>egl-headless</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </graphics>
Oct 16 09:39:49 user nova-compute[74342]:     <video supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='modelType'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>vga</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>cirrus</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>vmvga</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>qxl</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>none</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>bochs</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>ramfb</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </video>
Oct 16 09:39:49 user nova-compute[74342]:     <hostdev supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='mode'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>subsystem</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='startupPolicy'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>default</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>mandatory</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>requisite</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>optional</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='subsysType'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>usb</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>pci</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>scsi</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='capsType'/>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='pciBackend'/>
Oct 16 09:39:49 user nova-compute[74342]:     </hostdev>
Oct 16 09:39:49 user nova-compute[74342]:     <rng supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='model'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-non-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='backendModel'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>random</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>egd</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>builtin</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </rng>
Oct 16 09:39:49 user nova-compute[74342]:     <filesystem supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='driverType'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>path</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>handle</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtiofs</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </filesystem>
Oct 16 09:39:49 user nova-compute[74342]:     <tpm supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='model'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>tpm-tis</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>tpm-crb</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='backendModel'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>passthrough</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>emulator</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </tpm>
Oct 16 09:39:49 user nova-compute[74342]:   </devices>
Oct 16 09:39:49 user nova-compute[74342]:   <features>
Oct 16 09:39:49 user nova-compute[74342]:     <gic supported='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     <vmcoreinfo supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <genid supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <backingStoreInput supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <backup supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <sev supported='no'/>
Oct 16 09:39:49 user nova-compute[74342]:   </features>
Oct 16 09:39:49 user nova-compute[74342]: </domainCapabilities>
Oct 16 09:39:49 user nova-compute[74342]:  {{(pid=74342) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Oct 16 09:39:49 user nova-compute[74342]: <domainCapabilities>
Oct 16 09:39:49 user nova-compute[74342]:   <path>/usr/bin/qemu-system-i386</path>
Oct 16 09:39:49 user nova-compute[74342]:   <domain>kvm</domain>
Oct 16 09:39:49 user nova-compute[74342]:   <machine>pc-q35-jammy</machine>
Oct 16 09:39:49 user nova-compute[74342]:   <arch>i686</arch>
Oct 16 09:39:49 user nova-compute[74342]:   <vcpu max='288'/>
Oct 16 09:39:49 user nova-compute[74342]:   <iothreads supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:   <os supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:     <enum name='firmware'/>
Oct 16 09:39:49 user nova-compute[74342]:     <loader supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='type'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>rom</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>pflash</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='readonly'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>yes</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>no</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='secure'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>no</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </loader>
Oct 16 09:39:49 user nova-compute[74342]:   </os>
Oct 16 09:39:49 user nova-compute[74342]:   <cpu>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='host-passthrough' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='hostPassthroughMigratable'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>off</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='maximum' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='maximumMigratable'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>on</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>off</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='host-model' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <vendor>Intel</vendor>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ss'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='vmx'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='pcid'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='hypervisor'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='arat'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='umip'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='md-clear'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='stibp'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ssbd'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ibpb'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ibrs'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='amd-stibp'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='disable' name='erms'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='disable' name='lm'/>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='custom' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>qemu64</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>qemu32</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>phenom</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>pentium3</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>pentium2</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>pentium</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>n270</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>kvm64</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>kvm32</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>coreduo</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>core2duo</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>athlon</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Westmere-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Westmere</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Snowridge</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Server</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Client</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>SandyBridge</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Penryn</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G5</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G4</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G3</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G2</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G1</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Nehalem-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Nehalem</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>IvyBridge</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Icelake-Server</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC-Rome</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC-Milan</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Dhyana</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Cooperlake</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Conroe</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>486</model>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:   </cpu>
Oct 16 09:39:49 user nova-compute[74342]:   <memoryBacking supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:     <enum name='sourceType'>
Oct 16 09:39:49 user nova-compute[74342]:       <value>file</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>anonymous</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>memfd</value>
Oct 16 09:39:49 user nova-compute[74342]:     </enum>
Oct 16 09:39:49 user nova-compute[74342]:   </memoryBacking>
Oct 16 09:39:49 user nova-compute[74342]:   <devices>
Oct 16 09:39:49 user nova-compute[74342]:     <disk supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='diskDevice'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>disk</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>cdrom</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>floppy</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>lun</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='bus'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>fdc</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>scsi</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>usb</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>sata</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='model'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-non-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </disk>
Oct 16 09:39:49 user nova-compute[74342]:     <graphics supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='type'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>sdl</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>vnc</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>spice</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>egl-headless</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </graphics>
Oct 16 09:39:49 user nova-compute[74342]:     <video supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='modelType'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>vga</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>cirrus</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>vmvga</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>qxl</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>none</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>bochs</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>ramfb</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </video>
Oct 16 09:39:49 user nova-compute[74342]:     <hostdev supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='mode'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>subsystem</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='startupPolicy'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>default</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>mandatory</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>requisite</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>optional</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='subsysType'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>usb</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>pci</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>scsi</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='capsType'/>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='pciBackend'/>
Oct 16 09:39:49 user nova-compute[74342]:     </hostdev>
Oct 16 09:39:49 user nova-compute[74342]:     <rng supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='model'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-non-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='backendModel'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>random</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>egd</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>builtin</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </rng>
Oct 16 09:39:49 user nova-compute[74342]:     <filesystem supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='driverType'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>path</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>handle</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtiofs</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </filesystem>
Oct 16 09:39:49 user nova-compute[74342]:     <tpm supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='model'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>tpm-tis</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>tpm-crb</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='backendModel'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>passthrough</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>emulator</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </tpm>
Oct 16 09:39:49 user nova-compute[74342]:   </devices>
Oct 16 09:39:49 user nova-compute[74342]:   <features>
Oct 16 09:39:49 user nova-compute[74342]:     <gic supported='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     <vmcoreinfo supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <genid supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <backingStoreInput supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <backup supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <sev supported='no'/>
Oct 16 09:39:49 user nova-compute[74342]:   </features>
Oct 16 09:39:49 user nova-compute[74342]: </domainCapabilities>
Oct 16 09:39:49 user nova-compute[74342]:  {{(pid=74342) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=74342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=74342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=74342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=74342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=74342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=74342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=74342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=74342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=74342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=74342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=74342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=74342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=74342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=74342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=74342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=74342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=74342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=74342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=74342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=74342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=74342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=74342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=74342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=74342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=74342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=74342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=74342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=74342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=74342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=74342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=74342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=74342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=74342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=74342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'ubuntu', 'q35', 'ubuntu-q35'} {{(pid=74342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Oct 16 09:39:49 user nova-compute[74342]: <domainCapabilities>
Oct 16 09:39:49 user nova-compute[74342]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 16 09:39:49 user nova-compute[74342]:   <domain>kvm</domain>
Oct 16 09:39:49 user nova-compute[74342]:   <machine>pc-i440fx-6.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:   <arch>x86_64</arch>
Oct 16 09:39:49 user nova-compute[74342]:   <vcpu max='255'/>
Oct 16 09:39:49 user nova-compute[74342]:   <iothreads supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:   <os supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:     <enum name='firmware'>
Oct 16 09:39:49 user nova-compute[74342]:       <value>efi</value>
Oct 16 09:39:49 user nova-compute[74342]:     </enum>
Oct 16 09:39:49 user nova-compute[74342]:     <loader supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='type'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>rom</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>pflash</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='readonly'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>yes</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>no</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='secure'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>no</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </loader>
Oct 16 09:39:49 user nova-compute[74342]:   </os>
Oct 16 09:39:49 user nova-compute[74342]:   <cpu>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='host-passthrough' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='hostPassthroughMigratable'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>on</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>off</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='maximum' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='maximumMigratable'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>on</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>off</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='host-model' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <vendor>Intel</vendor>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ss'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='vmx'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='pcid'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='hypervisor'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='arat'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='umip'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='md-clear'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='stibp'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ssbd'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='invtsc'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ibpb'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ibrs'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='amd-stibp'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='rsba'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='pschange-mc-no'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='disable' name='erms'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='custom' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>qemu64</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>qemu32</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>phenom</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>pentium3</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>pentium2</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>pentium</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>n270</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>kvm64</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>kvm32</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>coreduo</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>core2duo</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>athlon</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>Westmere-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>Westmere</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Snowridge</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Server</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Client</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>SandyBridge</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>Penryn</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G5</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G4</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G3</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G2</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>Opteron_G1</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>Nehalem</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>IvyBridge</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Icelake-Server</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC-Rome</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC-Milan</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Dhyana</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Cooperlake</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>Conroe</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>486</model>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:   </cpu>
Oct 16 09:39:49 user nova-compute[74342]:   <memoryBacking supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:     <enum name='sourceType'>
Oct 16 09:39:49 user nova-compute[74342]:       <value>file</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>anonymous</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>memfd</value>
Oct 16 09:39:49 user nova-compute[74342]:     </enum>
Oct 16 09:39:49 user nova-compute[74342]:   </memoryBacking>
Oct 16 09:39:49 user nova-compute[74342]:   <devices>
Oct 16 09:39:49 user nova-compute[74342]:     <disk supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='diskDevice'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>disk</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>cdrom</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>floppy</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>lun</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='bus'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>ide</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>fdc</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>scsi</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>usb</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>sata</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='model'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-non-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </disk>
Oct 16 09:39:49 user nova-compute[74342]:     <graphics supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='type'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>sdl</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>vnc</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>spice</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>egl-headless</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </graphics>
Oct 16 09:39:49 user nova-compute[74342]:     <video supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='modelType'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>vga</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>cirrus</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>vmvga</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>qxl</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>none</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>bochs</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>ramfb</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </video>
Oct 16 09:39:49 user nova-compute[74342]:     <hostdev supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='mode'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>subsystem</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='startupPolicy'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>default</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>mandatory</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>requisite</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>optional</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='subsysType'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>usb</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>pci</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>scsi</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='capsType'/>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='pciBackend'/>
Oct 16 09:39:49 user nova-compute[74342]:     </hostdev>
Oct 16 09:39:49 user nova-compute[74342]:     <rng supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='model'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-non-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='backendModel'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>random</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>egd</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>builtin</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </rng>
Oct 16 09:39:49 user nova-compute[74342]:     <filesystem supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='driverType'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>path</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>handle</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtiofs</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </filesystem>
Oct 16 09:39:49 user nova-compute[74342]:     <tpm supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='model'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>tpm-tis</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>tpm-crb</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='backendModel'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>passthrough</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>emulator</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </tpm>
Oct 16 09:39:49 user nova-compute[74342]:   </devices>
Oct 16 09:39:49 user nova-compute[74342]:   <features>
Oct 16 09:39:49 user nova-compute[74342]:     <gic supported='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     <vmcoreinfo supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <genid supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <backingStoreInput supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <backup supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <sev supported='no'/>
Oct 16 09:39:49 user nova-compute[74342]:   </features>
Oct 16 09:39:49 user nova-compute[74342]: </domainCapabilities>
Oct 16 09:39:49 user nova-compute[74342]:  {{(pid=74342) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Oct 16 09:39:49 user nova-compute[74342]: <domainCapabilities>
Oct 16 09:39:49 user nova-compute[74342]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 16 09:39:49 user nova-compute[74342]:   <domain>kvm</domain>
Oct 16 09:39:49 user nova-compute[74342]:   <machine>pc-i440fx-jammy</machine>
Oct 16 09:39:49 user nova-compute[74342]:   <arch>x86_64</arch>
Oct 16 09:39:49 user nova-compute[74342]:   <vcpu max='255'/>
Oct 16 09:39:49 user nova-compute[74342]:   <iothreads supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:   <os supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:     <enum name='firmware'>
Oct 16 09:39:49 user nova-compute[74342]:       <value>efi</value>
Oct 16 09:39:49 user nova-compute[74342]:     </enum>
Oct 16 09:39:49 user nova-compute[74342]:     <loader supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='type'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>rom</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>pflash</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='readonly'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>yes</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>no</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='secure'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>no</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </loader>
Oct 16 09:39:49 user nova-compute[74342]:   </os>
Oct 16 09:39:49 user nova-compute[74342]:   <cpu>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='host-passthrough' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='hostPassthroughMigratable'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>on</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>off</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='maximum' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='maximumMigratable'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>on</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>off</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='host-model' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <vendor>Intel</vendor>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ss'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='vmx'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='pcid'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='hypervisor'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='arat'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='umip'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='md-clear'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='stibp'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ssbd'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='invtsc'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ibpb'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ibrs'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='amd-stibp'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='rsba'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='pschange-mc-no'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='disable' name='erms'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='custom' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>qemu64</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>qemu32</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>phenom</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>pentium3</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>pentium2</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>pentium</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>n270</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>kvm64</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>kvm32</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>coreduo</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>core2duo</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>athlon</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>Westmere-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>Westmere</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Snowridge</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Server</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Client</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>SandyBridge</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>Penryn</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G5</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G4</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G3</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G2</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>Opteron_G1</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>Nehalem</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>IvyBridge</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Icelake-Server</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC-Rome</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC-Milan</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Dhyana</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Cooperlake</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>Conroe</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>486</model>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:   </cpu>
Oct 16 09:39:49 user nova-compute[74342]:   <memoryBacking supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:     <enum name='sourceType'>
Oct 16 09:39:49 user nova-compute[74342]:       <value>file</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>anonymous</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>memfd</value>
Oct 16 09:39:49 user nova-compute[74342]:     </enum>
Oct 16 09:39:49 user nova-compute[74342]:   </memoryBacking>
Oct 16 09:39:49 user nova-compute[74342]:   <devices>
Oct 16 09:39:49 user nova-compute[74342]:     <disk supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='diskDevice'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>disk</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>cdrom</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>floppy</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>lun</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='bus'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>ide</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>fdc</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>scsi</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>usb</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>sata</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='model'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-non-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </disk>
Oct 16 09:39:49 user nova-compute[74342]:     <graphics supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='type'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>sdl</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>vnc</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>spice</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>egl-headless</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </graphics>
Oct 16 09:39:49 user nova-compute[74342]:     <video supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='modelType'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>vga</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>cirrus</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>vmvga</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>qxl</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>none</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>bochs</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>ramfb</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </video>
Oct 16 09:39:49 user nova-compute[74342]:     <hostdev supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='mode'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>subsystem</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='startupPolicy'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>default</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>mandatory</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>requisite</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>optional</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='subsysType'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>usb</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>pci</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>scsi</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='capsType'/>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='pciBackend'/>
Oct 16 09:39:49 user nova-compute[74342]:     </hostdev>
Oct 16 09:39:49 user nova-compute[74342]:     <rng supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='model'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-non-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='backendModel'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>random</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>egd</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>builtin</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </rng>
Oct 16 09:39:49 user nova-compute[74342]:     <filesystem supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='driverType'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>path</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>handle</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtiofs</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </filesystem>
Oct 16 09:39:49 user nova-compute[74342]:     <tpm supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='model'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>tpm-tis</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>tpm-crb</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='backendModel'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>passthrough</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>emulator</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </tpm>
Oct 16 09:39:49 user nova-compute[74342]:   </devices>
Oct 16 09:39:49 user nova-compute[74342]:   <features>
Oct 16 09:39:49 user nova-compute[74342]:     <gic supported='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     <vmcoreinfo supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <genid supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <backingStoreInput supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <backup supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <sev supported='no'/>
Oct 16 09:39:49 user nova-compute[74342]:   </features>
Oct 16 09:39:49 user nova-compute[74342]: </domainCapabilities>
Oct 16 09:39:49 user nova-compute[74342]:  {{(pid=74342) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Oct 16 09:39:49 user nova-compute[74342]: <domainCapabilities>
Oct 16 09:39:49 user nova-compute[74342]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 16 09:39:49 user nova-compute[74342]:   <domain>kvm</domain>
Oct 16 09:39:49 user nova-compute[74342]:   <machine>pc-q35-6.2</machine>
Oct 16 09:39:49 user nova-compute[74342]:   <arch>x86_64</arch>
Oct 16 09:39:49 user nova-compute[74342]:   <vcpu max='288'/>
Oct 16 09:39:49 user nova-compute[74342]:   <iothreads supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:   <os supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:     <enum name='firmware'>
Oct 16 09:39:49 user nova-compute[74342]:       <value>efi</value>
Oct 16 09:39:49 user nova-compute[74342]:     </enum>
Oct 16 09:39:49 user nova-compute[74342]:     <loader supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='type'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>rom</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>pflash</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='readonly'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>yes</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>no</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='secure'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>yes</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>no</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </loader>
Oct 16 09:39:49 user nova-compute[74342]:   </os>
Oct 16 09:39:49 user nova-compute[74342]:   <cpu>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='host-passthrough' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='hostPassthroughMigratable'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>on</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>off</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='maximum' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='maximumMigratable'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>on</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>off</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='host-model' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <vendor>Intel</vendor>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ss'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='vmx'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='pcid'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='hypervisor'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='arat'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='umip'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='md-clear'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='stibp'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ssbd'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='invtsc'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ibpb'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ibrs'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='amd-stibp'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='rsba'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='pschange-mc-no'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='disable' name='erms'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='custom' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>qemu64</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>qemu32</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>phenom</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>pentium3</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>pentium2</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>pentium</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>n270</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>kvm64</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>kvm32</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>coreduo</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>core2duo</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>athlon</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>Westmere-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>Westmere</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Snowridge</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Server</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Client</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>SandyBridge</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>Penryn</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G5</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G4</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G3</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G2</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>Opteron_G1</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>Nehalem</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>IvyBridge</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Icelake-Server</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC-Rome</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC-Milan</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Dhyana</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Cooperlake</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>Conroe</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>486</model>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:   </cpu>
Oct 16 09:39:49 user nova-compute[74342]:   <memoryBacking supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:     <enum name='sourceType'>
Oct 16 09:39:49 user nova-compute[74342]:       <value>file</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>anonymous</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>memfd</value>
Oct 16 09:39:49 user nova-compute[74342]:     </enum>
Oct 16 09:39:49 user nova-compute[74342]:   </memoryBacking>
Oct 16 09:39:49 user nova-compute[74342]:   <devices>
Oct 16 09:39:49 user nova-compute[74342]:     <disk supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='diskDevice'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>disk</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>cdrom</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>floppy</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>lun</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='bus'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>fdc</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>scsi</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>usb</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>sata</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='model'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-non-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </disk>
Oct 16 09:39:49 user nova-compute[74342]:     <graphics supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='type'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>sdl</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>vnc</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>spice</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>egl-headless</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </graphics>
Oct 16 09:39:49 user nova-compute[74342]:     <video supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='modelType'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>vga</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>cirrus</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>vmvga</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>qxl</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>none</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>bochs</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>ramfb</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </video>
Oct 16 09:39:49 user nova-compute[74342]:     <hostdev supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='mode'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>subsystem</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='startupPolicy'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>default</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>mandatory</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>requisite</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>optional</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='subsysType'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>usb</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>pci</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>scsi</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='capsType'/>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='pciBackend'/>
Oct 16 09:39:49 user nova-compute[74342]:     </hostdev>
Oct 16 09:39:49 user nova-compute[74342]:     <rng supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='model'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-non-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='backendModel'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>random</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>egd</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>builtin</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </rng>
Oct 16 09:39:49 user nova-compute[74342]:     <filesystem supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='driverType'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>path</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>handle</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtiofs</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </filesystem>
Oct 16 09:39:49 user nova-compute[74342]:     <tpm supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='model'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>tpm-tis</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>tpm-crb</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='backendModel'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>passthrough</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>emulator</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </tpm>
Oct 16 09:39:49 user nova-compute[74342]:   </devices>
Oct 16 09:39:49 user nova-compute[74342]:   <features>
Oct 16 09:39:49 user nova-compute[74342]:     <gic supported='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     <vmcoreinfo supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <genid supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <backingStoreInput supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <backup supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <sev supported='no'/>
Oct 16 09:39:49 user nova-compute[74342]:   </features>
Oct 16 09:39:49 user nova-compute[74342]: </domainCapabilities>
Oct 16 09:39:49 user nova-compute[74342]:  {{(pid=74342) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Oct 16 09:39:49 user nova-compute[74342]: <domainCapabilities>
Oct 16 09:39:49 user nova-compute[74342]:   <path>/usr/bin/qemu-system-x86_64</path>
Oct 16 09:39:49 user nova-compute[74342]:   <domain>kvm</domain>
Oct 16 09:39:49 user nova-compute[74342]:   <machine>pc-q35-jammy</machine>
Oct 16 09:39:49 user nova-compute[74342]:   <arch>x86_64</arch>
Oct 16 09:39:49 user nova-compute[74342]:   <vcpu max='288'/>
Oct 16 09:39:49 user nova-compute[74342]:   <iothreads supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:   <os supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:     <enum name='firmware'>
Oct 16 09:39:49 user nova-compute[74342]:       <value>efi</value>
Oct 16 09:39:49 user nova-compute[74342]:     </enum>
Oct 16 09:39:49 user nova-compute[74342]:     <loader supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='type'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>rom</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>pflash</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='readonly'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>yes</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>no</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='secure'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>yes</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>no</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </loader>
Oct 16 09:39:49 user nova-compute[74342]:   </os>
Oct 16 09:39:49 user nova-compute[74342]:   <cpu>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='host-passthrough' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='hostPassthroughMigratable'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>on</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>off</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='maximum' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='maximumMigratable'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>on</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>off</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='host-model' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <vendor>Intel</vendor>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ss'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='vmx'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='pcid'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='hypervisor'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='arat'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='tsc_adjust'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='umip'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='md-clear'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='stibp'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='arch-capabilities'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ssbd'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='invtsc'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ibpb'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='ibrs'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='amd-stibp'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='amd-ssbd'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='rsba'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='require' name='pschange-mc-no'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='disable' name='erms'/>
Oct 16 09:39:49 user nova-compute[74342]:       <feature policy='disable' name='xsaveopt'/>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:     <mode name='custom' supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>qemu64</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>qemu32</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>phenom</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>pentium3</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>pentium2</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>pentium</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>n270</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>kvm64</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>kvm32</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>coreduo</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>core2duo</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>athlon</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>Westmere-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>Westmere</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Snowridge</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Server-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Server</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Client-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Skylake-Client</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>SandyBridge-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>SandyBridge</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>Penryn</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G5</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G4</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G3</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Opteron_G2</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>Opteron_G1</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>Nehalem-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>Nehalem</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>IvyBridge-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>IvyBridge</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Icelake-Server-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Icelake-Server</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Haswell</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC-Rome</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC-Milan</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC-IBPB</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>EPYC</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Dhyana</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Cooperlake</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>Conroe</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Cascadelake-Server</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell-noTSX</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell-IBRS</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='no'>Broadwell</model>
Oct 16 09:39:49 user nova-compute[74342]:       <model usable='yes'>486</model>
Oct 16 09:39:49 user nova-compute[74342]:     </mode>
Oct 16 09:39:49 user nova-compute[74342]:   </cpu>
Oct 16 09:39:49 user nova-compute[74342]:   <memoryBacking supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:     <enum name='sourceType'>
Oct 16 09:39:49 user nova-compute[74342]:       <value>file</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>anonymous</value>
Oct 16 09:39:49 user nova-compute[74342]:       <value>memfd</value>
Oct 16 09:39:49 user nova-compute[74342]:     </enum>
Oct 16 09:39:49 user nova-compute[74342]:   </memoryBacking>
Oct 16 09:39:49 user nova-compute[74342]:   <devices>
Oct 16 09:39:49 user nova-compute[74342]:     <disk supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='diskDevice'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>disk</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>cdrom</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>floppy</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>lun</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='bus'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>fdc</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>scsi</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>usb</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>sata</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='model'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-non-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </disk>
Oct 16 09:39:49 user nova-compute[74342]:     <graphics supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='type'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>sdl</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>vnc</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>spice</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>egl-headless</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </graphics>
Oct 16 09:39:49 user nova-compute[74342]:     <video supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='modelType'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>vga</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>cirrus</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>vmvga</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>qxl</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>none</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>bochs</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>ramfb</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </video>
Oct 16 09:39:49 user nova-compute[74342]:     <hostdev supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='mode'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>subsystem</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='startupPolicy'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>default</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>mandatory</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>requisite</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>optional</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='subsysType'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>usb</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>pci</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>scsi</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='capsType'/>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='pciBackend'/>
Oct 16 09:39:49 user nova-compute[74342]:     </hostdev>
Oct 16 09:39:49 user nova-compute[74342]:     <rng supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='model'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtio-non-transitional</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='backendModel'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>random</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>egd</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>builtin</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </rng>
Oct 16 09:39:49 user nova-compute[74342]:     <filesystem supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='driverType'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>path</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>handle</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>virtiofs</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </filesystem>
Oct 16 09:39:49 user nova-compute[74342]:     <tpm supported='yes'>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='model'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>tpm-tis</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>tpm-crb</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:       <enum name='backendModel'>
Oct 16 09:39:49 user nova-compute[74342]:         <value>passthrough</value>
Oct 16 09:39:49 user nova-compute[74342]:         <value>emulator</value>
Oct 16 09:39:49 user nova-compute[74342]:       </enum>
Oct 16 09:39:49 user nova-compute[74342]:     </tpm>
Oct 16 09:39:49 user nova-compute[74342]:   </devices>
Oct 16 09:39:49 user nova-compute[74342]:   <features>
Oct 16 09:39:49 user nova-compute[74342]:     <gic supported='no'/>
Oct 16 09:39:49 user nova-compute[74342]:     <vmcoreinfo supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <genid supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <backingStoreInput supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <backup supported='yes'/>
Oct 16 09:39:49 user nova-compute[74342]:     <sev supported='no'/>
Oct 16 09:39:49 user nova-compute[74342]:   </features>
Oct 16 09:39:49 user nova-compute[74342]: </domainCapabilities>
Oct 16 09:39:49 user nova-compute[74342]:  {{(pid=74342) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=74342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=74342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=74342) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=74342) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Checking secure boot support for host arch (x86_64) {{(pid=74342) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Checking secure boot support for host arch (x86_64) {{(pid=74342) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Checking secure boot support for host arch (x86_64) {{(pid=74342) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Checking secure boot support for host arch (x86_64) {{(pid=74342) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Checking secure boot support for host arch (x86_64) {{(pid=74342) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Oct 16 09:39:49 user nova-compute[74342]: INFO nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Secure Boot support detected
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] cpu compare xml: <cpu match="exact">
Oct 16 09:39:49 user nova-compute[74342]:   <model>Nehalem</model>
Oct 16 09:39:49 user nova-compute[74342]: </cpu>
Oct 16 09:39:49 user nova-compute[74342]:  {{(pid=74342) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Oct 16 09:39:49 user nova-compute[74342]: INFO nova.virt.node [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Generated node identity b5ec9788-0ade-4d36-b3d5-0cad880481ca
Oct 16 09:39:49 user nova-compute[74342]: INFO nova.virt.node [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Wrote node identity b5ec9788-0ade-4d36-b3d5-0cad880481ca to /opt/stack/data/nova/compute_id
Oct 16 09:39:49 user nova-compute[74342]: WARNING nova.compute.manager [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Compute nodes ['b5ec9788-0ade-4d36-b3d5-0cad880481ca'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Oct 16 09:39:49 user nova-compute[74342]: INFO nova.compute.manager [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Oct 16 09:39:49 user nova-compute[74342]: WARNING nova.compute.manager [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Oct 16 09:39:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 09:39:49 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:39:49 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:39:49 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Hypervisor/Node resource view: name=user free_ram=10990MB free_disk=26.116363525390625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:39:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:39:49 user nova-compute[74342]: WARNING nova.compute.resource_tracker [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] No compute node record for user:b5ec9788-0ade-4d36-b3d5-0cad880481ca: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host b5ec9788-0ade-4d36-b3d5-0cad880481ca could not be found.
Oct 16 09:39:50 user nova-compute[74342]: INFO nova.compute.resource_tracker [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Compute node record created for user:user with uuid: b5ec9788-0ade-4d36-b3d5-0cad880481ca
Oct 16 09:39:50 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 09:39:50 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 09:39:50 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] [req-1964cc79-eb6f-47c6-afff-7cb4e38379bb] Created resource provider record via placement API for resource provider with UUID b5ec9788-0ade-4d36-b3d5-0cad880481ca and name user.
Oct 16 09:39:50 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=74342) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Oct 16 09:39:50 user nova-compute[74342]: INFO nova.virt.libvirt.host [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] kernel doesn't support AMD SEV
Oct 16 09:39:50 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Updating inventory in ProviderTree for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 09:39:50 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:39:50 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Libvirt baseline CPU <cpu>
Oct 16 09:39:50 user nova-compute[74342]:   <arch>x86_64</arch>
Oct 16 09:39:50 user nova-compute[74342]:   <model>Nehalem</model>
Oct 16 09:39:50 user nova-compute[74342]:   <vendor>Intel</vendor>
Oct 16 09:39:50 user nova-compute[74342]:   <topology sockets="6" cores="1" threads="1"/>
Oct 16 09:39:50 user nova-compute[74342]: </cpu>
Oct 16 09:39:50 user nova-compute[74342]:  {{(pid=74342) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Oct 16 09:39:50 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Updated inventory for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Oct 16 09:39:50 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Updating resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca generation from 0 to 1 during operation: update_inventory {{(pid=74342) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 16 09:39:50 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Updating inventory in ProviderTree for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 09:39:50 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Updating resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca generation from 1 to 2 during operation: update_traits {{(pid=74342) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Oct 16 09:39:50 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 09:39:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.657s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:39:50 user nova-compute[74342]: DEBUG nova.service [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Creating RPC server for service compute {{(pid=74342) start /opt/stack/nova/nova/service.py:182}}
Oct 16 09:39:50 user nova-compute[74342]: DEBUG nova.service [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] Join ServiceGroup membership for this service compute {{(pid=74342) start /opt/stack/nova/nova/service.py:199}}
Oct 16 09:39:50 user nova-compute[74342]: DEBUG nova.servicegroup.drivers.db [None req-ee31e0b4-a9d6-42a3-b16d-93814db73355 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=74342) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Oct 16 09:39:56 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:39:56 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:40:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:40:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:40:41 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 09:40:41 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Rebuilding the list of instances to heal {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 09:40:41 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Didn't find any instances for network info cache update. {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 09:40:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:40:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:40:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:40:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:40:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:40:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:40:41 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 09:40:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:40:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:40:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:40:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:40:41 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 09:40:41 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:40:41 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:40:41 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=10409MB free_disk=26.02008056640625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 09:40:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:40:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:40:41 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 09:40:41 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 09:40:41 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:40:41 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:40:41 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 09:40:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.202s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:41:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:41:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:41:41 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 09:41:41 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Rebuilding the list of instances to heal {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 09:41:41 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Didn't find any instances for network info cache update. {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 09:41:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:41:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:41:41 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 09:41:42 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:41:42 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:41:42 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:41:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:41:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:41:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:41:42 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 09:41:42 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:41:42 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:41:42 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=10334MB free_disk=26.084075927734375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 09:41:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:41:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:41:42 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 09:41:42 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 09:41:42 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:41:42 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:41:42 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 09:41:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.129s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:41:43 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:41:43 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:41:43 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:42:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:42:42 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:42:42 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:42:42 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:42:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:42:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:42:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:42:42 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 09:42:42 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:42:42 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:42:42 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=10331MB free_disk=25.837779998779297GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 09:42:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:42:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:42:42 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 09:42:42 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 09:42:42 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:42:42 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:42:42 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 09:42:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.131s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:42:43 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:42:43 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 09:42:43 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Rebuilding the list of instances to heal {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 09:42:43 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Didn't find any instances for network info cache update. {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 09:42:43 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:42:43 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 09:42:45 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:42:45 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:42:45 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:43:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:43:42 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:43:42 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:43:42 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:43:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:43:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:43:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:43:42 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 09:43:42 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:43:42 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:43:42 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=9665MB free_disk=25.858074188232422GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 09:43:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:43:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:43:42 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 09:43:42 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 09:43:42 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:43:42 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:43:42 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 09:43:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.114s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:43:43 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:43:44 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:43:44 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 09:43:44 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Rebuilding the list of instances to heal {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 09:43:44 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Didn't find any instances for network info cache update. {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 09:43:44 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:43:44 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 09:43:46 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:43:47 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:43:47 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:43:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "d45abd20-3a58-4657-8f4c-a426d8e39be3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:43:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "d45abd20-3a58-4657-8f4c-a426d8e39be3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:43:54 user nova-compute[74342]: DEBUG nova.compute.manager [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:43:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "98367a96-22f0-4edb-ab03-a8eb286b437b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:43:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "98367a96-22f0-4edb-ab03-a8eb286b437b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:43:54 user nova-compute[74342]: DEBUG nova.compute.manager [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:43:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:43:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:43:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:43:54 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:43:54 user nova-compute[74342]: INFO nova.compute.claims [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Claim successful on node user
Oct 16 09:43:54 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:43:54 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:43:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.303s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:43:54 user nova-compute[74342]: DEBUG nova.compute.manager [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:43:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.325s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:43:54 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:43:54 user nova-compute[74342]: INFO nova.compute.claims [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Claim successful on node user
Oct 16 09:43:54 user nova-compute[74342]: DEBUG nova.compute.manager [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:43:54 user nova-compute[74342]: DEBUG nova.network.neutron [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:43:54 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:43:54 user nova-compute[74342]: DEBUG nova.compute.manager [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:43:55 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:43:55 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:43:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.341s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:43:55 user nova-compute[74342]: DEBUG nova.compute.manager [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:43:55 user nova-compute[74342]: DEBUG nova.compute.manager [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 09:43:55 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:43:55 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Creating image(s)
Oct 16 09:43:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "/opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:43:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "/opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:43:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "/opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:43:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:43:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:43:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Acquiring lock "89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:43:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Lock "89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:43:55 user nova-compute[74342]: DEBUG nova.compute.manager [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:43:55 user nova-compute[74342]: DEBUG nova.compute.manager [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:43:55 user nova-compute[74342]: DEBUG nova.network.neutron [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:43:55 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:43:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd.part --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:43:55 user nova-compute[74342]: DEBUG nova.policy [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f90f091b76254a13957807feaeaef3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fcf2437a2d413ea584d0cc2508bed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:43:55 user nova-compute[74342]: DEBUG nova.policy [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e3c728429a0a42789cfc0f1251d6f623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355bac247f9d4ea8b3c2f0d87453f4c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:43:55 user nova-compute[74342]: DEBUG nova.compute.manager [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:43:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:43:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:43:55 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:43:55 user nova-compute[74342]: INFO nova.compute.claims [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Claim successful on node user
Oct 16 09:43:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd.part --force-share --output=json" returned: 0 in 0.255s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:43:55 user nova-compute[74342]: DEBUG nova.virt.images [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] 01fbac29-34fa-4a9a-a2f8-2f304b74a717 was qcow2, converting to raw {{(pid=74342) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 09:43:55 user nova-compute[74342]: DEBUG nova.privsep.utils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 09:43:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd.part /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd.converted {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:43:55 user nova-compute[74342]: DEBUG nova.compute.manager [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 09:43:55 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:43:55 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Creating image(s)
Oct 16 09:43:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "/opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:43:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "/opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:43:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "/opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:43:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:43:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd.part /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd.converted" returned: 0 in 0.169s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:43:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd.converted --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:43:56 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:43:56 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:43:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.355s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:43:56 user nova-compute[74342]: DEBUG nova.compute.manager [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:43:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd.converted --force-share --output=json" returned: 0 in 0.182s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:43:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.085s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:43:56 user nova-compute[74342]: INFO oslo.privsep.daemon [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpvpw8cje7/privsep.sock']
Oct 16 09:43:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.231s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:43:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:43:56 user nova-compute[74342]: DEBUG nova.compute.manager [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:43:56 user nova-compute[74342]: DEBUG nova.network.neutron [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:43:56 user sudo[83571]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpvpw8cje7/privsep.sock
Oct 16 09:43:56 user sudo[83571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 16 09:43:56 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:43:56 user nova-compute[74342]: DEBUG nova.compute.manager [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:43:56 user nova-compute[74342]: DEBUG nova.policy [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '03e4a514221849f08812551e45abf14e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1fb407ddf1914bfe814d5ef3d8301a06', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:43:56 user nova-compute[74342]: DEBUG nova.compute.manager [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 09:43:56 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:43:56 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Creating image(s)
Oct 16 09:43:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Acquiring lock "/opt/stack/data/nova/instances/89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:43:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Lock "/opt/stack/data/nova/instances/89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:43:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Lock "/opt/stack/data/nova/instances/89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:43:57 user sudo[83571]: pam_unix(sudo:session): session closed for user root
Oct 16 09:43:57 user nova-compute[74342]: INFO oslo.privsep.daemon [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Spawned new privsep daemon via rootwrap
Oct 16 09:43:57 user nova-compute[74342]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 16 09:43:57 user nova-compute[74342]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 16 09:43:57 user nova-compute[74342]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Oct 16 09:43:57 user nova-compute[74342]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83599
Oct 16 09:43:57 user nova-compute[74342]: WARNING oslo_privsep.priv_context [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] privsep daemon already running
Oct 16 09:43:57 user nova-compute[74342]: WARNING oslo_privsep.priv_context [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] privsep daemon already running
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.205s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.196s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.194s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG nova.network.neutron [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Successfully created port: 2e5ec9cf-9b58-47bc-be15-0b896a7625bc {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG nova.network.neutron [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Successfully created port: 75f58c77-45a5-4951-951c-4c0bb6ac8bf3 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG nova.network.neutron [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Successfully created port: dd087947-aab3-4ee2-81c4-71d884fb003b {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.212s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk 1073741824" returned: 0 in 0.038s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.243s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.171s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Checking if we can resize image /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.174s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce/disk 1073741824" returned: 0 in 0.042s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.221s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.467s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Cannot resize image /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Ensure instance console log exists: /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.166s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Checking if we can resize image /opt/stack/data/nova/instances/89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.190s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk 1073741824" returned: 0 in 0.046s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:43:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:43:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:43:59 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Cannot resize image /opt/stack/data/nova/instances/89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 09:43:59 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 09:43:59 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Ensure instance console log exists: /opt/stack/data/nova/instances/89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:43:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:43:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:43:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:43:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.176s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:43:59 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 09:43:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:43:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:43:59 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Cannot resize image /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 09:43:59 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 09:43:59 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Ensure instance console log exists: /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:43:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:43:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:43:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Acquiring lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:00 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:44:00 user nova-compute[74342]: DEBUG nova.network.neutron [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Successfully updated port: 75f58c77-45a5-4951-951c-4c0bb6ac8bf3 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:44:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:00 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:44:00 user nova-compute[74342]: INFO nova.compute.claims [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Claim successful on node user
Oct 16 09:44:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "refresh_cache-98367a96-22f0-4edb-ab03-a8eb286b437b" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:44:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquired lock "refresh_cache-98367a96-22f0-4edb-ab03-a8eb286b437b" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:44:00 user nova-compute[74342]: DEBUG nova.network.neutron [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:44:01 user nova-compute[74342]: DEBUG nova.network.neutron [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:44:01 user nova-compute[74342]: DEBUG nova.network.neutron [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Successfully updated port: 2e5ec9cf-9b58-47bc-be15-0b896a7625bc {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:44:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "refresh_cache-d45abd20-3a58-4657-8f4c-a426d8e39be3" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:44:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquired lock "refresh_cache-d45abd20-3a58-4657-8f4c-a426d8e39be3" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:44:01 user nova-compute[74342]: DEBUG nova.network.neutron [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:44:01 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:44:01 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:44:01 user nova-compute[74342]: DEBUG nova.compute.manager [req-4f6db6e4-dc4b-4da3-af55-f35df7531693 req-84fda8e7-1507-4763-970e-a250e626a609 service nova] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Received event network-changed-75f58c77-45a5-4951-951c-4c0bb6ac8bf3 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:44:01 user nova-compute[74342]: DEBUG nova.compute.manager [req-4f6db6e4-dc4b-4da3-af55-f35df7531693 req-84fda8e7-1507-4763-970e-a250e626a609 service nova] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Refreshing instance network info cache due to event network-changed-75f58c77-45a5-4951-951c-4c0bb6ac8bf3. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:44:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4f6db6e4-dc4b-4da3-af55-f35df7531693 req-84fda8e7-1507-4763-970e-a250e626a609 service nova] Acquiring lock "refresh_cache-98367a96-22f0-4edb-ab03-a8eb286b437b" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:44:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:01 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:44:01 user nova-compute[74342]: DEBUG nova.network.neutron [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Successfully updated port: dd087947-aab3-4ee2-81c4-71d884fb003b {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:44:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Acquiring lock "refresh_cache-89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:44:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Acquired lock "refresh_cache-89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:44:01 user nova-compute[74342]: DEBUG nova.network.neutron [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:44:01 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:44:01 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:44:01 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:44:01 user nova-compute[74342]: DEBUG nova.network.neutron [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:44:01 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:44:01 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 09:44:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:44:01 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Creating image(s)
Oct 16 09:44:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Acquiring lock "/opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "/opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "/opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:01 user nova-compute[74342]: DEBUG nova.policy [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cb81780de8824c3bb51b416c5f73f2b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6679e55d6a194b399b6b2d27a8cbb147', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:44:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.333s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.network.neutron [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.217s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk 1073741824" returned: 0 in 0.056s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.206s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Checking if we can resize image /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Cannot resize image /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Ensure instance console log exists: /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.network.neutron [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Updating instance_info_cache with network_info: [{"id": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "address": "fa:16:3e:7a:58:71", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f58c77-45", "ovs_interfaceid": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Releasing lock "refresh_cache-98367a96-22f0-4edb-ab03-a8eb286b437b" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.compute.manager [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Instance network_info: |[{"id": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "address": "fa:16:3e:7a:58:71", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f58c77-45", "ovs_interfaceid": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4f6db6e4-dc4b-4da3-af55-f35df7531693 req-84fda8e7-1507-4763-970e-a250e626a609 service nova] Acquired lock "refresh_cache-98367a96-22f0-4edb-ab03-a8eb286b437b" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.network.neutron [req-4f6db6e4-dc4b-4da3-af55-f35df7531693 req-84fda8e7-1507-4763-970e-a250e626a609 service nova] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Refreshing network info cache for port 75f58c77-45a5-4951-951c-4c0bb6ac8bf3 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Start _get_guest_xml network_info=[{"id": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "address": "fa:16:3e:7a:58:71", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f58c77-45", "ovs_interfaceid": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:44:02 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:44:02 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.privsep.utils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:43:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-542181045',display_name='tempest-ServerActionsTestOtherA-server-542181045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-542181045',id=2,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5Nn7Cd9XA4JGuwKexWOVVgfutTMETbY1OUIw/2Lg/7f8J0Bw2Ei1JnC+VmVg9p5to1vwEeuuESoLWsMybdIS98JRtnBeQn9/1YcrhMFyK9tNXAGp/a4/hIqjXfamZ4kQ==',key_name='tempest-keypair-772403242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='355bac247f9d4ea8b3c2f0d87453f4c1',ramdisk_id='',reservation_id='r-0eoey4qy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1004911708',owner_user_name='tempest-ServerActionsTestOtherA-1004911708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:43:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3c728429a0a42789cfc0f1251d6f623',uuid=98367a96-22f0-4edb-ab03-a8eb286b437b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "address": "fa:16:3e:7a:58:71", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f58c77-45", "ovs_interfaceid": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Converting VIF {"id": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "address": "fa:16:3e:7a:58:71", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f58c77-45", "ovs_interfaceid": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:58:71,bridge_name='br-int',has_traffic_filtering=True,id=75f58c77-45a5-4951-951c-4c0bb6ac8bf3,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75f58c77-45') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.objects.instance [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lazy-loading 'pci_devices' on Instance uuid 98367a96-22f0-4edb-ab03-a8eb286b437b {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:44:02 user nova-compute[74342]:   <uuid>98367a96-22f0-4edb-ab03-a8eb286b437b</uuid>
Oct 16 09:44:02 user nova-compute[74342]:   <name>instance-00000002</name>
Oct 16 09:44:02 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:44:02 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:44:02 user nova-compute[74342]:   <metadata>
Oct 16 09:44:02 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:44:02 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:44:02 user nova-compute[74342]:       <nova:name>tempest-ServerActionsTestOtherA-server-542181045</nova:name>
Oct 16 09:44:02 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:44:02</nova:creationTime>
Oct 16 09:44:02 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:44:02 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:44:02 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:44:02 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:44:02 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:44:02 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:44:02 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:44:02 user nova-compute[74342]:       <nova:owner>
Oct 16 09:44:02 user nova-compute[74342]:         <nova:user uuid="e3c728429a0a42789cfc0f1251d6f623">tempest-ServerActionsTestOtherA-1004911708-project-member</nova:user>
Oct 16 09:44:02 user nova-compute[74342]:         <nova:project uuid="355bac247f9d4ea8b3c2f0d87453f4c1">tempest-ServerActionsTestOtherA-1004911708</nova:project>
Oct 16 09:44:02 user nova-compute[74342]:       </nova:owner>
Oct 16 09:44:02 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:44:02 user nova-compute[74342]:       <nova:ports>
Oct 16 09:44:02 user nova-compute[74342]:         <nova:port uuid="75f58c77-45a5-4951-951c-4c0bb6ac8bf3">
Oct 16 09:44:02 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 16 09:44:02 user nova-compute[74342]:         </nova:port>
Oct 16 09:44:02 user nova-compute[74342]:       </nova:ports>
Oct 16 09:44:02 user nova-compute[74342]:     </nova:instance>
Oct 16 09:44:02 user nova-compute[74342]:   </metadata>
Oct 16 09:44:02 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:44:02 user nova-compute[74342]:     <system>
Oct 16 09:44:02 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:44:02 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:44:02 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:44:02 user nova-compute[74342]:       <entry name="serial">98367a96-22f0-4edb-ab03-a8eb286b437b</entry>
Oct 16 09:44:02 user nova-compute[74342]:       <entry name="uuid">98367a96-22f0-4edb-ab03-a8eb286b437b</entry>
Oct 16 09:44:02 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:44:02 user nova-compute[74342]:     </system>
Oct 16 09:44:02 user nova-compute[74342]:   </sysinfo>
Oct 16 09:44:02 user nova-compute[74342]:   <os>
Oct 16 09:44:02 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:44:02 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:44:02 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:44:02 user nova-compute[74342]:   </os>
Oct 16 09:44:02 user nova-compute[74342]:   <features>
Oct 16 09:44:02 user nova-compute[74342]:     <acpi/>
Oct 16 09:44:02 user nova-compute[74342]:     <apic/>
Oct 16 09:44:02 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:44:02 user nova-compute[74342]:   </features>
Oct 16 09:44:02 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:44:02 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:44:02 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:44:02 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:44:02 user nova-compute[74342]:   </clock>
Oct 16 09:44:02 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:44:02 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:44:02 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:44:02 user nova-compute[74342]:   </cpu>
Oct 16 09:44:02 user nova-compute[74342]:   <devices>
Oct 16 09:44:02 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 09:44:02 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 09:44:02 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk"/>
Oct 16 09:44:02 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:44:02 user nova-compute[74342]:     </disk>
Oct 16 09:44:02 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:44:02 user nova-compute[74342]:       <mac address="fa:16:3e:7a:58:71"/>
Oct 16 09:44:02 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:44:02 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:44:02 user nova-compute[74342]:       <target dev="tap75f58c77-45"/>
Oct 16 09:44:02 user nova-compute[74342]:     </interface>
Oct 16 09:44:02 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:44:02 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/console.log" append="off"/>
Oct 16 09:44:02 user nova-compute[74342]:     </serial>
Oct 16 09:44:02 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:44:02 user nova-compute[74342]:     <video>
Oct 16 09:44:02 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:44:02 user nova-compute[74342]:     </video>
Oct 16 09:44:02 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:44:02 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:44:02 user nova-compute[74342]:     </rng>
Oct 16 09:44:02 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:44:02 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:44:02 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:44:02 user nova-compute[74342]:     </memballoon>
Oct 16 09:44:02 user nova-compute[74342]:   </devices>
Oct 16 09:44:02 user nova-compute[74342]: </domain>
Oct 16 09:44:02 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:43:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-542181045',display_name='tempest-ServerActionsTestOtherA-server-542181045',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-542181045',id=2,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5Nn7Cd9XA4JGuwKexWOVVgfutTMETbY1OUIw/2Lg/7f8J0Bw2Ei1JnC+VmVg9p5to1vwEeuuESoLWsMybdIS98JRtnBeQn9/1YcrhMFyK9tNXAGp/a4/hIqjXfamZ4kQ==',key_name='tempest-keypair-772403242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='355bac247f9d4ea8b3c2f0d87453f4c1',ramdisk_id='',reservation_id='r-0eoey4qy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1004911708',owner_user_name='tempest-ServerActionsTestOtherA-1004911708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:43:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3c728429a0a42789cfc0f1251d6f623',uuid=98367a96-22f0-4edb-ab03-a8eb286b437b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "address": "fa:16:3e:7a:58:71", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f58c77-45", "ovs_interfaceid": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Converting VIF {"id": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "address": "fa:16:3e:7a:58:71", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f58c77-45", "ovs_interfaceid": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:58:71,bridge_name='br-int',has_traffic_filtering=True,id=75f58c77-45a5-4951-951c-4c0bb6ac8bf3,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75f58c77-45') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG os_vif [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:58:71,bridge_name='br-int',has_traffic_filtering=True,id=75f58c77-45a5-4951-951c-4c0bb6ac8bf3,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75f58c77-45') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:44:02 user nova-compute[74342]: DEBUG nova.network.neutron [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Updating instance_info_cache with network_info: [{"id": "2e5ec9cf-9b58-47bc-be15-0b896a7625bc", "address": "fa:16:3e:8c:de:8b", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e5ec9cf-9b", "ovs_interfaceid": "2e5ec9cf-9b58-47bc-be15-0b896a7625bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Created schema index Interface.name {{(pid=74342) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Created schema index Port.name {{(pid=74342) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Created schema index Bridge.name {{(pid=74342) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [POLLOUT] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Releasing lock "refresh_cache-d45abd20-3a58-4657-8f4c-a426d8e39be3" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.compute.manager [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Instance network_info: |[{"id": "2e5ec9cf-9b58-47bc-be15-0b896a7625bc", "address": "fa:16:3e:8c:de:8b", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e5ec9cf-9b", "ovs_interfaceid": "2e5ec9cf-9b58-47bc-be15-0b896a7625bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Start _get_guest_xml network_info=[{"id": "2e5ec9cf-9b58-47bc-be15-0b896a7625bc", "address": "fa:16:3e:8c:de:8b", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e5ec9cf-9b", "ovs_interfaceid": "2e5ec9cf-9b58-47bc-be15-0b896a7625bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81f01117-f9fb-52e4-9858-46424532ba95', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:03 user nova-compute[74342]: INFO oslo.privsep.daemon [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpu812hrk8/privsep.sock']
Oct 16 09:44:03 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:44:03 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:44:03 user sudo[83670]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpu812hrk8/privsep.sock
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:44:03 user sudo[83670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:43:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-664158185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-664158185',id=1,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4fcf2437a2d413ea584d0cc2508bed3',ramdisk_id='',reservation_id='r-nswunun9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-476995503',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:43:56Z,user_data=None,user_id='f90f091b76254a13957807feaeaef3fc',uuid=d45abd20-3a58-4657-8f4c-a426d8e39be3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e5ec9cf-9b58-47bc-be15-0b896a7625bc", "address": "fa:16:3e:8c:de:8b", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e5ec9cf-9b", "ovs_interfaceid": "2e5ec9cf-9b58-47bc-be15-0b896a7625bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Converting VIF {"id": "2e5ec9cf-9b58-47bc-be15-0b896a7625bc", "address": "fa:16:3e:8c:de:8b", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e5ec9cf-9b", "ovs_interfaceid": "2e5ec9cf-9b58-47bc-be15-0b896a7625bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:de:8b,bridge_name='br-int',has_traffic_filtering=True,id=2e5ec9cf-9b58-47bc-be15-0b896a7625bc,network=Network(a571ad70-6f8b-4b02-86b9-df50290509f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e5ec9cf-9b') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.objects.instance [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lazy-loading 'pci_devices' on Instance uuid d45abd20-3a58-4657-8f4c-a426d8e39be3 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:44:03 user nova-compute[74342]:   <uuid>d45abd20-3a58-4657-8f4c-a426d8e39be3</uuid>
Oct 16 09:44:03 user nova-compute[74342]:   <name>instance-00000001</name>
Oct 16 09:44:03 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:44:03 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:44:03 user nova-compute[74342]:   <metadata>
Oct 16 09:44:03 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:44:03 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:44:03 user nova-compute[74342]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-664158185</nova:name>
Oct 16 09:44:03 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:44:03</nova:creationTime>
Oct 16 09:44:03 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:44:03 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:44:03 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:44:03 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:44:03 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:44:03 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:44:03 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:44:03 user nova-compute[74342]:       <nova:owner>
Oct 16 09:44:03 user nova-compute[74342]:         <nova:user uuid="f90f091b76254a13957807feaeaef3fc">tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member</nova:user>
Oct 16 09:44:03 user nova-compute[74342]:         <nova:project uuid="a4fcf2437a2d413ea584d0cc2508bed3">tempest-ServerBootFromVolumeStableRescueTest-476995503</nova:project>
Oct 16 09:44:03 user nova-compute[74342]:       </nova:owner>
Oct 16 09:44:03 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:44:03 user nova-compute[74342]:       <nova:ports>
Oct 16 09:44:03 user nova-compute[74342]:         <nova:port uuid="2e5ec9cf-9b58-47bc-be15-0b896a7625bc">
Oct 16 09:44:03 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 16 09:44:03 user nova-compute[74342]:         </nova:port>
Oct 16 09:44:03 user nova-compute[74342]:       </nova:ports>
Oct 16 09:44:03 user nova-compute[74342]:     </nova:instance>
Oct 16 09:44:03 user nova-compute[74342]:   </metadata>
Oct 16 09:44:03 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:44:03 user nova-compute[74342]:     <system>
Oct 16 09:44:03 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:44:03 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:44:03 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:44:03 user nova-compute[74342]:       <entry name="serial">d45abd20-3a58-4657-8f4c-a426d8e39be3</entry>
Oct 16 09:44:03 user nova-compute[74342]:       <entry name="uuid">d45abd20-3a58-4657-8f4c-a426d8e39be3</entry>
Oct 16 09:44:03 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:44:03 user nova-compute[74342]:     </system>
Oct 16 09:44:03 user nova-compute[74342]:   </sysinfo>
Oct 16 09:44:03 user nova-compute[74342]:   <os>
Oct 16 09:44:03 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:44:03 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:44:03 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:44:03 user nova-compute[74342]:   </os>
Oct 16 09:44:03 user nova-compute[74342]:   <features>
Oct 16 09:44:03 user nova-compute[74342]:     <acpi/>
Oct 16 09:44:03 user nova-compute[74342]:     <apic/>
Oct 16 09:44:03 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:44:03 user nova-compute[74342]:   </features>
Oct 16 09:44:03 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:44:03 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:44:03 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:44:03 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:44:03 user nova-compute[74342]:   </clock>
Oct 16 09:44:03 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:44:03 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:44:03 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:44:03 user nova-compute[74342]:   </cpu>
Oct 16 09:44:03 user nova-compute[74342]:   <devices>
Oct 16 09:44:03 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 09:44:03 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 09:44:03 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk"/>
Oct 16 09:44:03 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:44:03 user nova-compute[74342]:     </disk>
Oct 16 09:44:03 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:44:03 user nova-compute[74342]:       <mac address="fa:16:3e:8c:de:8b"/>
Oct 16 09:44:03 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:44:03 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:44:03 user nova-compute[74342]:       <target dev="tap2e5ec9cf-9b"/>
Oct 16 09:44:03 user nova-compute[74342]:     </interface>
Oct 16 09:44:03 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:44:03 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/console.log" append="off"/>
Oct 16 09:44:03 user nova-compute[74342]:     </serial>
Oct 16 09:44:03 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:44:03 user nova-compute[74342]:     <video>
Oct 16 09:44:03 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:44:03 user nova-compute[74342]:     </video>
Oct 16 09:44:03 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:44:03 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:44:03 user nova-compute[74342]:     </rng>
Oct 16 09:44:03 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:44:03 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:44:03 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:44:03 user nova-compute[74342]:     </memballoon>
Oct 16 09:44:03 user nova-compute[74342]:   </devices>
Oct 16 09:44:03 user nova-compute[74342]: </domain>
Oct 16 09:44:03 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:43:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-664158185',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-664158185',id=1,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4fcf2437a2d413ea584d0cc2508bed3',ramdisk_id='',reservation_id='r-nswunun9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-476995503',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:43:56Z,user_data=None,user_id='f90f091b76254a13957807feaeaef3fc',uuid=d45abd20-3a58-4657-8f4c-a426d8e39be3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e5ec9cf-9b58-47bc-be15-0b896a7625bc", "address": "fa:16:3e:8c:de:8b", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e5ec9cf-9b", "ovs_interfaceid": "2e5ec9cf-9b58-47bc-be15-0b896a7625bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Converting VIF {"id": "2e5ec9cf-9b58-47bc-be15-0b896a7625bc", "address": "fa:16:3e:8c:de:8b", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e5ec9cf-9b", "ovs_interfaceid": "2e5ec9cf-9b58-47bc-be15-0b896a7625bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8c:de:8b,bridge_name='br-int',has_traffic_filtering=True,id=2e5ec9cf-9b58-47bc-be15-0b896a7625bc,network=Network(a571ad70-6f8b-4b02-86b9-df50290509f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e5ec9cf-9b') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG os_vif [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:de:8b,bridge_name='br-int',has_traffic_filtering=True,id=2e5ec9cf-9b58-47bc-be15-0b896a7625bc,network=Network(a571ad70-6f8b-4b02-86b9-df50290509f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e5ec9cf-9b') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.network.neutron [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Updating instance_info_cache with network_info: [{"id": "dd087947-aab3-4ee2-81c4-71d884fb003b", "address": "fa:16:3e:75:76:65", "network": {"id": "976fca4a-3d61-444a-abc9-845ebf17a00e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-205035660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fb407ddf1914bfe814d5ef3d8301a06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd087947-aa", "ovs_interfaceid": "dd087947-aab3-4ee2-81c4-71d884fb003b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3f6e161f-aea0-5321-8417-a4e85725b22e', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Releasing lock "refresh_cache-89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.compute.manager [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Instance network_info: |[{"id": "dd087947-aab3-4ee2-81c4-71d884fb003b", "address": "fa:16:3e:75:76:65", "network": {"id": "976fca4a-3d61-444a-abc9-845ebf17a00e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-205035660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fb407ddf1914bfe814d5ef3d8301a06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd087947-aa", "ovs_interfaceid": "dd087947-aab3-4ee2-81c4-71d884fb003b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Start _get_guest_xml network_info=[{"id": "dd087947-aab3-4ee2-81c4-71d884fb003b", "address": "fa:16:3e:75:76:65", "network": {"id": "976fca4a-3d61-444a-abc9-845ebf17a00e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-205035660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fb407ddf1914bfe814d5ef3d8301a06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd087947-aa", "ovs_interfaceid": "dd087947-aab3-4ee2-81c4-71d884fb003b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:44:03 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:44:03 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:43:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1499584542',display_name='tempest-DeleteServersTestJSON-server-1499584542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1499584542',id=3,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fb407ddf1914bfe814d5ef3d8301a06',ramdisk_id='',reservation_id='r-gas22d5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-431827328',owner_user_name='tempest-DeleteServersTestJSON-431827328-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:43:56Z,user_data=None,user_id='03e4a514221849f08812551e45abf14e',uuid=89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd087947-aab3-4ee2-81c4-71d884fb003b", "address": "fa:16:3e:75:76:65", "network": {"id": "976fca4a-3d61-444a-abc9-845ebf17a00e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-205035660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fb407ddf1914bfe814d5ef3d8301a06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd087947-aa", "ovs_interfaceid": "dd087947-aab3-4ee2-81c4-71d884fb003b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Converting VIF {"id": "dd087947-aab3-4ee2-81c4-71d884fb003b", "address": "fa:16:3e:75:76:65", "network": {"id": "976fca4a-3d61-444a-abc9-845ebf17a00e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-205035660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fb407ddf1914bfe814d5ef3d8301a06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd087947-aa", "ovs_interfaceid": "dd087947-aab3-4ee2-81c4-71d884fb003b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:76:65,bridge_name='br-int',has_traffic_filtering=True,id=dd087947-aab3-4ee2-81c4-71d884fb003b,network=Network(976fca4a-3d61-444a-abc9-845ebf17a00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd087947-aa') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.objects.instance [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Lazy-loading 'pci_devices' on Instance uuid 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:44:03 user nova-compute[74342]:   <uuid>89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce</uuid>
Oct 16 09:44:03 user nova-compute[74342]:   <name>instance-00000003</name>
Oct 16 09:44:03 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:44:03 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:44:03 user nova-compute[74342]:   <metadata>
Oct 16 09:44:03 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:44:03 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:44:03 user nova-compute[74342]:       <nova:name>tempest-DeleteServersTestJSON-server-1499584542</nova:name>
Oct 16 09:44:03 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:44:03</nova:creationTime>
Oct 16 09:44:03 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:44:03 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:44:03 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:44:03 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:44:03 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:44:03 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:44:03 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:44:03 user nova-compute[74342]:       <nova:owner>
Oct 16 09:44:03 user nova-compute[74342]:         <nova:user uuid="03e4a514221849f08812551e45abf14e">tempest-DeleteServersTestJSON-431827328-project-member</nova:user>
Oct 16 09:44:03 user nova-compute[74342]:         <nova:project uuid="1fb407ddf1914bfe814d5ef3d8301a06">tempest-DeleteServersTestJSON-431827328</nova:project>
Oct 16 09:44:03 user nova-compute[74342]:       </nova:owner>
Oct 16 09:44:03 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:44:03 user nova-compute[74342]:       <nova:ports>
Oct 16 09:44:03 user nova-compute[74342]:         <nova:port uuid="dd087947-aab3-4ee2-81c4-71d884fb003b">
Oct 16 09:44:03 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Oct 16 09:44:03 user nova-compute[74342]:         </nova:port>
Oct 16 09:44:03 user nova-compute[74342]:       </nova:ports>
Oct 16 09:44:03 user nova-compute[74342]:     </nova:instance>
Oct 16 09:44:03 user nova-compute[74342]:   </metadata>
Oct 16 09:44:03 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:44:03 user nova-compute[74342]:     <system>
Oct 16 09:44:03 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:44:03 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:44:03 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:44:03 user nova-compute[74342]:       <entry name="serial">89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce</entry>
Oct 16 09:44:03 user nova-compute[74342]:       <entry name="uuid">89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce</entry>
Oct 16 09:44:03 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:44:03 user nova-compute[74342]:     </system>
Oct 16 09:44:03 user nova-compute[74342]:   </sysinfo>
Oct 16 09:44:03 user nova-compute[74342]:   <os>
Oct 16 09:44:03 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:44:03 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:44:03 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:44:03 user nova-compute[74342]:   </os>
Oct 16 09:44:03 user nova-compute[74342]:   <features>
Oct 16 09:44:03 user nova-compute[74342]:     <acpi/>
Oct 16 09:44:03 user nova-compute[74342]:     <apic/>
Oct 16 09:44:03 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:44:03 user nova-compute[74342]:   </features>
Oct 16 09:44:03 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:44:03 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:44:03 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:44:03 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:44:03 user nova-compute[74342]:   </clock>
Oct 16 09:44:03 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:44:03 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:44:03 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:44:03 user nova-compute[74342]:   </cpu>
Oct 16 09:44:03 user nova-compute[74342]:   <devices>
Oct 16 09:44:03 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 09:44:03 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 09:44:03 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce/disk"/>
Oct 16 09:44:03 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:44:03 user nova-compute[74342]:     </disk>
Oct 16 09:44:03 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:44:03 user nova-compute[74342]:       <mac address="fa:16:3e:75:76:65"/>
Oct 16 09:44:03 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:44:03 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:44:03 user nova-compute[74342]:       <target dev="tapdd087947-aa"/>
Oct 16 09:44:03 user nova-compute[74342]:     </interface>
Oct 16 09:44:03 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:44:03 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce/console.log" append="off"/>
Oct 16 09:44:03 user nova-compute[74342]:     </serial>
Oct 16 09:44:03 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:44:03 user nova-compute[74342]:     <video>
Oct 16 09:44:03 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:44:03 user nova-compute[74342]:     </video>
Oct 16 09:44:03 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:44:03 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:44:03 user nova-compute[74342]:     </rng>
Oct 16 09:44:03 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:44:03 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:44:03 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:44:03 user nova-compute[74342]:     </memballoon>
Oct 16 09:44:03 user nova-compute[74342]:   </devices>
Oct 16 09:44:03 user nova-compute[74342]: </domain>
Oct 16 09:44:03 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:43:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1499584542',display_name='tempest-DeleteServersTestJSON-server-1499584542',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1499584542',id=3,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1fb407ddf1914bfe814d5ef3d8301a06',ramdisk_id='',reservation_id='r-gas22d5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-431827328',owner_user_name='tempest-DeleteServersTestJSON-431827328-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:43:56Z,user_data=None,user_id='03e4a514221849f08812551e45abf14e',uuid=89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dd087947-aab3-4ee2-81c4-71d884fb003b", "address": "fa:16:3e:75:76:65", "network": {"id": "976fca4a-3d61-444a-abc9-845ebf17a00e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-205035660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fb407ddf1914bfe814d5ef3d8301a06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd087947-aa", "ovs_interfaceid": "dd087947-aab3-4ee2-81c4-71d884fb003b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Converting VIF {"id": "dd087947-aab3-4ee2-81c4-71d884fb003b", "address": "fa:16:3e:75:76:65", "network": {"id": "976fca4a-3d61-444a-abc9-845ebf17a00e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-205035660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fb407ddf1914bfe814d5ef3d8301a06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd087947-aa", "ovs_interfaceid": "dd087947-aab3-4ee2-81c4-71d884fb003b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:76:65,bridge_name='br-int',has_traffic_filtering=True,id=dd087947-aab3-4ee2-81c4-71d884fb003b,network=Network(976fca4a-3d61-444a-abc9-845ebf17a00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd087947-aa') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG os_vif [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:76:65,bridge_name='br-int',has_traffic_filtering=True,id=dd087947-aab3-4ee2-81c4-71d884fb003b,network=Network(976fca4a-3d61-444a-abc9-845ebf17a00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd087947-aa') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd778e37e-ea7e-51f2-9e1b-2122cc18d911', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.compute.manager [req-6dfe4b7f-ba91-4628-8eec-6183bf097df5 req-417e3ef4-eb05-4902-8376-b4bd065c870f service nova] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Received event network-changed-2e5ec9cf-9b58-47bc-be15-0b896a7625bc {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.compute.manager [req-6dfe4b7f-ba91-4628-8eec-6183bf097df5 req-417e3ef4-eb05-4902-8376-b4bd065c870f service nova] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Refreshing instance network info cache due to event network-changed-2e5ec9cf-9b58-47bc-be15-0b896a7625bc. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-6dfe4b7f-ba91-4628-8eec-6183bf097df5 req-417e3ef4-eb05-4902-8376-b4bd065c870f service nova] Acquiring lock "refresh_cache-d45abd20-3a58-4657-8f4c-a426d8e39be3" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-6dfe4b7f-ba91-4628-8eec-6183bf097df5 req-417e3ef4-eb05-4902-8376-b4bd065c870f service nova] Acquired lock "refresh_cache-d45abd20-3a58-4657-8f4c-a426d8e39be3" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG nova.network.neutron [req-6dfe4b7f-ba91-4628-8eec-6183bf097df5 req-417e3ef4-eb05-4902-8376-b4bd065c870f service nova] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Refreshing network info cache for port 2e5ec9cf-9b58-47bc-be15-0b896a7625bc {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:44:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:04 user nova-compute[74342]: DEBUG nova.network.neutron [req-4f6db6e4-dc4b-4da3-af55-f35df7531693 req-84fda8e7-1507-4763-970e-a250e626a609 service nova] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Updated VIF entry in instance network info cache for port 75f58c77-45a5-4951-951c-4c0bb6ac8bf3. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:44:04 user nova-compute[74342]: DEBUG nova.network.neutron [req-4f6db6e4-dc4b-4da3-af55-f35df7531693 req-84fda8e7-1507-4763-970e-a250e626a609 service nova] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Updating instance_info_cache with network_info: [{"id": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "address": "fa:16:3e:7a:58:71", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f58c77-45", "ovs_interfaceid": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:44:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4f6db6e4-dc4b-4da3-af55-f35df7531693 req-84fda8e7-1507-4763-970e-a250e626a609 service nova] Releasing lock "refresh_cache-98367a96-22f0-4edb-ab03-a8eb286b437b" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:44:04 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Successfully created port: 6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:44:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:04 user sudo[83670]: pam_unix(sudo:session): session closed for user root
Oct 16 09:44:04 user nova-compute[74342]: INFO oslo.privsep.daemon [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Spawned new privsep daemon via rootwrap
Oct 16 09:44:04 user nova-compute[74342]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 16 09:44:04 user nova-compute[74342]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 16 09:44:04 user nova-compute[74342]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Oct 16 09:44:04 user nova-compute[74342]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 83677
Oct 16 09:44:04 user nova-compute[74342]: WARNING oslo_privsep.priv_context [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] privsep daemon already running
Oct 16 09:44:04 user nova-compute[74342]: WARNING oslo_privsep.priv_context [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] privsep daemon already running
Oct 16 09:44:05 user nova-compute[74342]: DEBUG nova.network.neutron [req-6dfe4b7f-ba91-4628-8eec-6183bf097df5 req-417e3ef4-eb05-4902-8376-b4bd065c870f service nova] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Updated VIF entry in instance network info cache for port 2e5ec9cf-9b58-47bc-be15-0b896a7625bc. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG nova.network.neutron [req-6dfe4b7f-ba91-4628-8eec-6183bf097df5 req-417e3ef4-eb05-4902-8376-b4bd065c870f service nova] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Updating instance_info_cache with network_info: [{"id": "2e5ec9cf-9b58-47bc-be15-0b896a7625bc", "address": "fa:16:3e:8c:de:8b", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e5ec9cf-9b", "ovs_interfaceid": "2e5ec9cf-9b58-47bc-be15-0b896a7625bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-6dfe4b7f-ba91-4628-8eec-6183bf097df5 req-417e3ef4-eb05-4902-8376-b4bd065c870f service nova] Releasing lock "refresh_cache-d45abd20-3a58-4657-8f4c-a426d8e39be3" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG nova.compute.manager [req-6dfe4b7f-ba91-4628-8eec-6183bf097df5 req-417e3ef4-eb05-4902-8376-b4bd065c870f service nova] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Received event network-changed-dd087947-aab3-4ee2-81c4-71d884fb003b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG nova.compute.manager [req-6dfe4b7f-ba91-4628-8eec-6183bf097df5 req-417e3ef4-eb05-4902-8376-b4bd065c870f service nova] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Refreshing instance network info cache due to event network-changed-dd087947-aab3-4ee2-81c4-71d884fb003b. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-6dfe4b7f-ba91-4628-8eec-6183bf097df5 req-417e3ef4-eb05-4902-8376-b4bd065c870f service nova] Acquiring lock "refresh_cache-89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-6dfe4b7f-ba91-4628-8eec-6183bf097df5 req-417e3ef4-eb05-4902-8376-b4bd065c870f service nova] Acquired lock "refresh_cache-89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG nova.network.neutron [req-6dfe4b7f-ba91-4628-8eec-6183bf097df5 req-417e3ef4-eb05-4902-8376-b4bd065c870f service nova] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Refreshing network info cache for port dd087947-aab3-4ee2-81c4-71d884fb003b {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e5ec9cf-9b, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e5ec9cf-9b, col_values=(('qos', UUID('59a206b1-497f-491f-b6f8-ba53303b8fae')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e5ec9cf-9b, col_values=(('external_ids', {'iface-id': '2e5ec9cf-9b58-47bc-be15-0b896a7625bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8c:de:8b', 'vm-uuid': 'd45abd20-3a58-4657-8f4c-a426d8e39be3'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:05 user nova-compute[74342]: INFO os_vif [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8c:de:8b,bridge_name='br-int',has_traffic_filtering=True,id=2e5ec9cf-9b58-47bc-be15-0b896a7625bc,network=Network(a571ad70-6f8b-4b02-86b9-df50290509f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e5ec9cf-9b')
Oct 16 09:44:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdd087947-aa, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdd087947-aa, col_values=(('qos', UUID('c7edad58-335a-4272-a5ce-6d65e179a506')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdd087947-aa, col_values=(('external_ids', {'iface-id': 'dd087947-aab3-4ee2-81c4-71d884fb003b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:76:65', 'vm-uuid': '89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:05 user nova-compute[74342]: INFO os_vif [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:76:65,bridge_name='br-int',has_traffic_filtering=True,id=dd087947-aab3-4ee2-81c4-71d884fb003b,network=Network(976fca4a-3d61-444a-abc9-845ebf17a00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd087947-aa')
Oct 16 09:44:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75f58c77-45, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75f58c77-45, col_values=(('qos', UUID('f37cbab4-6de2-4ac9-b383-339c85142525')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75f58c77-45, col_values=(('external_ids', {'iface-id': '75f58c77-45a5-4951-951c-4c0bb6ac8bf3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:58:71', 'vm-uuid': '98367a96-22f0-4edb-ab03-a8eb286b437b'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:05 user nova-compute[74342]: INFO os_vif [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:58:71,bridge_name='br-int',has_traffic_filtering=True,id=75f58c77-45a5-4951-951c-4c0bb6ac8bf3,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75f58c77-45')
Oct 16 09:44:05 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] No VIF found with MAC fa:16:3e:8c:de:8b, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] No VIF found with MAC fa:16:3e:7a:58:71, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] No VIF found with MAC fa:16:3e:75:76:65, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Successfully updated port: 6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Acquiring lock "refresh_cache-bdcd2e60-b36c-4d87-94d7-076e7430e1f0" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Acquired lock "refresh_cache-bdcd2e60-b36c-4d87-94d7-076e7430e1f0" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG nova.compute.manager [req-21ffc88a-4f5f-42e1-8174-e2ca6b6e5e0b req-0f4464bf-b6b3-4376-b0cf-8af7516a6d92 service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Received event network-changed-6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG nova.compute.manager [req-21ffc88a-4f5f-42e1-8174-e2ca6b6e5e0b req-0f4464bf-b6b3-4376-b0cf-8af7516a6d92 service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Refreshing instance network info cache due to event network-changed-6880e1ef-5122-458c-a9b8-a8202cdee055. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-21ffc88a-4f5f-42e1-8174-e2ca6b6e5e0b req-0f4464bf-b6b3-4376-b0cf-8af7516a6d92 service nova] Acquiring lock "refresh_cache-bdcd2e60-b36c-4d87-94d7-076e7430e1f0" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:44:05 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Updating instance_info_cache with network_info: [{"id": "6880e1ef-5122-458c-a9b8-a8202cdee055", "address": "fa:16:3e:22:60:5b", "network": {"id": "b9e6ad97-cbbe-40e7-b487-5fc89166bc6a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-718322219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6679e55d6a194b399b6b2d27a8cbb147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6880e1ef-51", "ovs_interfaceid": "6880e1ef-5122-458c-a9b8-a8202cdee055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Releasing lock "refresh_cache-bdcd2e60-b36c-4d87-94d7-076e7430e1f0" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Instance network_info: |[{"id": "6880e1ef-5122-458c-a9b8-a8202cdee055", "address": "fa:16:3e:22:60:5b", "network": {"id": "b9e6ad97-cbbe-40e7-b487-5fc89166bc6a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-718322219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6679e55d6a194b399b6b2d27a8cbb147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6880e1ef-51", "ovs_interfaceid": "6880e1ef-5122-458c-a9b8-a8202cdee055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-21ffc88a-4f5f-42e1-8174-e2ca6b6e5e0b req-0f4464bf-b6b3-4376-b0cf-8af7516a6d92 service nova] Acquired lock "refresh_cache-bdcd2e60-b36c-4d87-94d7-076e7430e1f0" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.network.neutron [req-21ffc88a-4f5f-42e1-8174-e2ca6b6e5e0b req-0f4464bf-b6b3-4376-b0cf-8af7516a6d92 service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Refreshing network info cache for port 6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Start _get_guest_xml network_info=[{"id": "6880e1ef-5122-458c-a9b8-a8202cdee055", "address": "fa:16:3e:22:60:5b", "network": {"id": "b9e6ad97-cbbe-40e7-b487-5fc89166bc6a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-718322219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6679e55d6a194b399b6b2d27a8cbb147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6880e1ef-51", "ovs_interfaceid": "6880e1ef-5122-458c-a9b8-a8202cdee055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:44:06 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:44:06 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:44:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1284670649',display_name='tempest-ServerStableDeviceRescueTest-server-1284670649',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1284670649',id=4,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrXoD5Hrtp0ROS6ovoeBvzjEfPpR4UjjC7ZqIID+HojYD/xMrg9FWvTD4l6ndTedTgydSxzmceB9u2uBK/WxkE0f/ZCFoLaDqAKtcEYleUSzfATZXWIic1PChOdLmXIwA==',key_name='tempest-keypair-1191894411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6679e55d6a194b399b6b2d27a8cbb147',ramdisk_id='',reservation_id='r-2zs156t5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-864442118',owner_user_name='tempest-ServerStableDeviceRescueTest-864442118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:44:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb81780de8824c3bb51b416c5f73f2b5',uuid=bdcd2e60-b36c-4d87-94d7-076e7430e1f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6880e1ef-5122-458c-a9b8-a8202cdee055", "address": "fa:16:3e:22:60:5b", "network": {"id": "b9e6ad97-cbbe-40e7-b487-5fc89166bc6a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-718322219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6679e55d6a194b399b6b2d27a8cbb147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6880e1ef-51", "ovs_interfaceid": "6880e1ef-5122-458c-a9b8-a8202cdee055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Converting VIF {"id": "6880e1ef-5122-458c-a9b8-a8202cdee055", "address": "fa:16:3e:22:60:5b", "network": {"id": "b9e6ad97-cbbe-40e7-b487-5fc89166bc6a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-718322219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6679e55d6a194b399b6b2d27a8cbb147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6880e1ef-51", "ovs_interfaceid": "6880e1ef-5122-458c-a9b8-a8202cdee055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:60:5b,bridge_name='br-int',has_traffic_filtering=True,id=6880e1ef-5122-458c-a9b8-a8202cdee055,network=Network(b9e6ad97-cbbe-40e7-b487-5fc89166bc6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6880e1ef-51') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.objects.instance [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lazy-loading 'pci_devices' on Instance uuid bdcd2e60-b36c-4d87-94d7-076e7430e1f0 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:44:06 user nova-compute[74342]:   <uuid>bdcd2e60-b36c-4d87-94d7-076e7430e1f0</uuid>
Oct 16 09:44:06 user nova-compute[74342]:   <name>instance-00000004</name>
Oct 16 09:44:06 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:44:06 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:44:06 user nova-compute[74342]:   <metadata>
Oct 16 09:44:06 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:44:06 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:44:06 user nova-compute[74342]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1284670649</nova:name>
Oct 16 09:44:06 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:44:06</nova:creationTime>
Oct 16 09:44:06 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:44:06 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:44:06 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:44:06 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:44:06 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:44:06 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:44:06 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:44:06 user nova-compute[74342]:       <nova:owner>
Oct 16 09:44:06 user nova-compute[74342]:         <nova:user uuid="cb81780de8824c3bb51b416c5f73f2b5">tempest-ServerStableDeviceRescueTest-864442118-project-member</nova:user>
Oct 16 09:44:06 user nova-compute[74342]:         <nova:project uuid="6679e55d6a194b399b6b2d27a8cbb147">tempest-ServerStableDeviceRescueTest-864442118</nova:project>
Oct 16 09:44:06 user nova-compute[74342]:       </nova:owner>
Oct 16 09:44:06 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:44:06 user nova-compute[74342]:       <nova:ports>
Oct 16 09:44:06 user nova-compute[74342]:         <nova:port uuid="6880e1ef-5122-458c-a9b8-a8202cdee055">
Oct 16 09:44:06 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 16 09:44:06 user nova-compute[74342]:         </nova:port>
Oct 16 09:44:06 user nova-compute[74342]:       </nova:ports>
Oct 16 09:44:06 user nova-compute[74342]:     </nova:instance>
Oct 16 09:44:06 user nova-compute[74342]:   </metadata>
Oct 16 09:44:06 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:44:06 user nova-compute[74342]:     <system>
Oct 16 09:44:06 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:44:06 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:44:06 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:44:06 user nova-compute[74342]:       <entry name="serial">bdcd2e60-b36c-4d87-94d7-076e7430e1f0</entry>
Oct 16 09:44:06 user nova-compute[74342]:       <entry name="uuid">bdcd2e60-b36c-4d87-94d7-076e7430e1f0</entry>
Oct 16 09:44:06 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:44:06 user nova-compute[74342]:     </system>
Oct 16 09:44:06 user nova-compute[74342]:   </sysinfo>
Oct 16 09:44:06 user nova-compute[74342]:   <os>
Oct 16 09:44:06 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:44:06 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:44:06 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:44:06 user nova-compute[74342]:   </os>
Oct 16 09:44:06 user nova-compute[74342]:   <features>
Oct 16 09:44:06 user nova-compute[74342]:     <acpi/>
Oct 16 09:44:06 user nova-compute[74342]:     <apic/>
Oct 16 09:44:06 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:44:06 user nova-compute[74342]:   </features>
Oct 16 09:44:06 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:44:06 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:44:06 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:44:06 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:44:06 user nova-compute[74342]:   </clock>
Oct 16 09:44:06 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:44:06 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:44:06 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:44:06 user nova-compute[74342]:   </cpu>
Oct 16 09:44:06 user nova-compute[74342]:   <devices>
Oct 16 09:44:06 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 09:44:06 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 09:44:06 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk"/>
Oct 16 09:44:06 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:44:06 user nova-compute[74342]:     </disk>
Oct 16 09:44:06 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:44:06 user nova-compute[74342]:       <mac address="fa:16:3e:22:60:5b"/>
Oct 16 09:44:06 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:44:06 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:44:06 user nova-compute[74342]:       <target dev="tap6880e1ef-51"/>
Oct 16 09:44:06 user nova-compute[74342]:     </interface>
Oct 16 09:44:06 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:44:06 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/console.log" append="off"/>
Oct 16 09:44:06 user nova-compute[74342]:     </serial>
Oct 16 09:44:06 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:44:06 user nova-compute[74342]:     <video>
Oct 16 09:44:06 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:44:06 user nova-compute[74342]:     </video>
Oct 16 09:44:06 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:44:06 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:44:06 user nova-compute[74342]:     </rng>
Oct 16 09:44:06 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:44:06 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:44:06 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:44:06 user nova-compute[74342]:     </memballoon>
Oct 16 09:44:06 user nova-compute[74342]:   </devices>
Oct 16 09:44:06 user nova-compute[74342]: </domain>
Oct 16 09:44:06 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:44:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1284670649',display_name='tempest-ServerStableDeviceRescueTest-server-1284670649',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1284670649',id=4,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrXoD5Hrtp0ROS6ovoeBvzjEfPpR4UjjC7ZqIID+HojYD/xMrg9FWvTD4l6ndTedTgydSxzmceB9u2uBK/WxkE0f/ZCFoLaDqAKtcEYleUSzfATZXWIic1PChOdLmXIwA==',key_name='tempest-keypair-1191894411',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6679e55d6a194b399b6b2d27a8cbb147',ramdisk_id='',reservation_id='r-2zs156t5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-864442118',owner_user_name='tempest-ServerStableDeviceRescueTest-864442118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:44:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb81780de8824c3bb51b416c5f73f2b5',uuid=bdcd2e60-b36c-4d87-94d7-076e7430e1f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6880e1ef-5122-458c-a9b8-a8202cdee055", "address": "fa:16:3e:22:60:5b", "network": {"id": "b9e6ad97-cbbe-40e7-b487-5fc89166bc6a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-718322219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6679e55d6a194b399b6b2d27a8cbb147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6880e1ef-51", "ovs_interfaceid": "6880e1ef-5122-458c-a9b8-a8202cdee055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Converting VIF {"id": "6880e1ef-5122-458c-a9b8-a8202cdee055", "address": "fa:16:3e:22:60:5b", "network": {"id": "b9e6ad97-cbbe-40e7-b487-5fc89166bc6a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-718322219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6679e55d6a194b399b6b2d27a8cbb147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6880e1ef-51", "ovs_interfaceid": "6880e1ef-5122-458c-a9b8-a8202cdee055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:60:5b,bridge_name='br-int',has_traffic_filtering=True,id=6880e1ef-5122-458c-a9b8-a8202cdee055,network=Network(b9e6ad97-cbbe-40e7-b487-5fc89166bc6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6880e1ef-51') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG os_vif [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:60:5b,bridge_name='br-int',has_traffic_filtering=True,id=6880e1ef-5122-458c-a9b8-a8202cdee055,network=Network(b9e6ad97-cbbe-40e7-b487-5fc89166bc6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6880e1ef-51') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7cf4ab1b-81f4-5c95-8b26-4e9bf36f968f', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6880e1ef-51, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6880e1ef-51, col_values=(('qos', UUID('9c4c895b-7ccc-4ebd-99b2-7ad96b755bb0')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6880e1ef-51, col_values=(('external_ids', {'iface-id': '6880e1ef-5122-458c-a9b8-a8202cdee055', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:60:5b', 'vm-uuid': 'bdcd2e60-b36c-4d87-94d7-076e7430e1f0'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:06 user nova-compute[74342]: INFO os_vif [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:60:5b,bridge_name='br-int',has_traffic_filtering=True,id=6880e1ef-5122-458c-a9b8-a8202cdee055,network=Network(b9e6ad97-cbbe-40e7-b487-5fc89166bc6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6880e1ef-51')
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] No VIF found with MAC fa:16:3e:22:60:5b, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.network.neutron [req-6dfe4b7f-ba91-4628-8eec-6183bf097df5 req-417e3ef4-eb05-4902-8376-b4bd065c870f service nova] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Updated VIF entry in instance network info cache for port dd087947-aab3-4ee2-81c4-71d884fb003b. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.network.neutron [req-6dfe4b7f-ba91-4628-8eec-6183bf097df5 req-417e3ef4-eb05-4902-8376-b4bd065c870f service nova] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Updating instance_info_cache with network_info: [{"id": "dd087947-aab3-4ee2-81c4-71d884fb003b", "address": "fa:16:3e:75:76:65", "network": {"id": "976fca4a-3d61-444a-abc9-845ebf17a00e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-205035660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fb407ddf1914bfe814d5ef3d8301a06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd087947-aa", "ovs_interfaceid": "dd087947-aab3-4ee2-81c4-71d884fb003b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-6dfe4b7f-ba91-4628-8eec-6183bf097df5 req-417e3ef4-eb05-4902-8376-b4bd065c870f service nova] Releasing lock "refresh_cache-89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.network.neutron [req-21ffc88a-4f5f-42e1-8174-e2ca6b6e5e0b req-0f4464bf-b6b3-4376-b0cf-8af7516a6d92 service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Updated VIF entry in instance network info cache for port 6880e1ef-5122-458c-a9b8-a8202cdee055. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG nova.network.neutron [req-21ffc88a-4f5f-42e1-8174-e2ca6b6e5e0b req-0f4464bf-b6b3-4376-b0cf-8af7516a6d92 service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Updating instance_info_cache with network_info: [{"id": "6880e1ef-5122-458c-a9b8-a8202cdee055", "address": "fa:16:3e:22:60:5b", "network": {"id": "b9e6ad97-cbbe-40e7-b487-5fc89166bc6a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-718322219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6679e55d6a194b399b6b2d27a8cbb147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6880e1ef-51", "ovs_interfaceid": "6880e1ef-5122-458c-a9b8-a8202cdee055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:44:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-21ffc88a-4f5f-42e1-8174-e2ca6b6e5e0b req-0f4464bf-b6b3-4376-b0cf-8af7516a6d92 service nova] Releasing lock "refresh_cache-bdcd2e60-b36c-4d87-94d7-076e7430e1f0" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:44:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Acquiring lock "d3ed0377-ff2b-4a15-9175-a70624aa913d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lock "d3ed0377-ff2b-4a15-9175-a70624aa913d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:12 user nova-compute[74342]: DEBUG nova.compute.manager [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:44:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:44:12 user nova-compute[74342]: INFO nova.compute.claims [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Claim successful on node user
Oct 16 09:44:12 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:44:12 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:44:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.427s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:12 user nova-compute[74342]: DEBUG nova.compute.manager [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:44:12 user nova-compute[74342]: DEBUG nova.compute.manager [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:44:12 user nova-compute[74342]: DEBUG nova.network.neutron [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:44:12 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Oct 16 09:44:12 user nova-compute[74342]: DEBUG nova.compute.manager [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:44:13 user nova-compute[74342]: DEBUG nova.policy [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '364c71ffa3a94817bda4910f6c4f8e0c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '698c3910471646ee8bb8632484e3787b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:44:13 user nova-compute[74342]: DEBUG nova.compute.manager [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 09:44:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:44:13 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Creating image(s)
Oct 16 09:44:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Acquiring lock "/opt/stack/data/nova/instances/d3ed0377-ff2b-4a15-9175-a70624aa913d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lock "/opt/stack/data/nova/instances/d3ed0377-ff2b-4a15-9175-a70624aa913d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lock "/opt/stack/data/nova/instances/d3ed0377-ff2b-4a15-9175-a70624aa913d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Acquiring lock "f5f1ce72ae61e1e6e02683e51ca48f3ec5b2dbb8" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lock "f5f1ce72ae61e1e6e02683e51ca48f3ec5b2dbb8" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5f1ce72ae61e1e6e02683e51ca48f3ec5b2dbb8.part --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5f1ce72ae61e1e6e02683e51ca48f3ec5b2dbb8.part --force-share --output=json" returned: 0 in 0.194s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:13 user nova-compute[74342]: DEBUG nova.virt.images [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] 43e89f0e-d30a-4f69-89b3-85a57e8811ea was qcow2, converting to raw {{(pid=74342) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 09:44:13 user nova-compute[74342]: DEBUG nova.privsep.utils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 09:44:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f5f1ce72ae61e1e6e02683e51ca48f3ec5b2dbb8.part /opt/stack/data/nova/instances/_base/f5f1ce72ae61e1e6e02683e51ca48f3ec5b2dbb8.converted {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:13 user nova-compute[74342]: DEBUG nova.compute.manager [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:44:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:44:13 user nova-compute[74342]: DEBUG nova.compute.manager [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:44:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:44:13 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Instance spawned successfully.
Oct 16 09:44:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:44:14 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Instance spawned successfully.
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:14 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Instance spawned successfully.
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f5f1ce72ae61e1e6e02683e51ca48f3ec5b2dbb8.part /opt/stack/data/nova/instances/_base/f5f1ce72ae61e1e6e02683e51ca48f3ec5b2dbb8.converted" returned: 0 in 0.460s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5f1ce72ae61e1e6e02683e51ca48f3ec5b2dbb8.converted --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.compute.manager [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:44:14 user nova-compute[74342]: INFO nova.compute.manager [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Took 19.30 seconds to spawn the instance on the hypervisor.
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.compute.manager [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:14 user nova-compute[74342]: INFO nova.compute.manager [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Took 18.49 seconds to spawn the instance on the hypervisor.
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.compute.manager [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:44:14 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Instance spawned successfully.
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.network.neutron [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Successfully created port: c7e71629-bc93-41ff-bd86-e1f6be6aec6b {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:44:14 user nova-compute[74342]: INFO nova.compute.manager [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Took 20.28 seconds to build instance.
Oct 16 09:44:14 user nova-compute[74342]: INFO nova.compute.manager [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Took 13.01 seconds to spawn the instance on the hypervisor.
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:44:14 user nova-compute[74342]: INFO nova.compute.manager [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Took 18.08 seconds to spawn the instance on the hypervisor.
Oct 16 09:44:14 user nova-compute[74342]: DEBUG nova.compute.manager [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-13145e97-1098-419d-bcf8-e6f48605ac22 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "98367a96-22f0-4edb-ab03-a8eb286b437b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.608s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5f1ce72ae61e1e6e02683e51ca48f3ec5b2dbb8.converted --force-share --output=json" returned: 0 in 0.367s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lock "f5f1ce72ae61e1e6e02683e51ca48f3ec5b2dbb8" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.529s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5f1ce72ae61e1e6e02683e51ca48f3ec5b2dbb8 --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:14 user nova-compute[74342]: INFO nova.compute.manager [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Took 13.93 seconds to build instance.
Oct 16 09:44:14 user nova-compute[74342]: INFO nova.compute.manager [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Took 19.07 seconds to build instance.
Oct 16 09:44:14 user nova-compute[74342]: INFO nova.compute.manager [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Took 20.52 seconds to build instance.
Oct 16 09:44:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c956d38d-db8d-4c9a-9c8c-72e8fc7f0544 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.105s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6184b3e7-c8b8-47ce-9fff-8981230012c5 tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Lock "89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.740s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2864f017-433f-4b4a-9439-8a6f32b4e854 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "d45abd20-3a58-4657-8f4c-a426d8e39be3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.897s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5f1ce72ae61e1e6e02683e51ca48f3ec5b2dbb8 --force-share --output=json" returned: 0 in 0.275s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Acquiring lock "f5f1ce72ae61e1e6e02683e51ca48f3ec5b2dbb8" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lock "f5f1ce72ae61e1e6e02683e51ca48f3ec5b2dbb8" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5f1ce72ae61e1e6e02683e51ca48f3ec5b2dbb8 --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5f1ce72ae61e1e6e02683e51ca48f3ec5b2dbb8 --force-share --output=json" returned: 0 in 0.217s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f5f1ce72ae61e1e6e02683e51ca48f3ec5b2dbb8,backing_fmt=raw /opt/stack/data/nova/instances/d3ed0377-ff2b-4a15-9175-a70624aa913d/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f5f1ce72ae61e1e6e02683e51ca48f3ec5b2dbb8,backing_fmt=raw /opt/stack/data/nova/instances/d3ed0377-ff2b-4a15-9175-a70624aa913d/disk 1073741824" returned: 0 in 0.072s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lock "f5f1ce72ae61e1e6e02683e51ca48f3ec5b2dbb8" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.300s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5f1ce72ae61e1e6e02683e51ca48f3ec5b2dbb8 --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f5f1ce72ae61e1e6e02683e51ca48f3ec5b2dbb8 --force-share --output=json" returned: 0 in 0.266s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:15 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d3ed0377-ff2b-4a15-9175-a70624aa913d/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 09:44:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ed0377-ff2b-4a15-9175-a70624aa913d/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ed0377-ff2b-4a15-9175-a70624aa913d/disk --force-share --output=json" returned: 0 in 0.319s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:15 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Cannot resize image /opt/stack/data/nova/instances/d3ed0377-ff2b-4a15-9175-a70624aa913d/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 09:44:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 09:44:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Ensure instance console log exists: /opt/stack/data/nova/instances/d3ed0377-ff2b-4a15-9175-a70624aa913d/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:44:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:16 user nova-compute[74342]: DEBUG nova.network.neutron [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Successfully updated port: c7e71629-bc93-41ff-bd86-e1f6be6aec6b {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:44:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Acquiring lock "refresh_cache-d3ed0377-ff2b-4a15-9175-a70624aa913d" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:44:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Acquired lock "refresh_cache-d3ed0377-ff2b-4a15-9175-a70624aa913d" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:44:16 user nova-compute[74342]: DEBUG nova.network.neutron [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:44:16 user nova-compute[74342]: DEBUG nova.compute.manager [req-e2f17fb5-016f-48fb-9769-be6b93aab63d req-55a93b9b-946a-47b6-b256-d1d0aa477261 service nova] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Received event network-changed-c7e71629-bc93-41ff-bd86-e1f6be6aec6b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:44:16 user nova-compute[74342]: DEBUG nova.compute.manager [req-e2f17fb5-016f-48fb-9769-be6b93aab63d req-55a93b9b-946a-47b6-b256-d1d0aa477261 service nova] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Refreshing instance network info cache due to event network-changed-c7e71629-bc93-41ff-bd86-e1f6be6aec6b. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:44:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e2f17fb5-016f-48fb-9769-be6b93aab63d req-55a93b9b-946a-47b6-b256-d1d0aa477261 service nova] Acquiring lock "refresh_cache-d3ed0377-ff2b-4a15-9175-a70624aa913d" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:44:16 user nova-compute[74342]: DEBUG nova.network.neutron [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:44:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:16 user nova-compute[74342]: DEBUG nova.network.neutron [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Updating instance_info_cache with network_info: [{"id": "c7e71629-bc93-41ff-bd86-e1f6be6aec6b", "address": "fa:16:3e:c2:4d:5a", "network": {"id": "cf087024-9089-47c1-b7ce-dbc5b1d3232c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1070425141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698c3910471646ee8bb8632484e3787b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e71629-bc", "ovs_interfaceid": "c7e71629-bc93-41ff-bd86-e1f6be6aec6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:44:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Releasing lock "refresh_cache-d3ed0377-ff2b-4a15-9175-a70624aa913d" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:44:16 user nova-compute[74342]: DEBUG nova.compute.manager [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Instance network_info: |[{"id": "c7e71629-bc93-41ff-bd86-e1f6be6aec6b", "address": "fa:16:3e:c2:4d:5a", "network": {"id": "cf087024-9089-47c1-b7ce-dbc5b1d3232c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1070425141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698c3910471646ee8bb8632484e3787b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e71629-bc", "ovs_interfaceid": "c7e71629-bc93-41ff-bd86-e1f6be6aec6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:44:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e2f17fb5-016f-48fb-9769-be6b93aab63d req-55a93b9b-946a-47b6-b256-d1d0aa477261 service nova] Acquired lock "refresh_cache-d3ed0377-ff2b-4a15-9175-a70624aa913d" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:44:16 user nova-compute[74342]: DEBUG nova.network.neutron [req-e2f17fb5-016f-48fb-9769-be6b93aab63d req-55a93b9b-946a-47b6-b256-d1d0aa477261 service nova] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Refreshing network info cache for port c7e71629-bc93-41ff-bd86-e1f6be6aec6b {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:44:16 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Start _get_guest_xml network_info=[{"id": "c7e71629-bc93-41ff-bd86-e1f6be6aec6b", "address": "fa:16:3e:c2:4d:5a", "network": {"id": "cf087024-9089-47c1-b7ce-dbc5b1d3232c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1070425141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698c3910471646ee8bb8632484e3787b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e71629-bc", "ovs_interfaceid": "c7e71629-bc93-41ff-bd86-e1f6be6aec6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:44:06Z,direct_url=<?>,disk_format='qcow2',id=43e89f0e-d30a-4f69-89b3-85a57e8811ea,min_disk=0,min_ram=0,name='',owner='54ae93b3477f46fa941c922ded778ba6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:44:08Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/sda', 'disk_bus': 'scsi', 'encryption_secret_uuid': None, 'image_id': '43e89f0e-d30a-4f69-89b3-85a57e8811ea'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:44:17 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:44:17 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:44:17 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:44:06Z,direct_url=<?>,disk_format='qcow2',id=43e89f0e-d30a-4f69-89b3-85a57e8811ea,min_disk=0,min_ram=0,name='',owner='54ae93b3477f46fa941c922ded778ba6',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:44:08Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T09:44:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1013873379',display_name='tempest-AttachSCSIVolumeTestJSON-server-1013873379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1013873379',id=5,image_ref='43e89f0e-d30a-4f69-89b3-85a57e8811ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+SbWAmfhky3H7xXZhaqF6ii62jtxmE2K2dk+jdGcHktcGmxJqOIyKoi0Cp9F6hNdygwyK18UHia/jFn+4XUBPviiK4qDrny18LXFui72VSb4SEmJ9RmIqz0cX4o4yVfA==',key_name='tempest-keypair-202096675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='698c3910471646ee8bb8632484e3787b',ramdisk_id='',reservation_id='r-wj00pibf',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e89f0e-d30a-4f69-89b3-85a57e8811ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-546040346',owner_user_name='tempest-AttachSCSIVolumeTestJSON-546040346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:44:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='364c71ffa3a94817bda4910f6c4f8e0c',uuid=d3ed0377-ff2b-4a15-9175-a70624aa913d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7e71629-bc93-41ff-bd86-e1f6be6aec6b", "address": "fa:16:3e:c2:4d:5a", "network": {"id": "cf087024-9089-47c1-b7ce-dbc5b1d3232c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1070425141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698c3910471646ee8bb8632484e3787b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e71629-bc", "ovs_interfaceid": "c7e71629-bc93-41ff-bd86-e1f6be6aec6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Converting VIF {"id": "c7e71629-bc93-41ff-bd86-e1f6be6aec6b", "address": "fa:16:3e:c2:4d:5a", "network": {"id": "cf087024-9089-47c1-b7ce-dbc5b1d3232c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1070425141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698c3910471646ee8bb8632484e3787b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e71629-bc", "ovs_interfaceid": "c7e71629-bc93-41ff-bd86-e1f6be6aec6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:4d:5a,bridge_name='br-int',has_traffic_filtering=True,id=c7e71629-bc93-41ff-bd86-e1f6be6aec6b,network=Network(cf087024-9089-47c1-b7ce-dbc5b1d3232c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7e71629-bc') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG nova.objects.instance [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lazy-loading 'pci_devices' on Instance uuid d3ed0377-ff2b-4a15-9175-a70624aa913d {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:44:17 user nova-compute[74342]:   <uuid>d3ed0377-ff2b-4a15-9175-a70624aa913d</uuid>
Oct 16 09:44:17 user nova-compute[74342]:   <name>instance-00000005</name>
Oct 16 09:44:17 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:44:17 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:44:17 user nova-compute[74342]:   <metadata>
Oct 16 09:44:17 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:44:17 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:44:17 user nova-compute[74342]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1013873379</nova:name>
Oct 16 09:44:17 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:44:17</nova:creationTime>
Oct 16 09:44:17 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:44:17 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:44:17 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:44:17 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:44:17 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:44:17 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:44:17 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:44:17 user nova-compute[74342]:       <nova:owner>
Oct 16 09:44:17 user nova-compute[74342]:         <nova:user uuid="364c71ffa3a94817bda4910f6c4f8e0c">tempest-AttachSCSIVolumeTestJSON-546040346-project-member</nova:user>
Oct 16 09:44:17 user nova-compute[74342]:         <nova:project uuid="698c3910471646ee8bb8632484e3787b">tempest-AttachSCSIVolumeTestJSON-546040346</nova:project>
Oct 16 09:44:17 user nova-compute[74342]:       </nova:owner>
Oct 16 09:44:17 user nova-compute[74342]:       <nova:root type="image" uuid="43e89f0e-d30a-4f69-89b3-85a57e8811ea"/>
Oct 16 09:44:17 user nova-compute[74342]:       <nova:ports>
Oct 16 09:44:17 user nova-compute[74342]:         <nova:port uuid="c7e71629-bc93-41ff-bd86-e1f6be6aec6b">
Oct 16 09:44:17 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 16 09:44:17 user nova-compute[74342]:         </nova:port>
Oct 16 09:44:17 user nova-compute[74342]:       </nova:ports>
Oct 16 09:44:17 user nova-compute[74342]:     </nova:instance>
Oct 16 09:44:17 user nova-compute[74342]:   </metadata>
Oct 16 09:44:17 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:44:17 user nova-compute[74342]:     <system>
Oct 16 09:44:17 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:44:17 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:44:17 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:44:17 user nova-compute[74342]:       <entry name="serial">d3ed0377-ff2b-4a15-9175-a70624aa913d</entry>
Oct 16 09:44:17 user nova-compute[74342]:       <entry name="uuid">d3ed0377-ff2b-4a15-9175-a70624aa913d</entry>
Oct 16 09:44:17 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:44:17 user nova-compute[74342]:     </system>
Oct 16 09:44:17 user nova-compute[74342]:   </sysinfo>
Oct 16 09:44:17 user nova-compute[74342]:   <os>
Oct 16 09:44:17 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:44:17 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:44:17 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:44:17 user nova-compute[74342]:   </os>
Oct 16 09:44:17 user nova-compute[74342]:   <features>
Oct 16 09:44:17 user nova-compute[74342]:     <acpi/>
Oct 16 09:44:17 user nova-compute[74342]:     <apic/>
Oct 16 09:44:17 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:44:17 user nova-compute[74342]:   </features>
Oct 16 09:44:17 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:44:17 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:44:17 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:44:17 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:44:17 user nova-compute[74342]:   </clock>
Oct 16 09:44:17 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:44:17 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:44:17 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:44:17 user nova-compute[74342]:   </cpu>
Oct 16 09:44:17 user nova-compute[74342]:   <devices>
Oct 16 09:44:17 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 09:44:17 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 09:44:17 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/d3ed0377-ff2b-4a15-9175-a70624aa913d/disk"/>
Oct 16 09:44:17 user nova-compute[74342]:       <target dev="sda" bus="scsi"/>
Oct 16 09:44:17 user nova-compute[74342]:       <address type="drive" controller="0" unit="0"/>
Oct 16 09:44:17 user nova-compute[74342]:     </disk>
Oct 16 09:44:17 user nova-compute[74342]:     <disk type="file" device="cdrom">
Oct 16 09:44:17 user nova-compute[74342]:       <driver name="qemu" type="raw" cache="none"/>
Oct 16 09:44:17 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/d3ed0377-ff2b-4a15-9175-a70624aa913d/disk.config"/>
Oct 16 09:44:17 user nova-compute[74342]:       <target dev="sdb" bus="scsi"/>
Oct 16 09:44:17 user nova-compute[74342]:       <address type="drive" controller="0" unit="1"/>
Oct 16 09:44:17 user nova-compute[74342]:     </disk>
Oct 16 09:44:17 user nova-compute[74342]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Oct 16 09:44:17 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:44:17 user nova-compute[74342]:       <mac address="fa:16:3e:c2:4d:5a"/>
Oct 16 09:44:17 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:44:17 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:44:17 user nova-compute[74342]:       <target dev="tapc7e71629-bc"/>
Oct 16 09:44:17 user nova-compute[74342]:     </interface>
Oct 16 09:44:17 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:44:17 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/d3ed0377-ff2b-4a15-9175-a70624aa913d/console.log" append="off"/>
Oct 16 09:44:17 user nova-compute[74342]:     </serial>
Oct 16 09:44:17 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:44:17 user nova-compute[74342]:     <video>
Oct 16 09:44:17 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:44:17 user nova-compute[74342]:     </video>
Oct 16 09:44:17 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:44:17 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:44:17 user nova-compute[74342]:     </rng>
Oct 16 09:44:17 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:44:17 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:44:17 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:44:17 user nova-compute[74342]:     </memballoon>
Oct 16 09:44:17 user nova-compute[74342]:   </devices>
Oct 16 09:44:17 user nova-compute[74342]: </domain>
Oct 16 09:44:17 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T09:44:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1013873379',display_name='tempest-AttachSCSIVolumeTestJSON-server-1013873379',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1013873379',id=5,image_ref='43e89f0e-d30a-4f69-89b3-85a57e8811ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+SbWAmfhky3H7xXZhaqF6ii62jtxmE2K2dk+jdGcHktcGmxJqOIyKoi0Cp9F6hNdygwyK18UHia/jFn+4XUBPviiK4qDrny18LXFui72VSb4SEmJ9RmIqz0cX4o4yVfA==',key_name='tempest-keypair-202096675',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='698c3910471646ee8bb8632484e3787b',ramdisk_id='',reservation_id='r-wj00pibf',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e89f0e-d30a-4f69-89b3-85a57e8811ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-546040346',owner_user_name='tempest-AttachSCSIVolumeTestJSON-546040346-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:44:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='364c71ffa3a94817bda4910f6c4f8e0c',uuid=d3ed0377-ff2b-4a15-9175-a70624aa913d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7e71629-bc93-41ff-bd86-e1f6be6aec6b", "address": "fa:16:3e:c2:4d:5a", "network": {"id": "cf087024-9089-47c1-b7ce-dbc5b1d3232c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1070425141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698c3910471646ee8bb8632484e3787b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e71629-bc", "ovs_interfaceid": "c7e71629-bc93-41ff-bd86-e1f6be6aec6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Converting VIF {"id": "c7e71629-bc93-41ff-bd86-e1f6be6aec6b", "address": "fa:16:3e:c2:4d:5a", "network": {"id": "cf087024-9089-47c1-b7ce-dbc5b1d3232c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1070425141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698c3910471646ee8bb8632484e3787b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e71629-bc", "ovs_interfaceid": "c7e71629-bc93-41ff-bd86-e1f6be6aec6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:4d:5a,bridge_name='br-int',has_traffic_filtering=True,id=c7e71629-bc93-41ff-bd86-e1f6be6aec6b,network=Network(cf087024-9089-47c1-b7ce-dbc5b1d3232c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7e71629-bc') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG os_vif [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:4d:5a,bridge_name='br-int',has_traffic_filtering=True,id=c7e71629-bc93-41ff-bd86-e1f6be6aec6b,network=Network(cf087024-9089-47c1-b7ce-dbc5b1d3232c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7e71629-bc') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8cc7f015-e83a-558a-b85a-dbed752c302d', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7e71629-bc, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc7e71629-bc, col_values=(('qos', UUID('3027e55e-216b-4919-afb3-510efcd04120')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc7e71629-bc, col_values=(('external_ids', {'iface-id': 'c7e71629-bc93-41ff-bd86-e1f6be6aec6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:4d:5a', 'vm-uuid': 'd3ed0377-ff2b-4a15-9175-a70624aa913d'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:17 user nova-compute[74342]: INFO os_vif [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:4d:5a,bridge_name='br-int',has_traffic_filtering=True,id=c7e71629-bc93-41ff-bd86-e1f6be6aec6b,network=Network(cf087024-9089-47c1-b7ce-dbc5b1d3232c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7e71629-bc')
Oct 16 09:44:17 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] No BDM found with device name sda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] No VIF found with MAC fa:16:3e:c2:4d:5a, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:44:17 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Using config drive
Oct 16 09:44:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG nova.network.neutron [req-e2f17fb5-016f-48fb-9769-be6b93aab63d req-55a93b9b-946a-47b6-b256-d1d0aa477261 service nova] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Updated VIF entry in instance network info cache for port c7e71629-bc93-41ff-bd86-e1f6be6aec6b. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG nova.network.neutron [req-e2f17fb5-016f-48fb-9769-be6b93aab63d req-55a93b9b-946a-47b6-b256-d1d0aa477261 service nova] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Updating instance_info_cache with network_info: [{"id": "c7e71629-bc93-41ff-bd86-e1f6be6aec6b", "address": "fa:16:3e:c2:4d:5a", "network": {"id": "cf087024-9089-47c1-b7ce-dbc5b1d3232c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1070425141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698c3910471646ee8bb8632484e3787b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e71629-bc", "ovs_interfaceid": "c7e71629-bc93-41ff-bd86-e1f6be6aec6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:44:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e2f17fb5-016f-48fb-9769-be6b93aab63d req-55a93b9b-946a-47b6-b256-d1d0aa477261 service nova] Releasing lock "refresh_cache-d3ed0377-ff2b-4a15-9175-a70624aa913d" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:44:18 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Creating config drive at /opt/stack/data/nova/instances/d3ed0377-ff2b-4a15-9175-a70624aa913d/disk.config
Oct 16 09:44:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d3ed0377-ff2b-4a15-9175-a70624aa913d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjsut1zf7 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d3ed0377-ff2b-4a15-9175-a70624aa913d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpjsut1zf7" returned: 0 in 0.098s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Acquiring lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:20 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:44:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:20 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:44:20 user nova-compute[74342]: INFO nova.compute.claims [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Claim successful on node user
Oct 16 09:44:20 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:44:20 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:44:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.562s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:20 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:44:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:21 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:44:21 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:44:21 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:44:21 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:44:21 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 09:44:21 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:44:21 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Creating image(s)
Oct 16 09:44:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "/opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "/opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:21 user nova-compute[74342]: DEBUG nova.policy [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '580c2bb824f04735a5a0b0d6f594bde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a64826b7567493ab7deee5994b261e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:44:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.258s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.220s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk 1073741824" returned: 0 in 0.059s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.287s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.281s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:22 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 09:44:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk --force-share --output=json" returned: 0 in 0.317s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:22 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Cannot resize image /opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 09:44:22 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 09:44:22 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Ensure instance console log exists: /opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:44:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:22 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Successfully created port: ecb4fcc0-8f58-493c-9804-76bf3603b899 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:44:22 user nova-compute[74342]: DEBUG nova.compute.manager [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:44:22 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:44:22 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Instance spawned successfully.
Oct 16 09:44:22 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:44:22 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:22 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:22 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:22 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:22 user nova-compute[74342]: INFO nova.compute.manager [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Took 9.81 seconds to spawn the instance on the hypervisor.
Oct 16 09:44:22 user nova-compute[74342]: DEBUG nova.compute.manager [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:44:23 user nova-compute[74342]: INFO nova.compute.manager [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Took 10.76 seconds to build instance.
Oct 16 09:44:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5e2eba39-5c68-4ce2-8583-e11fe86b9436 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lock "d3ed0377-ff2b-4a15-9175-a70624aa913d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.896s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:23 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Successfully updated port: ecb4fcc0-8f58-493c-9804-76bf3603b899 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:44:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Acquiring lock "refresh_cache-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:44:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Acquired lock "refresh_cache-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:44:23 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:44:23 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:44:23 user nova-compute[74342]: DEBUG nova.compute.manager [req-20770823-b233-4ae6-84e3-5ecb4f4414de req-9abb6764-a90a-4e40-8b4d-38bd3a289b45 service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Received event network-changed-ecb4fcc0-8f58-493c-9804-76bf3603b899 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:44:23 user nova-compute[74342]: DEBUG nova.compute.manager [req-20770823-b233-4ae6-84e3-5ecb4f4414de req-9abb6764-a90a-4e40-8b4d-38bd3a289b45 service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Refreshing instance network info cache due to event network-changed-ecb4fcc0-8f58-493c-9804-76bf3603b899. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:44:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-20770823-b233-4ae6-84e3-5ecb4f4414de req-9abb6764-a90a-4e40-8b4d-38bd3a289b45 service nova] Acquiring lock "refresh_cache-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Updating instance_info_cache with network_info: [{"id": "ecb4fcc0-8f58-493c-9804-76bf3603b899", "address": "fa:16:3e:27:36:3d", "network": {"id": "7cc9829f-36e8-4fd9-9d62-78f3f0019d1f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-252337481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a64826b7567493ab7deee5994b261e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecb4fcc0-8f", "ovs_interfaceid": "ecb4fcc0-8f58-493c-9804-76bf3603b899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Releasing lock "refresh_cache-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Instance network_info: |[{"id": "ecb4fcc0-8f58-493c-9804-76bf3603b899", "address": "fa:16:3e:27:36:3d", "network": {"id": "7cc9829f-36e8-4fd9-9d62-78f3f0019d1f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-252337481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a64826b7567493ab7deee5994b261e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecb4fcc0-8f", "ovs_interfaceid": "ecb4fcc0-8f58-493c-9804-76bf3603b899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-20770823-b233-4ae6-84e3-5ecb4f4414de req-9abb6764-a90a-4e40-8b4d-38bd3a289b45 service nova] Acquired lock "refresh_cache-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.network.neutron [req-20770823-b233-4ae6-84e3-5ecb4f4414de req-9abb6764-a90a-4e40-8b4d-38bd3a289b45 service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Refreshing network info cache for port ecb4fcc0-8f58-493c-9804-76bf3603b899 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Start _get_guest_xml network_info=[{"id": "ecb4fcc0-8f58-493c-9804-76bf3603b899", "address": "fa:16:3e:27:36:3d", "network": {"id": "7cc9829f-36e8-4fd9-9d62-78f3f0019d1f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-252337481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a64826b7567493ab7deee5994b261e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecb4fcc0-8f", "ovs_interfaceid": "ecb4fcc0-8f58-493c-9804-76bf3603b899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:44:24 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:44:24 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T09:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-640949209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-640949209',id=6,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpYhQn0nZA6I7ZVLvCwhw5MRkVm+i8dhF9cA+w+3K6essQXKu4e2BqUgXONrqsgQPLMNC9JJK382LUfvK2FFKrfh3cM12JiZnpdknV1HPaHjSi3tgNn41IJGEsjJsOpHg==',key_name='tempest-keypair-1377321458',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a64826b7567493ab7deee5994b261e7',ramdisk_id='',reservation_id='r-v3nxv2mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1445023395',owner_user_name='tempest-TaggedAttachmentsTest-1445023395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:44:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='580c2bb824f04735a5a0b0d6f594bde3',uuid=1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecb4fcc0-8f58-493c-9804-76bf3603b899", "address": "fa:16:3e:27:36:3d", "network": {"id": "7cc9829f-36e8-4fd9-9d62-78f3f0019d1f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-252337481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a64826b7567493ab7deee5994b261e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecb4fcc0-8f", "ovs_interfaceid": "ecb4fcc0-8f58-493c-9804-76bf3603b899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Converting VIF {"id": "ecb4fcc0-8f58-493c-9804-76bf3603b899", "address": "fa:16:3e:27:36:3d", "network": {"id": "7cc9829f-36e8-4fd9-9d62-78f3f0019d1f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-252337481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a64826b7567493ab7deee5994b261e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecb4fcc0-8f", "ovs_interfaceid": "ecb4fcc0-8f58-493c-9804-76bf3603b899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:36:3d,bridge_name='br-int',has_traffic_filtering=True,id=ecb4fcc0-8f58-493c-9804-76bf3603b899,network=Network(7cc9829f-36e8-4fd9-9d62-78f3f0019d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecb4fcc0-8f') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.objects.instance [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:44:24 user nova-compute[74342]:   <uuid>1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4</uuid>
Oct 16 09:44:24 user nova-compute[74342]:   <name>instance-00000006</name>
Oct 16 09:44:24 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:44:24 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:44:24 user nova-compute[74342]:   <metadata>
Oct 16 09:44:24 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:44:24 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:44:24 user nova-compute[74342]:       <nova:name>tempest-device-tagging-server-640949209</nova:name>
Oct 16 09:44:24 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:44:24</nova:creationTime>
Oct 16 09:44:24 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:44:24 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:44:24 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:44:24 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:44:24 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:44:24 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:44:24 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:44:24 user nova-compute[74342]:       <nova:owner>
Oct 16 09:44:24 user nova-compute[74342]:         <nova:user uuid="580c2bb824f04735a5a0b0d6f594bde3">tempest-TaggedAttachmentsTest-1445023395-project-member</nova:user>
Oct 16 09:44:24 user nova-compute[74342]:         <nova:project uuid="3a64826b7567493ab7deee5994b261e7">tempest-TaggedAttachmentsTest-1445023395</nova:project>
Oct 16 09:44:24 user nova-compute[74342]:       </nova:owner>
Oct 16 09:44:24 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:44:24 user nova-compute[74342]:       <nova:ports>
Oct 16 09:44:24 user nova-compute[74342]:         <nova:port uuid="ecb4fcc0-8f58-493c-9804-76bf3603b899">
Oct 16 09:44:24 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 09:44:24 user nova-compute[74342]:         </nova:port>
Oct 16 09:44:24 user nova-compute[74342]:       </nova:ports>
Oct 16 09:44:24 user nova-compute[74342]:     </nova:instance>
Oct 16 09:44:24 user nova-compute[74342]:   </metadata>
Oct 16 09:44:24 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:44:24 user nova-compute[74342]:     <system>
Oct 16 09:44:24 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:44:24 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:44:24 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:44:24 user nova-compute[74342]:       <entry name="serial">1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4</entry>
Oct 16 09:44:24 user nova-compute[74342]:       <entry name="uuid">1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4</entry>
Oct 16 09:44:24 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:44:24 user nova-compute[74342]:     </system>
Oct 16 09:44:24 user nova-compute[74342]:   </sysinfo>
Oct 16 09:44:24 user nova-compute[74342]:   <os>
Oct 16 09:44:24 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:44:24 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:44:24 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:44:24 user nova-compute[74342]:   </os>
Oct 16 09:44:24 user nova-compute[74342]:   <features>
Oct 16 09:44:24 user nova-compute[74342]:     <acpi/>
Oct 16 09:44:24 user nova-compute[74342]:     <apic/>
Oct 16 09:44:24 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:44:24 user nova-compute[74342]:   </features>
Oct 16 09:44:24 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:44:24 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:44:24 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:44:24 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:44:24 user nova-compute[74342]:   </clock>
Oct 16 09:44:24 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:44:24 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:44:24 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:44:24 user nova-compute[74342]:   </cpu>
Oct 16 09:44:24 user nova-compute[74342]:   <devices>
Oct 16 09:44:24 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 09:44:24 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 09:44:24 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk"/>
Oct 16 09:44:24 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:44:24 user nova-compute[74342]:     </disk>
Oct 16 09:44:24 user nova-compute[74342]:     <disk type="file" device="cdrom">
Oct 16 09:44:24 user nova-compute[74342]:       <driver name="qemu" type="raw" cache="none"/>
Oct 16 09:44:24 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk.config"/>
Oct 16 09:44:24 user nova-compute[74342]:       <target dev="hda" bus="ide"/>
Oct 16 09:44:24 user nova-compute[74342]:     </disk>
Oct 16 09:44:24 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:44:24 user nova-compute[74342]:       <mac address="fa:16:3e:27:36:3d"/>
Oct 16 09:44:24 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:44:24 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:44:24 user nova-compute[74342]:       <target dev="tapecb4fcc0-8f"/>
Oct 16 09:44:24 user nova-compute[74342]:     </interface>
Oct 16 09:44:24 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:44:24 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/console.log" append="off"/>
Oct 16 09:44:24 user nova-compute[74342]:     </serial>
Oct 16 09:44:24 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:44:24 user nova-compute[74342]:     <video>
Oct 16 09:44:24 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:44:24 user nova-compute[74342]:     </video>
Oct 16 09:44:24 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:44:24 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:44:24 user nova-compute[74342]:     </rng>
Oct 16 09:44:24 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:44:24 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:44:24 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:44:24 user nova-compute[74342]:     </memballoon>
Oct 16 09:44:24 user nova-compute[74342]:   </devices>
Oct 16 09:44:24 user nova-compute[74342]: </domain>
Oct 16 09:44:24 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T09:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-640949209',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-640949209',id=6,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpYhQn0nZA6I7ZVLvCwhw5MRkVm+i8dhF9cA+w+3K6essQXKu4e2BqUgXONrqsgQPLMNC9JJK382LUfvK2FFKrfh3cM12JiZnpdknV1HPaHjSi3tgNn41IJGEsjJsOpHg==',key_name='tempest-keypair-1377321458',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a64826b7567493ab7deee5994b261e7',ramdisk_id='',reservation_id='r-v3nxv2mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1445023395',owner_user_name='tempest-TaggedAttachmentsTest-1445023395-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:44:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='580c2bb824f04735a5a0b0d6f594bde3',uuid=1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecb4fcc0-8f58-493c-9804-76bf3603b899", "address": "fa:16:3e:27:36:3d", "network": {"id": "7cc9829f-36e8-4fd9-9d62-78f3f0019d1f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-252337481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a64826b7567493ab7deee5994b261e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecb4fcc0-8f", "ovs_interfaceid": "ecb4fcc0-8f58-493c-9804-76bf3603b899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Converting VIF {"id": "ecb4fcc0-8f58-493c-9804-76bf3603b899", "address": "fa:16:3e:27:36:3d", "network": {"id": "7cc9829f-36e8-4fd9-9d62-78f3f0019d1f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-252337481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a64826b7567493ab7deee5994b261e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecb4fcc0-8f", "ovs_interfaceid": "ecb4fcc0-8f58-493c-9804-76bf3603b899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:27:36:3d,bridge_name='br-int',has_traffic_filtering=True,id=ecb4fcc0-8f58-493c-9804-76bf3603b899,network=Network(7cc9829f-36e8-4fd9-9d62-78f3f0019d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecb4fcc0-8f') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG os_vif [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:36:3d,bridge_name='br-int',has_traffic_filtering=True,id=ecb4fcc0-8f58-493c-9804-76bf3603b899,network=Network(7cc9829f-36e8-4fd9-9d62-78f3f0019d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecb4fcc0-8f') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '15f2afd3-8ceb-53b1-8420-4522f84ba5fd', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapecb4fcc0-8f, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapecb4fcc0-8f, col_values=(('qos', UUID('a9ca5ac3-4822-43c8-b8c3-ec9cd0f9e14a')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapecb4fcc0-8f, col_values=(('external_ids', {'iface-id': 'ecb4fcc0-8f58-493c-9804-76bf3603b899', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:27:36:3d', 'vm-uuid': '1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:24 user nova-compute[74342]: INFO os_vif [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:27:36:3d,bridge_name='br-int',has_traffic_filtering=True,id=ecb4fcc0-8f58-493c-9804-76bf3603b899,network=Network(7cc9829f-36e8-4fd9-9d62-78f3f0019d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecb4fcc0-8f')
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] No BDM found with device name hda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] No VIF found with MAC fa:16:3e:27:36:3d, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:44:24 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Using config drive
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.network.neutron [req-20770823-b233-4ae6-84e3-5ecb4f4414de req-9abb6764-a90a-4e40-8b4d-38bd3a289b45 service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Updated VIF entry in instance network info cache for port ecb4fcc0-8f58-493c-9804-76bf3603b899. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG nova.network.neutron [req-20770823-b233-4ae6-84e3-5ecb4f4414de req-9abb6764-a90a-4e40-8b4d-38bd3a289b45 service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Updating instance_info_cache with network_info: [{"id": "ecb4fcc0-8f58-493c-9804-76bf3603b899", "address": "fa:16:3e:27:36:3d", "network": {"id": "7cc9829f-36e8-4fd9-9d62-78f3f0019d1f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-252337481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a64826b7567493ab7deee5994b261e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecb4fcc0-8f", "ovs_interfaceid": "ecb4fcc0-8f58-493c-9804-76bf3603b899", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-20770823-b233-4ae6-84e3-5ecb4f4414de req-9abb6764-a90a-4e40-8b4d-38bd3a289b45 service nova] Releasing lock "refresh_cache-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:44:24 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Creating config drive at /opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk.config
Oct 16 09:44:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpho5bdwnk {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpho5bdwnk" returned: 0 in 0.054s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:26 user nova-compute[74342]: DEBUG nova.compute.manager [req-25ee561d-6104-4552-83d7-bd0f8615fcf7 req-136b8ea5-7ac1-4e08-8590-5986535c853d service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Received event network-vif-plugged-ecb4fcc0-8f58-493c-9804-76bf3603b899 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:44:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-25ee561d-6104-4552-83d7-bd0f8615fcf7 req-136b8ea5-7ac1-4e08-8590-5986535c853d service nova] Acquiring lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-25ee561d-6104-4552-83d7-bd0f8615fcf7 req-136b8ea5-7ac1-4e08-8590-5986535c853d service nova] Lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-25ee561d-6104-4552-83d7-bd0f8615fcf7 req-136b8ea5-7ac1-4e08-8590-5986535c853d service nova] Lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:26 user nova-compute[74342]: DEBUG nova.compute.manager [req-25ee561d-6104-4552-83d7-bd0f8615fcf7 req-136b8ea5-7ac1-4e08-8590-5986535c853d service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] No waiting events found dispatching network-vif-plugged-ecb4fcc0-8f58-493c-9804-76bf3603b899 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:44:26 user nova-compute[74342]: WARNING nova.compute.manager [req-25ee561d-6104-4552-83d7-bd0f8615fcf7 req-136b8ea5-7ac1-4e08-8590-5986535c853d service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Received unexpected event network-vif-plugged-ecb4fcc0-8f58-493c-9804-76bf3603b899 for instance with vm_state building and task_state spawning.
Oct 16 09:44:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:28 user nova-compute[74342]: DEBUG nova.compute.manager [req-d80fd477-2e3c-4736-83fa-84eb9f336f08 req-4de7d96d-c73e-4600-bef9-6b4e07c40deb service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Received event network-vif-plugged-ecb4fcc0-8f58-493c-9804-76bf3603b899 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:44:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d80fd477-2e3c-4736-83fa-84eb9f336f08 req-4de7d96d-c73e-4600-bef9-6b4e07c40deb service nova] Acquiring lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d80fd477-2e3c-4736-83fa-84eb9f336f08 req-4de7d96d-c73e-4600-bef9-6b4e07c40deb service nova] Lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d80fd477-2e3c-4736-83fa-84eb9f336f08 req-4de7d96d-c73e-4600-bef9-6b4e07c40deb service nova] Lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:28 user nova-compute[74342]: DEBUG nova.compute.manager [req-d80fd477-2e3c-4736-83fa-84eb9f336f08 req-4de7d96d-c73e-4600-bef9-6b4e07c40deb service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] No waiting events found dispatching network-vif-plugged-ecb4fcc0-8f58-493c-9804-76bf3603b899 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:44:28 user nova-compute[74342]: WARNING nova.compute.manager [req-d80fd477-2e3c-4736-83fa-84eb9f336f08 req-4de7d96d-c73e-4600-bef9-6b4e07c40deb service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Received unexpected event network-vif-plugged-ecb4fcc0-8f58-493c-9804-76bf3603b899 for instance with vm_state building and task_state spawning.
Oct 16 09:44:29 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:44:29 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:44:29 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Instance spawned successfully.
Oct 16 09:44:29 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:44:29 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:29 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:29 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:29 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:29 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:29 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:29 user nova-compute[74342]: INFO nova.compute.manager [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Took 7.97 seconds to spawn the instance on the hypervisor.
Oct 16 09:44:29 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:44:29 user nova-compute[74342]: INFO nova.compute.manager [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Took 9.11 seconds to build instance.
Oct 16 09:44:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c3323b30-ea5b-428c-8c00-015c218c3668 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.332s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Acquiring lock "719428d6-025b-4baa-97a2-c8ebdd49f57e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Lock "719428d6-025b-4baa-97a2-c8ebdd49f57e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:32 user nova-compute[74342]: DEBUG nova.compute.manager [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:44:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:32 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:44:32 user nova-compute[74342]: INFO nova.compute.claims [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Claim successful on node user
Oct 16 09:44:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:32 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:44:32 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:44:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.612s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:32 user nova-compute[74342]: DEBUG nova.compute.manager [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:44:32 user nova-compute[74342]: DEBUG nova.compute.manager [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:44:32 user nova-compute[74342]: DEBUG nova.network.neutron [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:44:32 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:44:32 user nova-compute[74342]: DEBUG nova.compute.manager [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:44:32 user nova-compute[74342]: DEBUG nova.policy [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '067571b5a90d474da700215c04cdfe3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d38497173ac495483e9f5c564415da4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:44:33 user nova-compute[74342]: DEBUG nova.compute.manager [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 09:44:33 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:44:33 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Creating image(s)
Oct 16 09:44:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Acquiring lock "/opt/stack/data/nova/instances/719428d6-025b-4baa-97a2-c8ebdd49f57e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Lock "/opt/stack/data/nova/instances/719428d6-025b-4baa-97a2-c8ebdd49f57e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Lock "/opt/stack/data/nova/instances/719428d6-025b-4baa-97a2-c8ebdd49f57e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.220s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.198s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/719428d6-025b-4baa-97a2-c8ebdd49f57e/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/719428d6-025b-4baa-97a2-c8ebdd49f57e/disk 1073741824" returned: 0 in 0.069s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:33 user nova-compute[74342]: DEBUG nova.network.neutron [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Successfully created port: 32030b48-4c52-4cf9-ba4f-0dc3b580fbdc {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:44:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.230s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:33 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Checking if we can resize image /opt/stack/data/nova/instances/719428d6-025b-4baa-97a2-c8ebdd49f57e/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 09:44:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719428d6-025b-4baa-97a2-c8ebdd49f57e/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719428d6-025b-4baa-97a2-c8ebdd49f57e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:33 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Cannot resize image /opt/stack/data/nova/instances/719428d6-025b-4baa-97a2-c8ebdd49f57e/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 09:44:33 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 09:44:33 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Ensure instance console log exists: /opt/stack/data/nova/instances/719428d6-025b-4baa-97a2-c8ebdd49f57e/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:44:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.013s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.network.neutron [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Successfully updated port: 32030b48-4c52-4cf9-ba4f-0dc3b580fbdc {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Acquiring lock "refresh_cache-719428d6-025b-4baa-97a2-c8ebdd49f57e" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Acquired lock "refresh_cache-719428d6-025b-4baa-97a2-c8ebdd49f57e" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.network.neutron [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.compute.manager [req-e48980a2-3b2d-445c-9073-e841ad4abdd8 req-f915d901-b8d2-4617-98bd-f08aff19de95 service nova] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Received event network-changed-32030b48-4c52-4cf9-ba4f-0dc3b580fbdc {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.compute.manager [req-e48980a2-3b2d-445c-9073-e841ad4abdd8 req-f915d901-b8d2-4617-98bd-f08aff19de95 service nova] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Refreshing instance network info cache due to event network-changed-32030b48-4c52-4cf9-ba4f-0dc3b580fbdc. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e48980a2-3b2d-445c-9073-e841ad4abdd8 req-f915d901-b8d2-4617-98bd-f08aff19de95 service nova] Acquiring lock "refresh_cache-719428d6-025b-4baa-97a2-c8ebdd49f57e" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.network.neutron [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.network.neutron [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Updating instance_info_cache with network_info: [{"id": "32030b48-4c52-4cf9-ba4f-0dc3b580fbdc", "address": "fa:16:3e:90:75:c6", "network": {"id": "58954713-04d6-4123-bfc0-74f8babdad45", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1482868561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d38497173ac495483e9f5c564415da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32030b48-4c", "ovs_interfaceid": "32030b48-4c52-4cf9-ba4f-0dc3b580fbdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Releasing lock "refresh_cache-719428d6-025b-4baa-97a2-c8ebdd49f57e" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.compute.manager [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Instance network_info: |[{"id": "32030b48-4c52-4cf9-ba4f-0dc3b580fbdc", "address": "fa:16:3e:90:75:c6", "network": {"id": "58954713-04d6-4123-bfc0-74f8babdad45", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1482868561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d38497173ac495483e9f5c564415da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32030b48-4c", "ovs_interfaceid": "32030b48-4c52-4cf9-ba4f-0dc3b580fbdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e48980a2-3b2d-445c-9073-e841ad4abdd8 req-f915d901-b8d2-4617-98bd-f08aff19de95 service nova] Acquired lock "refresh_cache-719428d6-025b-4baa-97a2-c8ebdd49f57e" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.network.neutron [req-e48980a2-3b2d-445c-9073-e841ad4abdd8 req-f915d901-b8d2-4617-98bd-f08aff19de95 service nova] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Refreshing network info cache for port 32030b48-4c52-4cf9-ba4f-0dc3b580fbdc {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Start _get_guest_xml network_info=[{"id": "32030b48-4c52-4cf9-ba4f-0dc3b580fbdc", "address": "fa:16:3e:90:75:c6", "network": {"id": "58954713-04d6-4123-bfc0-74f8babdad45", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1482868561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d38497173ac495483e9f5c564415da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32030b48-4c", "ovs_interfaceid": "32030b48-4c52-4cf9-ba4f-0dc3b580fbdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:44:34 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:44:34 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:44:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1384801338',display_name='tempest-VolumesAssistedSnapshotsTest-server-1384801338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1384801338',id=7,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4CGvi/ddHz1YRJfr4qmfF54Kal6XrHg944hKoDcXLwX+t2qj4dkscqVcXhMhzHAj0y1Pb5Zr7fmmTo0el3yXp6ef0r6Uvf0ymyXcpYn9GXaYZsu0+kvFpwJ1mK+Fe6aA==',key_name='tempest-keypair-1224038078',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d38497173ac495483e9f5c564415da4',ramdisk_id='',reservation_id='r-zq8wq25e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-654150561',owner_user_name='tempest-VolumesAssistedSnapshotsTest-654150561-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:44:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='067571b5a90d474da700215c04cdfe3c',uuid=719428d6-025b-4baa-97a2-c8ebdd49f57e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32030b48-4c52-4cf9-ba4f-0dc3b580fbdc", "address": "fa:16:3e:90:75:c6", "network": {"id": "58954713-04d6-4123-bfc0-74f8babdad45", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1482868561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d38497173ac495483e9f5c564415da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32030b48-4c", "ovs_interfaceid": "32030b48-4c52-4cf9-ba4f-0dc3b580fbdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Converting VIF {"id": "32030b48-4c52-4cf9-ba4f-0dc3b580fbdc", "address": "fa:16:3e:90:75:c6", "network": {"id": "58954713-04d6-4123-bfc0-74f8babdad45", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1482868561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d38497173ac495483e9f5c564415da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32030b48-4c", "ovs_interfaceid": "32030b48-4c52-4cf9-ba4f-0dc3b580fbdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:75:c6,bridge_name='br-int',has_traffic_filtering=True,id=32030b48-4c52-4cf9-ba4f-0dc3b580fbdc,network=Network(58954713-04d6-4123-bfc0-74f8babdad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32030b48-4c') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.objects.instance [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Lazy-loading 'pci_devices' on Instance uuid 719428d6-025b-4baa-97a2-c8ebdd49f57e {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:44:34 user nova-compute[74342]:   <uuid>719428d6-025b-4baa-97a2-c8ebdd49f57e</uuid>
Oct 16 09:44:34 user nova-compute[74342]:   <name>instance-00000007</name>
Oct 16 09:44:34 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:44:34 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:44:34 user nova-compute[74342]:   <metadata>
Oct 16 09:44:34 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:44:34 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:44:34 user nova-compute[74342]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1384801338</nova:name>
Oct 16 09:44:34 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:44:34</nova:creationTime>
Oct 16 09:44:34 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:44:34 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:44:34 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:44:34 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:44:34 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:44:34 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:44:34 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:44:34 user nova-compute[74342]:       <nova:owner>
Oct 16 09:44:34 user nova-compute[74342]:         <nova:user uuid="067571b5a90d474da700215c04cdfe3c">tempest-VolumesAssistedSnapshotsTest-654150561-project-member</nova:user>
Oct 16 09:44:34 user nova-compute[74342]:         <nova:project uuid="9d38497173ac495483e9f5c564415da4">tempest-VolumesAssistedSnapshotsTest-654150561</nova:project>
Oct 16 09:44:34 user nova-compute[74342]:       </nova:owner>
Oct 16 09:44:34 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:44:34 user nova-compute[74342]:       <nova:ports>
Oct 16 09:44:34 user nova-compute[74342]:         <nova:port uuid="32030b48-4c52-4cf9-ba4f-0dc3b580fbdc">
Oct 16 09:44:34 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 16 09:44:34 user nova-compute[74342]:         </nova:port>
Oct 16 09:44:34 user nova-compute[74342]:       </nova:ports>
Oct 16 09:44:34 user nova-compute[74342]:     </nova:instance>
Oct 16 09:44:34 user nova-compute[74342]:   </metadata>
Oct 16 09:44:34 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:44:34 user nova-compute[74342]:     <system>
Oct 16 09:44:34 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:44:34 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:44:34 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:44:34 user nova-compute[74342]:       <entry name="serial">719428d6-025b-4baa-97a2-c8ebdd49f57e</entry>
Oct 16 09:44:34 user nova-compute[74342]:       <entry name="uuid">719428d6-025b-4baa-97a2-c8ebdd49f57e</entry>
Oct 16 09:44:34 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:44:34 user nova-compute[74342]:     </system>
Oct 16 09:44:34 user nova-compute[74342]:   </sysinfo>
Oct 16 09:44:34 user nova-compute[74342]:   <os>
Oct 16 09:44:34 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:44:34 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:44:34 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:44:34 user nova-compute[74342]:   </os>
Oct 16 09:44:34 user nova-compute[74342]:   <features>
Oct 16 09:44:34 user nova-compute[74342]:     <acpi/>
Oct 16 09:44:34 user nova-compute[74342]:     <apic/>
Oct 16 09:44:34 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:44:34 user nova-compute[74342]:   </features>
Oct 16 09:44:34 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:44:34 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:44:34 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:44:34 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:44:34 user nova-compute[74342]:   </clock>
Oct 16 09:44:34 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:44:34 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:44:34 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:44:34 user nova-compute[74342]:   </cpu>
Oct 16 09:44:34 user nova-compute[74342]:   <devices>
Oct 16 09:44:34 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 09:44:34 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 09:44:34 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/719428d6-025b-4baa-97a2-c8ebdd49f57e/disk"/>
Oct 16 09:44:34 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:44:34 user nova-compute[74342]:     </disk>
Oct 16 09:44:34 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:44:34 user nova-compute[74342]:       <mac address="fa:16:3e:90:75:c6"/>
Oct 16 09:44:34 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:44:34 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:44:34 user nova-compute[74342]:       <target dev="tap32030b48-4c"/>
Oct 16 09:44:34 user nova-compute[74342]:     </interface>
Oct 16 09:44:34 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:44:34 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/719428d6-025b-4baa-97a2-c8ebdd49f57e/console.log" append="off"/>
Oct 16 09:44:34 user nova-compute[74342]:     </serial>
Oct 16 09:44:34 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:44:34 user nova-compute[74342]:     <video>
Oct 16 09:44:34 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:44:34 user nova-compute[74342]:     </video>
Oct 16 09:44:34 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:44:34 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:44:34 user nova-compute[74342]:     </rng>
Oct 16 09:44:34 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:44:34 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:44:34 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:44:34 user nova-compute[74342]:     </memballoon>
Oct 16 09:44:34 user nova-compute[74342]:   </devices>
Oct 16 09:44:34 user nova-compute[74342]: </domain>
Oct 16 09:44:34 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:44:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1384801338',display_name='tempest-VolumesAssistedSnapshotsTest-server-1384801338',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1384801338',id=7,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4CGvi/ddHz1YRJfr4qmfF54Kal6XrHg944hKoDcXLwX+t2qj4dkscqVcXhMhzHAj0y1Pb5Zr7fmmTo0el3yXp6ef0r6Uvf0ymyXcpYn9GXaYZsu0+kvFpwJ1mK+Fe6aA==',key_name='tempest-keypair-1224038078',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9d38497173ac495483e9f5c564415da4',ramdisk_id='',reservation_id='r-zq8wq25e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-654150561',owner_user_name='tempest-VolumesAssistedSnapshotsTest-654150561-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:44:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='067571b5a90d474da700215c04cdfe3c',uuid=719428d6-025b-4baa-97a2-c8ebdd49f57e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32030b48-4c52-4cf9-ba4f-0dc3b580fbdc", "address": "fa:16:3e:90:75:c6", "network": {"id": "58954713-04d6-4123-bfc0-74f8babdad45", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1482868561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d38497173ac495483e9f5c564415da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32030b48-4c", "ovs_interfaceid": "32030b48-4c52-4cf9-ba4f-0dc3b580fbdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Converting VIF {"id": "32030b48-4c52-4cf9-ba4f-0dc3b580fbdc", "address": "fa:16:3e:90:75:c6", "network": {"id": "58954713-04d6-4123-bfc0-74f8babdad45", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1482868561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d38497173ac495483e9f5c564415da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32030b48-4c", "ovs_interfaceid": "32030b48-4c52-4cf9-ba4f-0dc3b580fbdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:75:c6,bridge_name='br-int',has_traffic_filtering=True,id=32030b48-4c52-4cf9-ba4f-0dc3b580fbdc,network=Network(58954713-04d6-4123-bfc0-74f8babdad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32030b48-4c') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG os_vif [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:75:c6,bridge_name='br-int',has_traffic_filtering=True,id=32030b48-4c52-4cf9-ba4f-0dc3b580fbdc,network=Network(58954713-04d6-4123-bfc0-74f8babdad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32030b48-4c') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f096fa5-cf3e-578e-ab71-09d735aa95fe', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32030b48-4c, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap32030b48-4c, col_values=(('qos', UUID('463fae87-7a25-4066-80a1-42efe1601b9b')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap32030b48-4c, col_values=(('external_ids', {'iface-id': '32030b48-4c52-4cf9-ba4f-0dc3b580fbdc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:75:c6', 'vm-uuid': '719428d6-025b-4baa-97a2-c8ebdd49f57e'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:34 user nova-compute[74342]: INFO os_vif [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:75:c6,bridge_name='br-int',has_traffic_filtering=True,id=32030b48-4c52-4cf9-ba4f-0dc3b580fbdc,network=Network(58954713-04d6-4123-bfc0-74f8babdad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32030b48-4c')
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:44:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] No VIF found with MAC fa:16:3e:90:75:c6, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:44:35 user nova-compute[74342]: DEBUG nova.network.neutron [req-e48980a2-3b2d-445c-9073-e841ad4abdd8 req-f915d901-b8d2-4617-98bd-f08aff19de95 service nova] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Updated VIF entry in instance network info cache for port 32030b48-4c52-4cf9-ba4f-0dc3b580fbdc. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:44:35 user nova-compute[74342]: DEBUG nova.network.neutron [req-e48980a2-3b2d-445c-9073-e841ad4abdd8 req-f915d901-b8d2-4617-98bd-f08aff19de95 service nova] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Updating instance_info_cache with network_info: [{"id": "32030b48-4c52-4cf9-ba4f-0dc3b580fbdc", "address": "fa:16:3e:90:75:c6", "network": {"id": "58954713-04d6-4123-bfc0-74f8babdad45", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1482868561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d38497173ac495483e9f5c564415da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32030b48-4c", "ovs_interfaceid": "32030b48-4c52-4cf9-ba4f-0dc3b580fbdc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:44:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e48980a2-3b2d-445c-9073-e841ad4abdd8 req-f915d901-b8d2-4617-98bd-f08aff19de95 service nova] Releasing lock "refresh_cache-719428d6-025b-4baa-97a2-c8ebdd49f57e" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:44:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:36 user nova-compute[74342]: DEBUG nova.compute.manager [req-0aa4c235-4b07-48de-8b09-181943d8f3b5 req-107c6d93-1149-4023-8daa-2a11b0f040d4 service nova] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Received event network-vif-plugged-32030b48-4c52-4cf9-ba4f-0dc3b580fbdc {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:44:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0aa4c235-4b07-48de-8b09-181943d8f3b5 req-107c6d93-1149-4023-8daa-2a11b0f040d4 service nova] Acquiring lock "719428d6-025b-4baa-97a2-c8ebdd49f57e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0aa4c235-4b07-48de-8b09-181943d8f3b5 req-107c6d93-1149-4023-8daa-2a11b0f040d4 service nova] Lock "719428d6-025b-4baa-97a2-c8ebdd49f57e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0aa4c235-4b07-48de-8b09-181943d8f3b5 req-107c6d93-1149-4023-8daa-2a11b0f040d4 service nova] Lock "719428d6-025b-4baa-97a2-c8ebdd49f57e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:36 user nova-compute[74342]: DEBUG nova.compute.manager [req-0aa4c235-4b07-48de-8b09-181943d8f3b5 req-107c6d93-1149-4023-8daa-2a11b0f040d4 service nova] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] No waiting events found dispatching network-vif-plugged-32030b48-4c52-4cf9-ba4f-0dc3b580fbdc {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:44:36 user nova-compute[74342]: WARNING nova.compute.manager [req-0aa4c235-4b07-48de-8b09-181943d8f3b5 req-107c6d93-1149-4023-8daa-2a11b0f040d4 service nova] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Received unexpected event network-vif-plugged-32030b48-4c52-4cf9-ba4f-0dc3b580fbdc for instance with vm_state building and task_state spawning.
Oct 16 09:44:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:38 user nova-compute[74342]: DEBUG nova.compute.manager [req-8015ed22-2d95-45e1-9f66-a4403e93e2fc req-cd5aa91a-3913-4b78-81d0-4a05d4531207 service nova] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Received event network-vif-plugged-32030b48-4c52-4cf9-ba4f-0dc3b580fbdc {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:44:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8015ed22-2d95-45e1-9f66-a4403e93e2fc req-cd5aa91a-3913-4b78-81d0-4a05d4531207 service nova] Acquiring lock "719428d6-025b-4baa-97a2-c8ebdd49f57e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8015ed22-2d95-45e1-9f66-a4403e93e2fc req-cd5aa91a-3913-4b78-81d0-4a05d4531207 service nova] Lock "719428d6-025b-4baa-97a2-c8ebdd49f57e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8015ed22-2d95-45e1-9f66-a4403e93e2fc req-cd5aa91a-3913-4b78-81d0-4a05d4531207 service nova] Lock "719428d6-025b-4baa-97a2-c8ebdd49f57e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:38 user nova-compute[74342]: DEBUG nova.compute.manager [req-8015ed22-2d95-45e1-9f66-a4403e93e2fc req-cd5aa91a-3913-4b78-81d0-4a05d4531207 service nova] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] No waiting events found dispatching network-vif-plugged-32030b48-4c52-4cf9-ba4f-0dc3b580fbdc {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:44:38 user nova-compute[74342]: WARNING nova.compute.manager [req-8015ed22-2d95-45e1-9f66-a4403e93e2fc req-cd5aa91a-3913-4b78-81d0-4a05d4531207 service nova] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Received unexpected event network-vif-plugged-32030b48-4c52-4cf9-ba4f-0dc3b580fbdc for instance with vm_state building and task_state spawning.
Oct 16 09:44:38 user nova-compute[74342]: DEBUG nova.compute.manager [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:44:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:44:38 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Instance spawned successfully.
Oct 16 09:44:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:44:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:38 user nova-compute[74342]: INFO nova.compute.manager [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Took 5.91 seconds to spawn the instance on the hypervisor.
Oct 16 09:44:38 user nova-compute[74342]: DEBUG nova.compute.manager [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:44:39 user nova-compute[74342]: INFO nova.compute.manager [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Took 7.05 seconds to build instance.
Oct 16 09:44:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-eb22e334-4fec-423b-a0a3-5de50bb0d9fc tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Lock "719428d6-025b-4baa-97a2-c8ebdd49f57e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.387s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:44:41 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Cleaning up deleted instances {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 09:44:41 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] There are 0 instances to clean {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 09:44:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:44:41 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74342) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 09:44:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:44:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:42 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:44:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:42 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 09:44:42 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:42 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json" returned: 0 in 0.340s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Acquiring lock "1c0d394c-6e6b-41f6-b6eb-e5d54b82990f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Lock "1c0d394c-6e6b-41f6-b6eb-e5d54b82990f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:44 user nova-compute[74342]: DEBUG nova.compute.manager [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:44:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719428d6-025b-4baa-97a2-c8ebdd49f57e/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:44 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:44:44 user nova-compute[74342]: INFO nova.compute.claims [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Claim successful on node user
Oct 16 09:44:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719428d6-025b-4baa-97a2-c8ebdd49f57e/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719428d6-025b-4baa-97a2-c8ebdd49f57e/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719428d6-025b-4baa-97a2-c8ebdd49f57e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:45 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:44:45 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:44:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.663s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:45 user nova-compute[74342]: DEBUG nova.compute.manager [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:44:45 user nova-compute[74342]: DEBUG nova.compute.manager [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:44:45 user nova-compute[74342]: DEBUG nova.network.neutron [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:44:45 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:44:45 user nova-compute[74342]: DEBUG nova.compute.manager [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:44:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ed0377-ff2b-4a15-9175-a70624aa913d/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:45 user nova-compute[74342]: DEBUG nova.policy [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cfac413e4633478b9e524c34d5239d8b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '96d85f52140448bca8fa0646bea02d75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:44:45 user nova-compute[74342]: DEBUG nova.compute.manager [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 09:44:45 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:44:45 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Creating image(s)
Oct 16 09:44:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Acquiring lock "/opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Lock "/opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Lock "/opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ed0377-ff2b-4a15-9175-a70624aa913d/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ed0377-ff2b-4a15-9175-a70624aa913d/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.230s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ed0377-ff2b-4a15-9175-a70624aa913d/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.219s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/disk 1073741824" returned: 0 in 0.064s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.344s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG nova.network.neutron [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Successfully created port: 4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.195s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG nova.network.neutron [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Successfully updated port: 4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG nova.compute.manager [req-60890439-523a-4ea7-beca-5dadd687276d req-d8126a7c-9c47-4314-a159-59a8ab9b83cd service nova] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Received event network-changed-4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG nova.compute.manager [req-60890439-523a-4ea7-beca-5dadd687276d req-d8126a7c-9c47-4314-a159-59a8ab9b83cd service nova] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Refreshing instance network info cache due to event network-changed-4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-60890439-523a-4ea7-beca-5dadd687276d req-d8126a7c-9c47-4314-a159-59a8ab9b83cd service nova] Acquiring lock "refresh_cache-1c0d394c-6e6b-41f6-b6eb-e5d54b82990f" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-60890439-523a-4ea7-beca-5dadd687276d req-d8126a7c-9c47-4314-a159-59a8ab9b83cd service nova] Acquired lock "refresh_cache-1c0d394c-6e6b-41f6-b6eb-e5d54b82990f" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG nova.network.neutron [req-60890439-523a-4ea7-beca-5dadd687276d req-d8126a7c-9c47-4314-a159-59a8ab9b83cd service nova] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Refreshing network info cache for port 4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Acquiring lock "refresh_cache-1c0d394c-6e6b-41f6-b6eb-e5d54b82990f" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/disk --force-share --output=json" returned: 0 in 0.563s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Cannot resize image /opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Ensure instance console log exists: /opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:46 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:44:46 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:44:46 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=7829MB free_disk=25.574478149414062GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG nova.network.neutron [req-60890439-523a-4ea7-beca-5dadd687276d req-d8126a7c-9c47-4314-a159-59a8ab9b83cd service nova] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance d45abd20-3a58-4657-8f4c-a426d8e39be3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 98367a96-22f0-4edb-ab03-a8eb286b437b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance bdcd2e60-b36c-4d87-94d7-076e7430e1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance d3ed0377-ff2b-4a15-9175-a70624aa913d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 719428d6-025b-4baa-97a2-c8ebdd49f57e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 09:44:46 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.network.neutron [req-60890439-523a-4ea7-beca-5dadd687276d req-d8126a7c-9c47-4314-a159-59a8ab9b83cd service nova] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-60890439-523a-4ea7-beca-5dadd687276d req-d8126a7c-9c47-4314-a159-59a8ab9b83cd service nova] Releasing lock "refresh_cache-1c0d394c-6e6b-41f6-b6eb-e5d54b82990f" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Acquired lock "refresh_cache-1c0d394c-6e6b-41f6-b6eb-e5d54b82990f" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.network.neutron [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.network.neutron [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.431s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.network.neutron [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Updating instance_info_cache with network_info: [{"id": "4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9", "address": "fa:16:3e:42:54:d6", "network": {"id": "b6011a11-a0a3-40cb-bf20-d1df67f13d18", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1041414891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96d85f52140448bca8fa0646bea02d75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4900a7e6-eb", "ovs_interfaceid": "4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Releasing lock "refresh_cache-1c0d394c-6e6b-41f6-b6eb-e5d54b82990f" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.compute.manager [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Instance network_info: |[{"id": "4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9", "address": "fa:16:3e:42:54:d6", "network": {"id": "b6011a11-a0a3-40cb-bf20-d1df67f13d18", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1041414891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96d85f52140448bca8fa0646bea02d75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4900a7e6-eb", "ovs_interfaceid": "4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Start _get_guest_xml network_info=[{"id": "4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9", "address": "fa:16:3e:42:54:d6", "network": {"id": "b6011a11-a0a3-40cb-bf20-d1df67f13d18", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1041414891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96d85f52140448bca8fa0646bea02d75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4900a7e6-eb", "ovs_interfaceid": "4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:44:47 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:44:47 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:44:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1526365471',display_name='tempest-TestVolumeSwap-server-1526365471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1526365471',id=8,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkerhSX2ESfi6yIwy3pqF6xZrlFRUGF12oJeq33lLeKQHy8c5rhTkNY8IXsANWd8wE4iLXnUdFod6fG0rtDOmdxB4KiLO13GHeDXbu3yUdDrnraYfYTMRCQ0m8EMPtUag==',key_name='tempest-keypair-193753504',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96d85f52140448bca8fa0646bea02d75',ramdisk_id='',reservation_id='r-cu8z3kjp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-346509380',owner_user_name='tempest-TestVolumeSwap-346509380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:44:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfac413e4633478b9e524c34d5239d8b',uuid=1c0d394c-6e6b-41f6-b6eb-e5d54b82990f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9", "address": "fa:16:3e:42:54:d6", "network": {"id": "b6011a11-a0a3-40cb-bf20-d1df67f13d18", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1041414891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96d85f52140448bca8fa0646bea02d75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4900a7e6-eb", "ovs_interfaceid": "4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Converting VIF {"id": "4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9", "address": "fa:16:3e:42:54:d6", "network": {"id": "b6011a11-a0a3-40cb-bf20-d1df67f13d18", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1041414891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96d85f52140448bca8fa0646bea02d75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4900a7e6-eb", "ovs_interfaceid": "4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:54:d6,bridge_name='br-int',has_traffic_filtering=True,id=4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9,network=Network(b6011a11-a0a3-40cb-bf20-d1df67f13d18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4900a7e6-eb') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.objects.instance [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:44:47 user nova-compute[74342]:   <uuid>1c0d394c-6e6b-41f6-b6eb-e5d54b82990f</uuid>
Oct 16 09:44:47 user nova-compute[74342]:   <name>instance-00000008</name>
Oct 16 09:44:47 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:44:47 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:44:47 user nova-compute[74342]:   <metadata>
Oct 16 09:44:47 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:44:47 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:44:47 user nova-compute[74342]:       <nova:name>tempest-TestVolumeSwap-server-1526365471</nova:name>
Oct 16 09:44:47 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:44:47</nova:creationTime>
Oct 16 09:44:47 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:44:47 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:44:47 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:44:47 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:44:47 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:44:47 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:44:47 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:44:47 user nova-compute[74342]:       <nova:owner>
Oct 16 09:44:47 user nova-compute[74342]:         <nova:user uuid="cfac413e4633478b9e524c34d5239d8b">tempest-TestVolumeSwap-346509380-project-member</nova:user>
Oct 16 09:44:47 user nova-compute[74342]:         <nova:project uuid="96d85f52140448bca8fa0646bea02d75">tempest-TestVolumeSwap-346509380</nova:project>
Oct 16 09:44:47 user nova-compute[74342]:       </nova:owner>
Oct 16 09:44:47 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:44:47 user nova-compute[74342]:       <nova:ports>
Oct 16 09:44:47 user nova-compute[74342]:         <nova:port uuid="4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9">
Oct 16 09:44:47 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 16 09:44:47 user nova-compute[74342]:         </nova:port>
Oct 16 09:44:47 user nova-compute[74342]:       </nova:ports>
Oct 16 09:44:47 user nova-compute[74342]:     </nova:instance>
Oct 16 09:44:47 user nova-compute[74342]:   </metadata>
Oct 16 09:44:47 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:44:47 user nova-compute[74342]:     <system>
Oct 16 09:44:47 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:44:47 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:44:47 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:44:47 user nova-compute[74342]:       <entry name="serial">1c0d394c-6e6b-41f6-b6eb-e5d54b82990f</entry>
Oct 16 09:44:47 user nova-compute[74342]:       <entry name="uuid">1c0d394c-6e6b-41f6-b6eb-e5d54b82990f</entry>
Oct 16 09:44:47 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:44:47 user nova-compute[74342]:     </system>
Oct 16 09:44:47 user nova-compute[74342]:   </sysinfo>
Oct 16 09:44:47 user nova-compute[74342]:   <os>
Oct 16 09:44:47 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:44:47 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:44:47 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:44:47 user nova-compute[74342]:   </os>
Oct 16 09:44:47 user nova-compute[74342]:   <features>
Oct 16 09:44:47 user nova-compute[74342]:     <acpi/>
Oct 16 09:44:47 user nova-compute[74342]:     <apic/>
Oct 16 09:44:47 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:44:47 user nova-compute[74342]:   </features>
Oct 16 09:44:47 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:44:47 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:44:47 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:44:47 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:44:47 user nova-compute[74342]:   </clock>
Oct 16 09:44:47 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:44:47 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:44:47 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:44:47 user nova-compute[74342]:   </cpu>
Oct 16 09:44:47 user nova-compute[74342]:   <devices>
Oct 16 09:44:47 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 09:44:47 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 09:44:47 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/disk"/>
Oct 16 09:44:47 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:44:47 user nova-compute[74342]:     </disk>
Oct 16 09:44:47 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:44:47 user nova-compute[74342]:       <mac address="fa:16:3e:42:54:d6"/>
Oct 16 09:44:47 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:44:47 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:44:47 user nova-compute[74342]:       <target dev="tap4900a7e6-eb"/>
Oct 16 09:44:47 user nova-compute[74342]:     </interface>
Oct 16 09:44:47 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:44:47 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/console.log" append="off"/>
Oct 16 09:44:47 user nova-compute[74342]:     </serial>
Oct 16 09:44:47 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:44:47 user nova-compute[74342]:     <video>
Oct 16 09:44:47 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:44:47 user nova-compute[74342]:     </video>
Oct 16 09:44:47 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:44:47 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:44:47 user nova-compute[74342]:     </rng>
Oct 16 09:44:47 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:44:47 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:44:47 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:44:47 user nova-compute[74342]:     </memballoon>
Oct 16 09:44:47 user nova-compute[74342]:   </devices>
Oct 16 09:44:47 user nova-compute[74342]: </domain>
Oct 16 09:44:47 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:44:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1526365471',display_name='tempest-TestVolumeSwap-server-1526365471',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1526365471',id=8,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkerhSX2ESfi6yIwy3pqF6xZrlFRUGF12oJeq33lLeKQHy8c5rhTkNY8IXsANWd8wE4iLXnUdFod6fG0rtDOmdxB4KiLO13GHeDXbu3yUdDrnraYfYTMRCQ0m8EMPtUag==',key_name='tempest-keypair-193753504',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='96d85f52140448bca8fa0646bea02d75',ramdisk_id='',reservation_id='r-cu8z3kjp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-346509380',owner_user_name='tempest-TestVolumeSwap-346509380-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:44:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfac413e4633478b9e524c34d5239d8b',uuid=1c0d394c-6e6b-41f6-b6eb-e5d54b82990f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9", "address": "fa:16:3e:42:54:d6", "network": {"id": "b6011a11-a0a3-40cb-bf20-d1df67f13d18", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1041414891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96d85f52140448bca8fa0646bea02d75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4900a7e6-eb", "ovs_interfaceid": "4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Converting VIF {"id": "4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9", "address": "fa:16:3e:42:54:d6", "network": {"id": "b6011a11-a0a3-40cb-bf20-d1df67f13d18", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1041414891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96d85f52140448bca8fa0646bea02d75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4900a7e6-eb", "ovs_interfaceid": "4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:54:d6,bridge_name='br-int',has_traffic_filtering=True,id=4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9,network=Network(b6011a11-a0a3-40cb-bf20-d1df67f13d18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4900a7e6-eb') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG os_vif [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:54:d6,bridge_name='br-int',has_traffic_filtering=True,id=4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9,network=Network(b6011a11-a0a3-40cb-bf20-d1df67f13d18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4900a7e6-eb') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cccc7b50-1980-580f-9231-083450ab5e01', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4900a7e6-eb, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4900a7e6-eb, col_values=(('qos', UUID('7864d22a-a4f1-4bb6-8a2a-e7bcf4121de6')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4900a7e6-eb, col_values=(('external_ids', {'iface-id': '4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:54:d6', 'vm-uuid': '1c0d394c-6e6b-41f6-b6eb-e5d54b82990f'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:47 user nova-compute[74342]: INFO os_vif [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:54:d6,bridge_name='br-int',has_traffic_filtering=True,id=4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9,network=Network(b6011a11-a0a3-40cb-bf20-d1df67f13d18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4900a7e6-eb')
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:44:47 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] No VIF found with MAC fa:16:3e:42:54:d6, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:44:48 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:44:48 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:44:48 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 09:44:48 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Rebuilding the list of instances to heal {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 09:44:48 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Skipping network cache update for instance because it is Building. {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 16 09:44:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-d45abd20-3a58-4657-8f4c-a426d8e39be3" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:44:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-d45abd20-3a58-4657-8f4c-a426d8e39be3" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:44:48 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 09:44:48 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lazy-loading 'info_cache' on Instance uuid d45abd20-3a58-4657-8f4c-a426d8e39be3 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:44:48 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Updating instance_info_cache with network_info: [{"id": "2e5ec9cf-9b58-47bc-be15-0b896a7625bc", "address": "fa:16:3e:8c:de:8b", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e5ec9cf-9b", "ovs_interfaceid": "2e5ec9cf-9b58-47bc-be15-0b896a7625bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:44:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-d45abd20-3a58-4657-8f4c-a426d8e39be3" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:44:48 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 09:44:48 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:44:48 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:44:48 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:44:48 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:44:48 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:44:48 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 09:44:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:49 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:44:49 user nova-compute[74342]: DEBUG nova.compute.manager [req-8a116f07-0fad-4d4f-841d-5fe9b7b909ca req-9070c514-f622-47e0-a857-98953c496d78 service nova] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Received event network-vif-plugged-4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:44:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8a116f07-0fad-4d4f-841d-5fe9b7b909ca req-9070c514-f622-47e0-a857-98953c496d78 service nova] Acquiring lock "1c0d394c-6e6b-41f6-b6eb-e5d54b82990f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8a116f07-0fad-4d4f-841d-5fe9b7b909ca req-9070c514-f622-47e0-a857-98953c496d78 service nova] Lock "1c0d394c-6e6b-41f6-b6eb-e5d54b82990f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8a116f07-0fad-4d4f-841d-5fe9b7b909ca req-9070c514-f622-47e0-a857-98953c496d78 service nova] Lock "1c0d394c-6e6b-41f6-b6eb-e5d54b82990f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:49 user nova-compute[74342]: DEBUG nova.compute.manager [req-8a116f07-0fad-4d4f-841d-5fe9b7b909ca req-9070c514-f622-47e0-a857-98953c496d78 service nova] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] No waiting events found dispatching network-vif-plugged-4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:44:49 user nova-compute[74342]: WARNING nova.compute.manager [req-8a116f07-0fad-4d4f-841d-5fe9b7b909ca req-9070c514-f622-47e0-a857-98953c496d78 service nova] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Received unexpected event network-vif-plugged-4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9 for instance with vm_state building and task_state spawning.
Oct 16 09:44:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:51 user nova-compute[74342]: DEBUG nova.compute.manager [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:44:51 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:44:51 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Instance spawned successfully.
Oct 16 09:44:51 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:44:51 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:51 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:51 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:51 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:51 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:51 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:44:51 user nova-compute[74342]: DEBUG nova.compute.manager [req-ea660279-c4a8-4330-8838-2577e9538073 req-2ee0ddc0-6cd4-4ffb-86e0-7b425e0b7064 service nova] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Received event network-vif-plugged-4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:44:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ea660279-c4a8-4330-8838-2577e9538073 req-2ee0ddc0-6cd4-4ffb-86e0-7b425e0b7064 service nova] Acquiring lock "1c0d394c-6e6b-41f6-b6eb-e5d54b82990f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:44:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ea660279-c4a8-4330-8838-2577e9538073 req-2ee0ddc0-6cd4-4ffb-86e0-7b425e0b7064 service nova] Lock "1c0d394c-6e6b-41f6-b6eb-e5d54b82990f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:44:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ea660279-c4a8-4330-8838-2577e9538073 req-2ee0ddc0-6cd4-4ffb-86e0-7b425e0b7064 service nova] Lock "1c0d394c-6e6b-41f6-b6eb-e5d54b82990f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:51 user nova-compute[74342]: DEBUG nova.compute.manager [req-ea660279-c4a8-4330-8838-2577e9538073 req-2ee0ddc0-6cd4-4ffb-86e0-7b425e0b7064 service nova] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] No waiting events found dispatching network-vif-plugged-4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:44:51 user nova-compute[74342]: WARNING nova.compute.manager [req-ea660279-c4a8-4330-8838-2577e9538073 req-2ee0ddc0-6cd4-4ffb-86e0-7b425e0b7064 service nova] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Received unexpected event network-vif-plugged-4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9 for instance with vm_state building and task_state spawning.
Oct 16 09:44:51 user nova-compute[74342]: INFO nova.compute.manager [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Took 6.12 seconds to spawn the instance on the hypervisor.
Oct 16 09:44:51 user nova-compute[74342]: DEBUG nova.compute.manager [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:44:51 user nova-compute[74342]: INFO nova.compute.manager [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Took 7.30 seconds to build instance.
Oct 16 09:44:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f73d233b-111e-4ec2-b676-a5d7c85e491d tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Lock "1c0d394c-6e6b-41f6-b6eb-e5d54b82990f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.485s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:44:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:44:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:07 user nova-compute[74342]: DEBUG nova.compute.manager [req-6ccc3f44-115f-42a6-8fad-6f2a8da59688 req-033352be-5749-48a2-96b2-00f7c8e35c1c service nova] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Received event network-vif-plugged-75f58c77-45a5-4951-951c-4c0bb6ac8bf3 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:45:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-6ccc3f44-115f-42a6-8fad-6f2a8da59688 req-033352be-5749-48a2-96b2-00f7c8e35c1c service nova] Acquiring lock "98367a96-22f0-4edb-ab03-a8eb286b437b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:45:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-6ccc3f44-115f-42a6-8fad-6f2a8da59688 req-033352be-5749-48a2-96b2-00f7c8e35c1c service nova] Lock "98367a96-22f0-4edb-ab03-a8eb286b437b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:45:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-6ccc3f44-115f-42a6-8fad-6f2a8da59688 req-033352be-5749-48a2-96b2-00f7c8e35c1c service nova] Lock "98367a96-22f0-4edb-ab03-a8eb286b437b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:45:07 user nova-compute[74342]: DEBUG nova.compute.manager [req-6ccc3f44-115f-42a6-8fad-6f2a8da59688 req-033352be-5749-48a2-96b2-00f7c8e35c1c service nova] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] No waiting events found dispatching network-vif-plugged-75f58c77-45a5-4951-951c-4c0bb6ac8bf3 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:45:07 user nova-compute[74342]: WARNING nova.compute.manager [req-6ccc3f44-115f-42a6-8fad-6f2a8da59688 req-033352be-5749-48a2-96b2-00f7c8e35c1c service nova] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Received unexpected event network-vif-plugged-75f58c77-45a5-4951-951c-4c0bb6ac8bf3 for instance with vm_state active and task_state None.
Oct 16 09:45:10 user nova-compute[74342]: DEBUG nova.compute.manager [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Received event network-vif-plugged-75f58c77-45a5-4951-951c-4c0bb6ac8bf3 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] Acquiring lock "98367a96-22f0-4edb-ab03-a8eb286b437b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] Lock "98367a96-22f0-4edb-ab03-a8eb286b437b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] Lock "98367a96-22f0-4edb-ab03-a8eb286b437b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG nova.compute.manager [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] No waiting events found dispatching network-vif-plugged-75f58c77-45a5-4951-951c-4c0bb6ac8bf3 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:45:10 user nova-compute[74342]: WARNING nova.compute.manager [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Received unexpected event network-vif-plugged-75f58c77-45a5-4951-951c-4c0bb6ac8bf3 for instance with vm_state active and task_state None.
Oct 16 09:45:10 user nova-compute[74342]: DEBUG nova.compute.manager [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Received event network-vif-plugged-dd087947-aab3-4ee2-81c4-71d884fb003b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] Acquiring lock "89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] Lock "89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] Lock "89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG nova.compute.manager [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] No waiting events found dispatching network-vif-plugged-dd087947-aab3-4ee2-81c4-71d884fb003b {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:45:10 user nova-compute[74342]: WARNING nova.compute.manager [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Received unexpected event network-vif-plugged-dd087947-aab3-4ee2-81c4-71d884fb003b for instance with vm_state active and task_state None.
Oct 16 09:45:10 user nova-compute[74342]: DEBUG nova.compute.manager [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Received event network-vif-plugged-dd087947-aab3-4ee2-81c4-71d884fb003b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] Acquiring lock "89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] Lock "89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] Lock "89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG nova.compute.manager [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] No waiting events found dispatching network-vif-plugged-dd087947-aab3-4ee2-81c4-71d884fb003b {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:45:10 user nova-compute[74342]: WARNING nova.compute.manager [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Received unexpected event network-vif-plugged-dd087947-aab3-4ee2-81c4-71d884fb003b for instance with vm_state active and task_state None.
Oct 16 09:45:10 user nova-compute[74342]: DEBUG nova.compute.manager [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Received event network-vif-plugged-2e5ec9cf-9b58-47bc-be15-0b896a7625bc {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] Acquiring lock "d45abd20-3a58-4657-8f4c-a426d8e39be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] Lock "d45abd20-3a58-4657-8f4c-a426d8e39be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] Lock "d45abd20-3a58-4657-8f4c-a426d8e39be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG nova.compute.manager [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] No waiting events found dispatching network-vif-plugged-2e5ec9cf-9b58-47bc-be15-0b896a7625bc {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:45:10 user nova-compute[74342]: WARNING nova.compute.manager [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Received unexpected event network-vif-plugged-2e5ec9cf-9b58-47bc-be15-0b896a7625bc for instance with vm_state active and task_state None.
Oct 16 09:45:10 user nova-compute[74342]: DEBUG nova.compute.manager [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Received event network-vif-plugged-2e5ec9cf-9b58-47bc-be15-0b896a7625bc {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] Acquiring lock "d45abd20-3a58-4657-8f4c-a426d8e39be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] Lock "d45abd20-3a58-4657-8f4c-a426d8e39be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] Lock "d45abd20-3a58-4657-8f4c-a426d8e39be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG nova.compute.manager [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] No waiting events found dispatching network-vif-plugged-2e5ec9cf-9b58-47bc-be15-0b896a7625bc {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:45:10 user nova-compute[74342]: WARNING nova.compute.manager [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Received unexpected event network-vif-plugged-2e5ec9cf-9b58-47bc-be15-0b896a7625bc for instance with vm_state active and task_state None.
Oct 16 09:45:10 user nova-compute[74342]: DEBUG nova.compute.manager [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Received event network-vif-plugged-6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] Acquiring lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG nova.compute.manager [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] No waiting events found dispatching network-vif-plugged-6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:45:10 user nova-compute[74342]: WARNING nova.compute.manager [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Received unexpected event network-vif-plugged-6880e1ef-5122-458c-a9b8-a8202cdee055 for instance with vm_state active and task_state None.
Oct 16 09:45:10 user nova-compute[74342]: DEBUG nova.compute.manager [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Received event network-vif-plugged-6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] Acquiring lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG nova.compute.manager [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] No waiting events found dispatching network-vif-plugged-6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:45:10 user nova-compute[74342]: WARNING nova.compute.manager [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Received unexpected event network-vif-plugged-6880e1ef-5122-458c-a9b8-a8202cdee055 for instance with vm_state active and task_state None.
Oct 16 09:45:10 user nova-compute[74342]: DEBUG nova.compute.manager [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Received event network-vif-plugged-c7e71629-bc93-41ff-bd86-e1f6be6aec6b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] Acquiring lock "d3ed0377-ff2b-4a15-9175-a70624aa913d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] Lock "d3ed0377-ff2b-4a15-9175-a70624aa913d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] Lock "d3ed0377-ff2b-4a15-9175-a70624aa913d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG nova.compute.manager [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] No waiting events found dispatching network-vif-plugged-c7e71629-bc93-41ff-bd86-e1f6be6aec6b {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:45:10 user nova-compute[74342]: WARNING nova.compute.manager [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Received unexpected event network-vif-plugged-c7e71629-bc93-41ff-bd86-e1f6be6aec6b for instance with vm_state active and task_state None.
Oct 16 09:45:10 user nova-compute[74342]: DEBUG nova.compute.manager [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Received event network-vif-plugged-c7e71629-bc93-41ff-bd86-e1f6be6aec6b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] Acquiring lock "d3ed0377-ff2b-4a15-9175-a70624aa913d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] Lock "d3ed0377-ff2b-4a15-9175-a70624aa913d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] Lock "d3ed0377-ff2b-4a15-9175-a70624aa913d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:45:10 user nova-compute[74342]: DEBUG nova.compute.manager [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] No waiting events found dispatching network-vif-plugged-c7e71629-bc93-41ff-bd86-e1f6be6aec6b {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:45:10 user nova-compute[74342]: WARNING nova.compute.manager [req-d0ea2397-f516-4bb8-89ce-f65f4dcee469 req-708f870c-565d-4d3a-b5cb-e839590688f2 service nova] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Received unexpected event network-vif-plugged-c7e71629-bc93-41ff-bd86-e1f6be6aec6b for instance with vm_state active and task_state None.
Oct 16 09:45:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Acquiring lock "017caffb-5be2-4e78-ab48-a8091c5c00f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:45:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Lock "017caffb-5be2-4e78-ab48-a8091c5c00f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:45:16 user nova-compute[74342]: DEBUG nova.compute.manager [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:45:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:45:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:45:16 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:45:16 user nova-compute[74342]: INFO nova.compute.claims [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Claim successful on node user
Oct 16 09:45:16 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Refreshing inventories for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 09:45:16 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Updating ProviderTree inventory for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 09:45:16 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Updating inventory in ProviderTree for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 09:45:16 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Refreshing aggregate associations for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca, aggregates: None {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 09:45:16 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Refreshing trait associations for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 09:45:16 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:45:16 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:45:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.531s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:45:17 user nova-compute[74342]: DEBUG nova.compute.manager [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:45:17 user nova-compute[74342]: DEBUG nova.compute.manager [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:45:17 user nova-compute[74342]: DEBUG nova.network.neutron [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:45:17 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:45:17 user nova-compute[74342]: DEBUG nova.compute.manager [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:45:17 user nova-compute[74342]: DEBUG nova.policy [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '596268e3d8b7413ba90094ae370971f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cbba73e7218148b492aca0b1c2673b85', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:45:17 user nova-compute[74342]: INFO nova.virt.block_device [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Booting with volume fe2aa7c1-4340-4adb-915f-3be7ae4a985d at /dev/vda
Oct 16 09:45:17 user nova-compute[74342]: DEBUG os_brick.utils [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:45:17 user nova-compute[74342]: INFO oslo.privsep.daemon [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpnahbn0kg/privsep.sock']
Oct 16 09:45:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:17 user sudo[85389]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpnahbn0kg/privsep.sock
Oct 16 09:45:17 user sudo[85389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Oct 16 09:45:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:17 user nova-compute[74342]: DEBUG nova.network.neutron [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Successfully created port: 0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:45:18 user nova-compute[74342]: DEBUG nova.network.neutron [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Successfully updated port: 0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:45:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Acquiring lock "refresh_cache-017caffb-5be2-4e78-ab48-a8091c5c00f4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:45:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Acquired lock "refresh_cache-017caffb-5be2-4e78-ab48-a8091c5c00f4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:45:18 user nova-compute[74342]: DEBUG nova.network.neutron [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:45:18 user nova-compute[74342]: DEBUG nova.compute.manager [req-72b3462e-62a2-4b18-882a-c19ed2f01c69 req-39f31dfd-ae2b-4fbc-b216-a6f186a404b2 service nova] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Received event network-changed-0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:45:18 user nova-compute[74342]: DEBUG nova.compute.manager [req-72b3462e-62a2-4b18-882a-c19ed2f01c69 req-39f31dfd-ae2b-4fbc-b216-a6f186a404b2 service nova] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Refreshing instance network info cache due to event network-changed-0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:45:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-72b3462e-62a2-4b18-882a-c19ed2f01c69 req-39f31dfd-ae2b-4fbc-b216-a6f186a404b2 service nova] Acquiring lock "refresh_cache-017caffb-5be2-4e78-ab48-a8091c5c00f4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:45:18 user nova-compute[74342]: DEBUG nova.network.neutron [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:45:18 user nova-compute[74342]: DEBUG nova.network.neutron [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Updating instance_info_cache with network_info: [{"id": "0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6", "address": "fa:16:3e:56:bd:70", "network": {"id": "9c306d1c-3407-47dd-a04f-e185b1d1788a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1404292047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbba73e7218148b492aca0b1c2673b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad97513-e2", "ovs_interfaceid": "0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:45:18 user sudo[85389]: pam_unix(sudo:session): session closed for user root
Oct 16 09:45:18 user nova-compute[74342]: INFO oslo.privsep.daemon [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Spawned new privsep daemon via rootwrap
Oct 16 09:45:18 user nova-compute[74342]: INFO oslo.privsep.daemon [-] privsep daemon starting
Oct 16 09:45:18 user nova-compute[74342]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Oct 16 09:45:18 user nova-compute[74342]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Oct 16 09:45:18 user nova-compute[74342]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85400
Oct 16 09:45:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Releasing lock "refresh_cache-017caffb-5be2-4e78-ab48-a8091c5c00f4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:45:18 user nova-compute[74342]: DEBUG nova.compute.manager [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Instance network_info: |[{"id": "0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6", "address": "fa:16:3e:56:bd:70", "network": {"id": "9c306d1c-3407-47dd-a04f-e185b1d1788a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1404292047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbba73e7218148b492aca0b1c2673b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad97513-e2", "ovs_interfaceid": "0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:45:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-72b3462e-62a2-4b18-882a-c19ed2f01c69 req-39f31dfd-ae2b-4fbc-b216-a6f186a404b2 service nova] Acquired lock "refresh_cache-017caffb-5be2-4e78-ab48-a8091c5c00f4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:45:18 user nova-compute[74342]: DEBUG nova.network.neutron [req-72b3462e-62a2-4b18-882a-c19ed2f01c69 req-39f31dfd-ae2b-4fbc-b216-a6f186a404b2 service nova] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Refreshing network info cache for port 0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:45:18 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e3903e-cbc0-468f-a6a6-576d92cf4b31]: (2,) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:45:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:19 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7228f30f-93f7-447e-84ee-a2bbace9629d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:45:19 user nova-compute[74342]: WARNING os_brick.initiator.connectors.nvmeof [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Oct 16 09:45:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:19 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[657d8ab6-40aa-4c89-a716-5f97351100e4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:45:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:19 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[288b6c44-5163-45af-8d70-fdead1f2ae2e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:45:19 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ff2315-d2b7-456e-ac54-7b17bec6a5ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:45:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:45:19 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:45:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:45:19 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:45:19 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd40e55d-f39f-4182-acb7-e8c06fc18b14]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:45:19 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:45:19 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:45:19 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:45:19 user nova-compute[74342]: DEBUG os_brick.utils [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] <== get_connector_properties: return (1852ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:45:19 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Updating existing volume attachment record: e98ef2e5-96e7-4db9-8e76-33e57c352c87 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 09:45:19 user nova-compute[74342]: DEBUG nova.network.neutron [req-72b3462e-62a2-4b18-882a-c19ed2f01c69 req-39f31dfd-ae2b-4fbc-b216-a6f186a404b2 service nova] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Updated VIF entry in instance network info cache for port 0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:45:19 user nova-compute[74342]: DEBUG nova.network.neutron [req-72b3462e-62a2-4b18-882a-c19ed2f01c69 req-39f31dfd-ae2b-4fbc-b216-a6f186a404b2 service nova] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Updating instance_info_cache with network_info: [{"id": "0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6", "address": "fa:16:3e:56:bd:70", "network": {"id": "9c306d1c-3407-47dd-a04f-e185b1d1788a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1404292047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbba73e7218148b492aca0b1c2673b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad97513-e2", "ovs_interfaceid": "0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:45:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-72b3462e-62a2-4b18-882a-c19ed2f01c69 req-39f31dfd-ae2b-4fbc-b216-a6f186a404b2 service nova] Releasing lock "refresh_cache-017caffb-5be2-4e78-ab48-a8091c5c00f4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:45:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG nova.compute.manager [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:45:35 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Creating image(s)
Oct 16 09:45:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Did not create local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Ensure instance console log exists: /opt/stack/data/nova/instances/017caffb-5be2-4e78-ab48-a8091c5c00f4/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Start _get_guest_xml network_info=[{"id": "0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6", "address": "fa:16:3e:56:bd:70", "network": {"id": "9c306d1c-3407-47dd-a04f-e185b1d1788a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1404292047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbba73e7218148b492aca0b1c2673b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad97513-e2", "ovs_interfaceid": "0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'attachment_id': 'e98ef2e5-96e7-4db9-8e76-33e57c352c87', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QSPrXWFi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '017caffb-5be2-4e78-ab48-a8091c5c00f4', 'attached_at': '', 'detached_at': '', 'volume_id': 'fe2aa7c1-4340-4adb-915f-3be7ae4a985d', 'serial': 'fe2aa7c1-4340-4adb-915f-3be7ae4a985d'}, 'volume_type': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:45:35 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:45:35 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:45:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG os_brick.initiator.connector [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Factory for ISCSI on None {{(pid=74342) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.005s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QSPrXWFi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:45:35 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:45:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:45:35 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:45:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:45:35 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a33e3b91-ef71-485c-897a-17a112fbb0bb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 09:45:35 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e337af9b-a9ca-45e0-b09b-03361fa94707]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d] added
Oct 16 09:45:35 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d418ce0-b2e3-4d44-9f9c-b70327ef1508]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6614eecc-7337-458d-b9b8-7665b2fde6f0]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QSPrXWFi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QSPrXWFi" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd636b9-f6f3-4fd8-bbc4-318af04a10f7]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QSPrXWFi'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[891e7b49-588e-4a88-872b-f8343caf70b2]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2d0ea61-7e65-4102-85c1-04a6c291541c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 09:45:35 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 09:45:35 user nova-compute[74342]:  {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:45:35 user nova-compute[74342]: WARNING os_brick.initiator.connectors.iscsi [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 09:45:35 user nova-compute[74342]: 
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8077d31-713d-468c-bc5d-eb9138613215]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d, portal: 172.16.0.220,3260]
Oct 16 09:45:35 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d, portal: 172.16.0.220,3260] successful.
Oct 16 09:45:35 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aff2808-99b8-4f95-bf73-f1ae59c7e699]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b4ee68-37db-461c-ba8a-47297e8505a4]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)
Oct 16 09:45:35 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)
Oct 16 09:45:35 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0369ce7e-9b56-488e-a4ce-7441125c3f2a]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:45:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QSPrXWFi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 09:45:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:45:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] <== connect_volume: return (1283ms) {'type': 'block', 'scsi_wwn': '23135363638353138', 'path': '/dev/sdb'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:45:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23135363638353138', 'path': '/dev/sdb'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 09:45:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:45:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-6026343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-6026343',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPciwGhgOXmWKxPktygR+HbYTK8AUs1Crujmt54eoK4xAiI8i1PAFebnNjbXBPGkoIS2iiZYgHukiKRdajQWHqMDi5/QPWZiz5/7sETFrH4JlOPioPfUP9OLnmHgasCJMg==',key_name='tempest-keypair-1307970994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbba73e7218148b492aca0b1c2673b85',ramdisk_id='',reservation_id='r-pg3x8ny5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1575697015',owner_user_name='tempest-ServerActionsV293TestJSON-1575697015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:45:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='596268e3d8b7413ba90094ae370971f9',uuid=017caffb-5be2-4e78-ab48-a8091c5c00f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6", "address": "fa:16:3e:56:bd:70", "network": {"id": "9c306d1c-3407-47dd-a04f-e185b1d1788a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1404292047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbba73e7218148b492aca0b1c2673b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad97513-e2", "ovs_interfaceid": "0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:45:36 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Converting VIF {"id": "0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6", "address": "fa:16:3e:56:bd:70", "network": {"id": "9c306d1c-3407-47dd-a04f-e185b1d1788a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1404292047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbba73e7218148b492aca0b1c2673b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad97513-e2", "ovs_interfaceid": "0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:45:36 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:bd:70,bridge_name='br-int',has_traffic_filtering=True,id=0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6,network=Network(9c306d1c-3407-47dd-a04f-e185b1d1788a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad97513-e2') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:45:36 user nova-compute[74342]: DEBUG nova.objects.instance [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Lazy-loading 'pci_devices' on Instance uuid 017caffb-5be2-4e78-ab48-a8091c5c00f4 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:45:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:45:36 user nova-compute[74342]:   <uuid>017caffb-5be2-4e78-ab48-a8091c5c00f4</uuid>
Oct 16 09:45:36 user nova-compute[74342]:   <name>instance-00000009</name>
Oct 16 09:45:36 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:45:36 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:45:36 user nova-compute[74342]:   <metadata>
Oct 16 09:45:36 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:45:36 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:45:36 user nova-compute[74342]:       <nova:name>tempest-ServerActionsV293TestJSON-server-6026343</nova:name>
Oct 16 09:45:36 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:45:35</nova:creationTime>
Oct 16 09:45:36 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:45:36 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:45:36 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:45:36 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:45:36 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:45:36 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:45:36 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:45:36 user nova-compute[74342]:       <nova:owner>
Oct 16 09:45:36 user nova-compute[74342]:         <nova:user uuid="596268e3d8b7413ba90094ae370971f9">tempest-ServerActionsV293TestJSON-1575697015-project-member</nova:user>
Oct 16 09:45:36 user nova-compute[74342]:         <nova:project uuid="cbba73e7218148b492aca0b1c2673b85">tempest-ServerActionsV293TestJSON-1575697015</nova:project>
Oct 16 09:45:36 user nova-compute[74342]:       </nova:owner>
Oct 16 09:45:36 user nova-compute[74342]:       <nova:ports>
Oct 16 09:45:36 user nova-compute[74342]:         <nova:port uuid="0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6">
Oct 16 09:45:36 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 16 09:45:36 user nova-compute[74342]:         </nova:port>
Oct 16 09:45:36 user nova-compute[74342]:       </nova:ports>
Oct 16 09:45:36 user nova-compute[74342]:     </nova:instance>
Oct 16 09:45:36 user nova-compute[74342]:   </metadata>
Oct 16 09:45:36 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:45:36 user nova-compute[74342]:     <system>
Oct 16 09:45:36 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:45:36 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:45:36 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:45:36 user nova-compute[74342]:       <entry name="serial">017caffb-5be2-4e78-ab48-a8091c5c00f4</entry>
Oct 16 09:45:36 user nova-compute[74342]:       <entry name="uuid">017caffb-5be2-4e78-ab48-a8091c5c00f4</entry>
Oct 16 09:45:36 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:45:36 user nova-compute[74342]:     </system>
Oct 16 09:45:36 user nova-compute[74342]:   </sysinfo>
Oct 16 09:45:36 user nova-compute[74342]:   <os>
Oct 16 09:45:36 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:45:36 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:45:36 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:45:36 user nova-compute[74342]:   </os>
Oct 16 09:45:36 user nova-compute[74342]:   <features>
Oct 16 09:45:36 user nova-compute[74342]:     <acpi/>
Oct 16 09:45:36 user nova-compute[74342]:     <apic/>
Oct 16 09:45:36 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:45:36 user nova-compute[74342]:   </features>
Oct 16 09:45:36 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:45:36 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:45:36 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:45:36 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:45:36 user nova-compute[74342]:   </clock>
Oct 16 09:45:36 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:45:36 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:45:36 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:45:36 user nova-compute[74342]:   </cpu>
Oct 16 09:45:36 user nova-compute[74342]:   <devices>
Oct 16 09:45:36 user nova-compute[74342]:     <disk type="block" device="disk">
Oct 16 09:45:36 user nova-compute[74342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:45:36 user nova-compute[74342]:       <source dev="/dev/sdb"/>
Oct 16 09:45:36 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:45:36 user nova-compute[74342]:       <serial>fe2aa7c1-4340-4adb-915f-3be7ae4a985d</serial>
Oct 16 09:45:36 user nova-compute[74342]:     </disk>
Oct 16 09:45:36 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:45:36 user nova-compute[74342]:       <mac address="fa:16:3e:56:bd:70"/>
Oct 16 09:45:36 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:45:36 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:45:36 user nova-compute[74342]:       <target dev="tap0ad97513-e2"/>
Oct 16 09:45:36 user nova-compute[74342]:     </interface>
Oct 16 09:45:36 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:45:36 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/017caffb-5be2-4e78-ab48-a8091c5c00f4/console.log" append="off"/>
Oct 16 09:45:36 user nova-compute[74342]:     </serial>
Oct 16 09:45:36 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:45:36 user nova-compute[74342]:     <video>
Oct 16 09:45:36 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:45:36 user nova-compute[74342]:     </video>
Oct 16 09:45:36 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:45:36 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:45:36 user nova-compute[74342]:     </rng>
Oct 16 09:45:36 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:45:36 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:45:36 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:45:36 user nova-compute[74342]:     </memballoon>
Oct 16 09:45:36 user nova-compute[74342]:   </devices>
Oct 16 09:45:36 user nova-compute[74342]: </domain>
Oct 16 09:45:36 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:45:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:45:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-6026343',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-6026343',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPciwGhgOXmWKxPktygR+HbYTK8AUs1Crujmt54eoK4xAiI8i1PAFebnNjbXBPGkoIS2iiZYgHukiKRdajQWHqMDi5/QPWZiz5/7sETFrH4JlOPioPfUP9OLnmHgasCJMg==',key_name='tempest-keypair-1307970994',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cbba73e7218148b492aca0b1c2673b85',ramdisk_id='',reservation_id='r-pg3x8ny5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1575697015',owner_user_name='tempest-ServerActionsV293TestJSON-1575697015-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:45:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='596268e3d8b7413ba90094ae370971f9',uuid=017caffb-5be2-4e78-ab48-a8091c5c00f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6", "address": "fa:16:3e:56:bd:70", "network": {"id": "9c306d1c-3407-47dd-a04f-e185b1d1788a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1404292047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbba73e7218148b492aca0b1c2673b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad97513-e2", "ovs_interfaceid": "0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:45:36 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Converting VIF {"id": "0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6", "address": "fa:16:3e:56:bd:70", "network": {"id": "9c306d1c-3407-47dd-a04f-e185b1d1788a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1404292047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbba73e7218148b492aca0b1c2673b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad97513-e2", "ovs_interfaceid": "0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:45:36 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:bd:70,bridge_name='br-int',has_traffic_filtering=True,id=0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6,network=Network(9c306d1c-3407-47dd-a04f-e185b1d1788a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad97513-e2') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:45:36 user nova-compute[74342]: DEBUG os_vif [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:bd:70,bridge_name='br-int',has_traffic_filtering=True,id=0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6,network=Network(9c306d1c-3407-47dd-a04f-e185b1d1788a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad97513-e2') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:45:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:45:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:45:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '529a9fa0-6e87-5cf6-8bad-0b8f736cf8ae', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:45:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:45:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0ad97513-e2, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:45:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0ad97513-e2, col_values=(('qos', UUID('e87d6e01-15a5-473f-8675-43f3659134e3')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:45:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0ad97513-e2, col_values=(('external_ids', {'iface-id': '0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:bd:70', 'vm-uuid': '017caffb-5be2-4e78-ab48-a8091c5c00f4'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:45:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:45:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:36 user nova-compute[74342]: INFO os_vif [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:bd:70,bridge_name='br-int',has_traffic_filtering=True,id=0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6,network=Network(9c306d1c-3407-47dd-a04f-e185b1d1788a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad97513-e2')
Oct 16 09:45:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:45:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] No VIF found with MAC fa:16:3e:56:bd:70, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:45:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:38 user nova-compute[74342]: DEBUG nova.compute.manager [req-402fee0c-f113-4da1-a492-fad3a3b7297f req-0b15c42e-c5e0-4594-9997-e2356389cb1c service nova] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Received event network-vif-plugged-0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:45:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-402fee0c-f113-4da1-a492-fad3a3b7297f req-0b15c42e-c5e0-4594-9997-e2356389cb1c service nova] Acquiring lock "017caffb-5be2-4e78-ab48-a8091c5c00f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:45:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-402fee0c-f113-4da1-a492-fad3a3b7297f req-0b15c42e-c5e0-4594-9997-e2356389cb1c service nova] Lock "017caffb-5be2-4e78-ab48-a8091c5c00f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:45:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-402fee0c-f113-4da1-a492-fad3a3b7297f req-0b15c42e-c5e0-4594-9997-e2356389cb1c service nova] Lock "017caffb-5be2-4e78-ab48-a8091c5c00f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:45:38 user nova-compute[74342]: DEBUG nova.compute.manager [req-402fee0c-f113-4da1-a492-fad3a3b7297f req-0b15c42e-c5e0-4594-9997-e2356389cb1c service nova] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] No waiting events found dispatching network-vif-plugged-0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:45:38 user nova-compute[74342]: WARNING nova.compute.manager [req-402fee0c-f113-4da1-a492-fad3a3b7297f req-0b15c42e-c5e0-4594-9997-e2356389cb1c service nova] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Received unexpected event network-vif-plugged-0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6 for instance with vm_state building and task_state spawning.
Oct 16 09:45:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:40 user nova-compute[74342]: DEBUG nova.compute.manager [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:45:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:45:40 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Instance spawned successfully.
Oct 16 09:45:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:45:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:45:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:45:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:45:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:45:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:45:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:45:40 user nova-compute[74342]: INFO nova.compute.manager [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Took 5.21 seconds to spawn the instance on the hypervisor.
Oct 16 09:45:40 user nova-compute[74342]: DEBUG nova.compute.manager [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:45:40 user nova-compute[74342]: INFO nova.compute.manager [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Took 24.45 seconds to build instance.
Oct 16 09:45:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cbb02975-1af7-45c3-ae47-dc93f565f3d8 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Lock "017caffb-5be2-4e78-ab48-a8091c5c00f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.568s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:45:40 user nova-compute[74342]: DEBUG nova.compute.manager [req-c03bf61e-4753-49f4-83d0-396ea4e107a1 req-bd53d000-3fc0-4009-ad59-56414a7f83cd service nova] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Received event network-vif-plugged-0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:45:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c03bf61e-4753-49f4-83d0-396ea4e107a1 req-bd53d000-3fc0-4009-ad59-56414a7f83cd service nova] Acquiring lock "017caffb-5be2-4e78-ab48-a8091c5c00f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:45:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c03bf61e-4753-49f4-83d0-396ea4e107a1 req-bd53d000-3fc0-4009-ad59-56414a7f83cd service nova] Lock "017caffb-5be2-4e78-ab48-a8091c5c00f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:45:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c03bf61e-4753-49f4-83d0-396ea4e107a1 req-bd53d000-3fc0-4009-ad59-56414a7f83cd service nova] Lock "017caffb-5be2-4e78-ab48-a8091c5c00f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:45:40 user nova-compute[74342]: DEBUG nova.compute.manager [req-c03bf61e-4753-49f4-83d0-396ea4e107a1 req-bd53d000-3fc0-4009-ad59-56414a7f83cd service nova] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] No waiting events found dispatching network-vif-plugged-0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:45:40 user nova-compute[74342]: WARNING nova.compute.manager [req-c03bf61e-4753-49f4-83d0-396ea4e107a1 req-bd53d000-3fc0-4009-ad59-56414a7f83cd service nova] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Received unexpected event network-vif-plugged-0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6 for instance with vm_state active and task_state None.
Oct 16 09:45:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:43 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:45:43 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:45:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:45:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:45:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:45:43 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 09:45:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:44 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:45:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719428d6-025b-4baa-97a2-c8ebdd49f57e/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719428d6-025b-4baa-97a2-c8ebdd49f57e/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719428d6-025b-4baa-97a2-c8ebdd49f57e/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:45 user nova-compute[74342]: DEBUG nova.compute.manager [None req-51dea501-e970-4793-9f1f-185590d7488a tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:45:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719428d6-025b-4baa-97a2-c8ebdd49f57e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:45 user nova-compute[74342]: INFO nova.compute.manager [None req-51dea501-e970-4793-9f1f-185590d7488a tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] instance snapshotting
Oct 16 09:45:45 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-51dea501-e970-4793-9f1f-185590d7488a tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Beginning live snapshot process
Oct 16 09:45:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-51dea501-e970-4793-9f1f-185590d7488a tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json -f qcow2 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-51dea501-e970-4793-9f1f-185590d7488a tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json -f qcow2" returned: 0 in 0.183s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-51dea501-e970-4793-9f1f-185590d7488a tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json -f qcow2 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-51dea501-e970-4793-9f1f-185590d7488a tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json -f qcow2" returned: 0 in 0.197s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-51dea501-e970-4793-9f1f-185590d7488a tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:46 user nova-compute[74342]: DEBUG nova.compute.manager [req-0ae4c61d-cb90-465c-8b05-f3952b3c924e req-708566ef-3b68-44ab-8f81-76408b589480 service nova] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Received event network-changed-75f58c77-45a5-4951-951c-4c0bb6ac8bf3 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:45:46 user nova-compute[74342]: DEBUG nova.compute.manager [req-0ae4c61d-cb90-465c-8b05-f3952b3c924e req-708566ef-3b68-44ab-8f81-76408b589480 service nova] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Refreshing instance network info cache due to event network-changed-75f58c77-45a5-4951-951c-4c0bb6ac8bf3. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:45:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0ae4c61d-cb90-465c-8b05-f3952b3c924e req-708566ef-3b68-44ab-8f81-76408b589480 service nova] Acquiring lock "refresh_cache-98367a96-22f0-4edb-ab03-a8eb286b437b" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:45:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0ae4c61d-cb90-465c-8b05-f3952b3c924e req-708566ef-3b68-44ab-8f81-76408b589480 service nova] Acquired lock "refresh_cache-98367a96-22f0-4edb-ab03-a8eb286b437b" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:45:46 user nova-compute[74342]: DEBUG nova.network.neutron [req-0ae4c61d-cb90-465c-8b05-f3952b3c924e req-708566ef-3b68-44ab-8f81-76408b589480 service nova] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Refreshing network info cache for port 75f58c77-45a5-4951-951c-4c0bb6ac8bf3 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:45:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-51dea501-e970-4793-9f1f-185590d7488a tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.265s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-51dea501-e970-4793-9f1f-185590d7488a tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp30w6c5f9/d05dee45b6634b27a2b1db3d403f8931.delta 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-51dea501-e970-4793-9f1f-185590d7488a tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp30w6c5f9/d05dee45b6634b27a2b1db3d403f8931.delta 1073741824" returned: 0 in 0.090s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:46 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-51dea501-e970-4793-9f1f-185590d7488a tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 16 09:45:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-51dea501-e970-4793-9f1f-185590d7488a tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Checking UEFI support for host arch (x86_64) {{(pid=74342) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Oct 16 09:45:46 user nova-compute[74342]: INFO nova.virt.libvirt.host [None req-51dea501-e970-4793-9f1f-185590d7488a tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] UEFI support detected
Oct 16 09:45:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ed0377-ff2b-4a15-9175-a70624aa913d/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ed0377-ff2b-4a15-9175-a70624aa913d/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ed0377-ff2b-4a15-9175-a70624aa913d/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:46 user nova-compute[74342]: DEBUG nova.network.neutron [req-0ae4c61d-cb90-465c-8b05-f3952b3c924e req-708566ef-3b68-44ab-8f81-76408b589480 service nova] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Updated VIF entry in instance network info cache for port 75f58c77-45a5-4951-951c-4c0bb6ac8bf3. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:45:46 user nova-compute[74342]: DEBUG nova.network.neutron [req-0ae4c61d-cb90-465c-8b05-f3952b3c924e req-708566ef-3b68-44ab-8f81-76408b589480 service nova] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Updating instance_info_cache with network_info: [{"id": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "address": "fa:16:3e:7a:58:71", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f58c77-45", "ovs_interfaceid": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:45:47 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0ae4c61d-cb90-465c-8b05-f3952b3c924e req-708566ef-3b68-44ab-8f81-76408b589480 service nova] Releasing lock "refresh_cache-98367a96-22f0-4edb-ab03-a8eb286b437b" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:45:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ed0377-ff2b-4a15-9175-a70624aa913d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:48 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-51dea501-e970-4793-9f1f-185590d7488a tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 09:45:48 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:45:48 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:45:48 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=7380MB free_disk=25.495426177978516GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 09:45:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:45:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:45:48 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-51dea501-e970-4793-9f1f-185590d7488a tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 16 09:45:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Acquiring lock "347c7f16-6bd0-4a51-b40a-1d9d705acc27" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:45:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Lock "347c7f16-6bd0-4a51-b40a-1d9d705acc27" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:45:48 user nova-compute[74342]: DEBUG nova.compute.manager [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:45:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:45:48 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance d45abd20-3a58-4657-8f4c-a426d8e39be3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:45:48 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 98367a96-22f0-4edb-ab03-a8eb286b437b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:45:48 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:45:48 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance bdcd2e60-b36c-4d87-94d7-076e7430e1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:45:48 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance d3ed0377-ff2b-4a15-9175-a70624aa913d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:45:48 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:45:48 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 719428d6-025b-4baa-97a2-c8ebdd49f57e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:45:48 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:45:48 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 017caffb-5be2-4e78-ab48-a8091c5c00f4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:45:48 user nova-compute[74342]: DEBUG nova.privsep.utils [None req-51dea501-e970-4793-9f1f-185590d7488a tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 09:45:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-51dea501-e970-4793-9f1f-185590d7488a tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp30w6c5f9/d05dee45b6634b27a2b1db3d403f8931.delta /opt/stack/data/nova/instances/snapshots/tmp30w6c5f9/d05dee45b6634b27a2b1db3d403f8931 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:48 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 347c7f16-6bd0-4a51-b40a-1d9d705acc27 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 16 09:45:48 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 09:45:48 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 09:45:48 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:45:48 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:45:49 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 09:45:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.052s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:45:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.897s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:45:49 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:45:49 user nova-compute[74342]: INFO nova.compute.claims [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Claim successful on node user
Oct 16 09:45:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-51dea501-e970-4793-9f1f-185590d7488a tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp30w6c5f9/d05dee45b6634b27a2b1db3d403f8931.delta /opt/stack/data/nova/instances/snapshots/tmp30w6c5f9/d05dee45b6634b27a2b1db3d403f8931" returned: 0 in 0.882s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:49 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-51dea501-e970-4793-9f1f-185590d7488a tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Snapshot extracted, beginning image upload
Oct 16 09:45:49 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:45:49 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:45:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:45:49 user nova-compute[74342]: DEBUG nova.compute.manager [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:45:49 user nova-compute[74342]: DEBUG nova.compute.manager [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:45:49 user nova-compute[74342]: DEBUG nova.network.neutron [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:45:49 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:45:49 user nova-compute[74342]: DEBUG nova.compute.manager [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:45:49 user nova-compute[74342]: INFO nova.virt.block_device [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Booting with volume f090ed4a-db48-4b4a-b057-b343afc8f498 at /dev/vda
Oct 16 09:45:49 user nova-compute[74342]: DEBUG nova.policy [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fab6c328617247fcb87f3470224ff649', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8b01b25d1cea4707925f30c00ae5b22c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:45:49 user nova-compute[74342]: DEBUG os_brick.utils [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:45:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:49 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[978fa505-1b46-4afa-8736-5346bedd439a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:45:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:49 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7ae659-f4c6-4e80-9f34-153c25ffc412]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:45:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:49 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07c0ddc-ef74-4614-9ce8-4da6e81d0f5f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:45:49 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5d7d2e-88d7-4ccc-8650-db54a1c87472]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:45:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:45:50 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:45:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:45:50 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:45:50 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c3a8c7-2c2f-4478-88c2-8e48aac62135]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:45:50 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:45:50 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:45:50 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:45:50 user nova-compute[74342]: DEBUG os_brick.utils [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:45:50 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Updating existing volume attachment record: 69943116-ca1b-4bf2-8f72-b2ba43b4ed60 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 09:45:50 user nova-compute[74342]: DEBUG nova.network.neutron [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Successfully created port: a0a154df-669a-4799-9ed9-ccb9f0790d74 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:45:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Acquiring lock "89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:45:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Lock "89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:45:50 user nova-compute[74342]: DEBUG nova.objects.instance [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Lazy-loading 'flavor' on Instance uuid 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:45:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Lock "89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.120s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Acquiring lock "89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Lock "89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:45:51 user nova-compute[74342]: INFO nova.compute.manager [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Attaching volume d6f56e0f-db06-4754-ac87-c15addca786d to /dev/vdb
Oct 16 09:45:51 user nova-compute[74342]: DEBUG nova.network.neutron [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Successfully created port: 0f1019bc-8ce5-4b55-972b-25f0d84b47b5 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG os_brick.utils [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e818e162-e388-4ad3-9b18-ea7c0fd40056]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3b75a08-195c-4d41-a616-517885007279]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4c7f24-43ae-4592-afd4-65038e46caab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b19b6e62-00af-4676-8603-9e9b0c86c7e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-98367a96-22f0-4edb-ab03-a8eb286b437b" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-98367a96-22f0-4edb-ab03-a8eb286b437b" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:45:51 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:45:51 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[550ae418-59e0-409b-9b38-ccf1e974e289]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG os_brick.utils [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] <== get_connector_properties: return (152ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Updating existing volume attachment record: 3a3b2816-6ad1-4c10-bf54-f564fc7429e1 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 09:45:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:52 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-51dea501-e970-4793-9f1f-185590d7488a tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Snapshot image upload complete
Oct 16 09:45:52 user nova-compute[74342]: INFO nova.compute.manager [None req-51dea501-e970-4793-9f1f-185590d7488a tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Took 6.86 seconds to snapshot the instance on the hypervisor.
Oct 16 09:45:52 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Updating instance_info_cache with network_info: [{"id": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "address": "fa:16:3e:7a:58:71", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f58c77-45", "ovs_interfaceid": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:45:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-98367a96-22f0-4edb-ab03-a8eb286b437b" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:45:52 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 09:45:52 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:45:52 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:45:52 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:45:52 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:45:52 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:45:52 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 09:45:52 user nova-compute[74342]: DEBUG nova.network.neutron [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Successfully created port: 13518a35-eebd-4937-a344-06940941505a {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:45:52 user nova-compute[74342]: DEBUG nova.compute.manager [req-e9bee6d9-325f-4ca5-ae41-9e42a63673e9 req-c1cd87b1-3bc3-45f9-9aaa-c82bfb3a9c5d service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Received event network-changed-6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:45:52 user nova-compute[74342]: DEBUG nova.compute.manager [req-e9bee6d9-325f-4ca5-ae41-9e42a63673e9 req-c1cd87b1-3bc3-45f9-9aaa-c82bfb3a9c5d service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Refreshing instance network info cache due to event network-changed-6880e1ef-5122-458c-a9b8-a8202cdee055. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:45:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e9bee6d9-325f-4ca5-ae41-9e42a63673e9 req-c1cd87b1-3bc3-45f9-9aaa-c82bfb3a9c5d service nova] Acquiring lock "refresh_cache-bdcd2e60-b36c-4d87-94d7-076e7430e1f0" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:45:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e9bee6d9-325f-4ca5-ae41-9e42a63673e9 req-c1cd87b1-3bc3-45f9-9aaa-c82bfb3a9c5d service nova] Acquired lock "refresh_cache-bdcd2e60-b36c-4d87-94d7-076e7430e1f0" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:45:52 user nova-compute[74342]: DEBUG nova.network.neutron [req-e9bee6d9-325f-4ca5-ae41-9e42a63673e9 req-c1cd87b1-3bc3-45f9-9aaa-c82bfb3a9c5d service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Refreshing network info cache for port 6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:45:52 user nova-compute[74342]: DEBUG nova.network.neutron [req-e9bee6d9-325f-4ca5-ae41-9e42a63673e9 req-c1cd87b1-3bc3-45f9-9aaa-c82bfb3a9c5d service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Updated VIF entry in instance network info cache for port 6880e1ef-5122-458c-a9b8-a8202cdee055. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:45:52 user nova-compute[74342]: DEBUG nova.network.neutron [req-e9bee6d9-325f-4ca5-ae41-9e42a63673e9 req-c1cd87b1-3bc3-45f9-9aaa-c82bfb3a9c5d service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Updating instance_info_cache with network_info: [{"id": "6880e1ef-5122-458c-a9b8-a8202cdee055", "address": "fa:16:3e:22:60:5b", "network": {"id": "b9e6ad97-cbbe-40e7-b487-5fc89166bc6a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-718322219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6679e55d6a194b399b6b2d27a8cbb147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6880e1ef-51", "ovs_interfaceid": "6880e1ef-5122-458c-a9b8-a8202cdee055", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:45:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e9bee6d9-325f-4ca5-ae41-9e42a63673e9 req-c1cd87b1-3bc3-45f9-9aaa-c82bfb3a9c5d service nova] Releasing lock "refresh_cache-bdcd2e60-b36c-4d87-94d7-076e7430e1f0" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:45:53 user nova-compute[74342]: DEBUG nova.network.neutron [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Successfully created port: 6ed92d36-33db-4d62-abe8-6ddc1961a364 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:45:53 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fec04da2-036f-4174-b2f6-04c515d0aa29 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:45:53 user nova-compute[74342]: INFO nova.compute.manager [None req-fec04da2-036f-4174-b2f6-04c515d0aa29 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] instance snapshotting
Oct 16 09:45:53 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-fec04da2-036f-4174-b2f6-04c515d0aa29 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Beginning live snapshot process
Oct 16 09:45:54 user nova-compute[74342]: DEBUG nova.network.neutron [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Successfully created port: 349cab86-e97a-496e-936b-53dbfbfc694e {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:45:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fec04da2-036f-4174-b2f6-04c515d0aa29 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json -f qcow2 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fec04da2-036f-4174-b2f6-04c515d0aa29 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json -f qcow2" returned: 0 in 0.169s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fec04da2-036f-4174-b2f6-04c515d0aa29 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json -f qcow2 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fec04da2-036f-4174-b2f6-04c515d0aa29 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json -f qcow2" returned: 0 in 0.192s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fec04da2-036f-4174-b2f6-04c515d0aa29 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fec04da2-036f-4174-b2f6-04c515d0aa29 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.201s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fec04da2-036f-4174-b2f6-04c515d0aa29 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7yhuxina/bc140c45dbf04207b4d28c1a1e5f7dcd.delta 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fec04da2-036f-4174-b2f6-04c515d0aa29 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp7yhuxina/bc140c45dbf04207b4d28c1a1e5f7dcd.delta 1073741824" returned: 0 in 0.060s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:54 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-fec04da2-036f-4174-b2f6-04c515d0aa29 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 16 09:45:54 user nova-compute[74342]: DEBUG nova.network.neutron [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Successfully updated port: a0a154df-669a-4799-9ed9-ccb9f0790d74 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:45:55 user nova-compute[74342]: DEBUG nova.compute.manager [req-af6549f7-0a16-417a-8554-d3ed4cd79390 req-899af824-2448-42b2-a7ef-3adc5850bc1b service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Received event network-changed-a0a154df-669a-4799-9ed9-ccb9f0790d74 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:45:55 user nova-compute[74342]: DEBUG nova.compute.manager [req-af6549f7-0a16-417a-8554-d3ed4cd79390 req-899af824-2448-42b2-a7ef-3adc5850bc1b service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Refreshing instance network info cache due to event network-changed-a0a154df-669a-4799-9ed9-ccb9f0790d74. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:45:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-af6549f7-0a16-417a-8554-d3ed4cd79390 req-899af824-2448-42b2-a7ef-3adc5850bc1b service nova] Acquiring lock "refresh_cache-347c7f16-6bd0-4a51-b40a-1d9d705acc27" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:45:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-af6549f7-0a16-417a-8554-d3ed4cd79390 req-899af824-2448-42b2-a7ef-3adc5850bc1b service nova] Acquired lock "refresh_cache-347c7f16-6bd0-4a51-b40a-1d9d705acc27" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:45:55 user nova-compute[74342]: DEBUG nova.network.neutron [req-af6549f7-0a16-417a-8554-d3ed4cd79390 req-899af824-2448-42b2-a7ef-3adc5850bc1b service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Refreshing network info cache for port a0a154df-669a-4799-9ed9-ccb9f0790d74 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:45:55 user nova-compute[74342]: DEBUG nova.network.neutron [req-af6549f7-0a16-417a-8554-d3ed4cd79390 req-899af824-2448-42b2-a7ef-3adc5850bc1b service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:45:55 user nova-compute[74342]: DEBUG nova.network.neutron [req-af6549f7-0a16-417a-8554-d3ed4cd79390 req-899af824-2448-42b2-a7ef-3adc5850bc1b service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:45:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-af6549f7-0a16-417a-8554-d3ed4cd79390 req-899af824-2448-42b2-a7ef-3adc5850bc1b service nova] Releasing lock "refresh_cache-347c7f16-6bd0-4a51-b40a-1d9d705acc27" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:45:55 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-fec04da2-036f-4174-b2f6-04c515d0aa29 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 09:45:55 user nova-compute[74342]: DEBUG nova.network.neutron [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Successfully updated port: 173fea01-20c0-43e0-9d3b-5435bceb4f12 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:45:56 user nova-compute[74342]: DEBUG nova.compute.manager [req-dbfafa23-7a01-49cb-961d-1b7ab9aff6b0 req-2ad03aea-5607-4049-b4e8-2773eae66214 service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Received event network-changed-173fea01-20c0-43e0-9d3b-5435bceb4f12 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:45:56 user nova-compute[74342]: DEBUG nova.compute.manager [req-dbfafa23-7a01-49cb-961d-1b7ab9aff6b0 req-2ad03aea-5607-4049-b4e8-2773eae66214 service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Refreshing instance network info cache due to event network-changed-173fea01-20c0-43e0-9d3b-5435bceb4f12. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:45:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-dbfafa23-7a01-49cb-961d-1b7ab9aff6b0 req-2ad03aea-5607-4049-b4e8-2773eae66214 service nova] Acquiring lock "refresh_cache-347c7f16-6bd0-4a51-b40a-1d9d705acc27" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:45:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-dbfafa23-7a01-49cb-961d-1b7ab9aff6b0 req-2ad03aea-5607-4049-b4e8-2773eae66214 service nova] Acquired lock "refresh_cache-347c7f16-6bd0-4a51-b40a-1d9d705acc27" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:45:56 user nova-compute[74342]: DEBUG nova.network.neutron [req-dbfafa23-7a01-49cb-961d-1b7ab9aff6b0 req-2ad03aea-5607-4049-b4e8-2773eae66214 service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Refreshing network info cache for port 173fea01-20c0-43e0-9d3b-5435bceb4f12 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:45:56 user nova-compute[74342]: DEBUG nova.network.neutron [req-dbfafa23-7a01-49cb-961d-1b7ab9aff6b0 req-2ad03aea-5607-4049-b4e8-2773eae66214 service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:45:56 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-fec04da2-036f-4174-b2f6-04c515d0aa29 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 09:45:56 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-fec04da2-036f-4174-b2f6-04c515d0aa29 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 16 09:45:56 user nova-compute[74342]: DEBUG nova.privsep.utils [None req-fec04da2-036f-4174-b2f6-04c515d0aa29 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 09:45:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fec04da2-036f-4174-b2f6-04c515d0aa29 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7yhuxina/bc140c45dbf04207b4d28c1a1e5f7dcd.delta /opt/stack/data/nova/instances/snapshots/tmp7yhuxina/bc140c45dbf04207b4d28c1a1e5f7dcd {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:56 user nova-compute[74342]: DEBUG nova.network.neutron [req-dbfafa23-7a01-49cb-961d-1b7ab9aff6b0 req-2ad03aea-5607-4049-b4e8-2773eae66214 service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:45:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-dbfafa23-7a01-49cb-961d-1b7ab9aff6b0 req-2ad03aea-5607-4049-b4e8-2773eae66214 service nova] Releasing lock "refresh_cache-347c7f16-6bd0-4a51-b40a-1d9d705acc27" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:45:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fec04da2-036f-4174-b2f6-04c515d0aa29 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp7yhuxina/bc140c45dbf04207b4d28c1a1e5f7dcd.delta /opt/stack/data/nova/instances/snapshots/tmp7yhuxina/bc140c45dbf04207b4d28c1a1e5f7dcd" returned: 0 in 0.409s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:56 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-fec04da2-036f-4174-b2f6-04c515d0aa29 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Snapshot extracted, beginning image upload
Oct 16 09:45:56 user nova-compute[74342]: DEBUG nova.network.neutron [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Successfully updated port: b723dc46-4fec-4be3-ba77-33792c72330b {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:45:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:45:57 user nova-compute[74342]: DEBUG nova.network.neutron [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Successfully updated port: 0f1019bc-8ce5-4b55-972b-25f0d84b47b5 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:45:58 user nova-compute[74342]: DEBUG nova.compute.manager [req-1248d570-4bc1-4eb3-9692-88d4e5950f9f req-a1a25f0a-de53-424c-a887-78be4a6c39ab service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Received event network-changed-b723dc46-4fec-4be3-ba77-33792c72330b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:45:58 user nova-compute[74342]: DEBUG nova.compute.manager [req-1248d570-4bc1-4eb3-9692-88d4e5950f9f req-a1a25f0a-de53-424c-a887-78be4a6c39ab service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Refreshing instance network info cache due to event network-changed-b723dc46-4fec-4be3-ba77-33792c72330b. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:45:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-1248d570-4bc1-4eb3-9692-88d4e5950f9f req-a1a25f0a-de53-424c-a887-78be4a6c39ab service nova] Acquiring lock "refresh_cache-347c7f16-6bd0-4a51-b40a-1d9d705acc27" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:45:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-1248d570-4bc1-4eb3-9692-88d4e5950f9f req-a1a25f0a-de53-424c-a887-78be4a6c39ab service nova] Acquired lock "refresh_cache-347c7f16-6bd0-4a51-b40a-1d9d705acc27" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:45:58 user nova-compute[74342]: DEBUG nova.network.neutron [req-1248d570-4bc1-4eb3-9692-88d4e5950f9f req-a1a25f0a-de53-424c-a887-78be4a6c39ab service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Refreshing network info cache for port b723dc46-4fec-4be3-ba77-33792c72330b {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:45:58 user nova-compute[74342]: DEBUG nova.network.neutron [req-1248d570-4bc1-4eb3-9692-88d4e5950f9f req-a1a25f0a-de53-424c-a887-78be4a6c39ab service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:45:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Acquiring lock "79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:45:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Lock "79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:45:58 user nova-compute[74342]: DEBUG nova.network.neutron [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Successfully updated port: 13518a35-eebd-4937-a344-06940941505a {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:45:58 user nova-compute[74342]: DEBUG nova.compute.manager [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:45:58 user nova-compute[74342]: DEBUG nova.network.neutron [req-1248d570-4bc1-4eb3-9692-88d4e5950f9f req-a1a25f0a-de53-424c-a887-78be4a6c39ab service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:45:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-1248d570-4bc1-4eb3-9692-88d4e5950f9f req-a1a25f0a-de53-424c-a887-78be4a6c39ab service nova] Releasing lock "refresh_cache-347c7f16-6bd0-4a51-b40a-1d9d705acc27" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:45:58 user nova-compute[74342]: DEBUG nova.compute.manager [req-1248d570-4bc1-4eb3-9692-88d4e5950f9f req-a1a25f0a-de53-424c-a887-78be4a6c39ab service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Received event network-changed-0f1019bc-8ce5-4b55-972b-25f0d84b47b5 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:45:58 user nova-compute[74342]: DEBUG nova.compute.manager [req-1248d570-4bc1-4eb3-9692-88d4e5950f9f req-a1a25f0a-de53-424c-a887-78be4a6c39ab service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Refreshing instance network info cache due to event network-changed-0f1019bc-8ce5-4b55-972b-25f0d84b47b5. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:45:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-1248d570-4bc1-4eb3-9692-88d4e5950f9f req-a1a25f0a-de53-424c-a887-78be4a6c39ab service nova] Acquiring lock "refresh_cache-347c7f16-6bd0-4a51-b40a-1d9d705acc27" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:45:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-1248d570-4bc1-4eb3-9692-88d4e5950f9f req-a1a25f0a-de53-424c-a887-78be4a6c39ab service nova] Acquired lock "refresh_cache-347c7f16-6bd0-4a51-b40a-1d9d705acc27" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:45:58 user nova-compute[74342]: DEBUG nova.network.neutron [req-1248d570-4bc1-4eb3-9692-88d4e5950f9f req-a1a25f0a-de53-424c-a887-78be4a6c39ab service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Refreshing network info cache for port 0f1019bc-8ce5-4b55-972b-25f0d84b47b5 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:45:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:45:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:45:58 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:45:58 user nova-compute[74342]: INFO nova.compute.claims [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Claim successful on node user
Oct 16 09:45:58 user nova-compute[74342]: DEBUG nova.network.neutron [req-1248d570-4bc1-4eb3-9692-88d4e5950f9f req-a1a25f0a-de53-424c-a887-78be4a6c39ab service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:45:58 user nova-compute[74342]: DEBUG nova.network.neutron [req-1248d570-4bc1-4eb3-9692-88d4e5950f9f req-a1a25f0a-de53-424c-a887-78be4a6c39ab service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:45:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-1248d570-4bc1-4eb3-9692-88d4e5950f9f req-a1a25f0a-de53-424c-a887-78be4a6c39ab service nova] Releasing lock "refresh_cache-347c7f16-6bd0-4a51-b40a-1d9d705acc27" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:45:58 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:45:58 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:45:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.585s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:45:58 user nova-compute[74342]: DEBUG nova.compute.manager [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:45:59 user nova-compute[74342]: DEBUG nova.network.neutron [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Successfully updated port: 6ed92d36-33db-4d62-abe8-6ddc1961a364 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:45:59 user nova-compute[74342]: DEBUG nova.compute.manager [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:45:59 user nova-compute[74342]: DEBUG nova.network.neutron [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:45:59 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:45:59 user nova-compute[74342]: DEBUG nova.compute.manager [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:45:59 user nova-compute[74342]: DEBUG nova.policy [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '77333a3273b5429fbabb5cb5f229f38f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23e0176e92bc48c3b79999f47fa4f6d1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:45:59 user nova-compute[74342]: INFO nova.virt.block_device [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Booting with volume 5b359a4f-7da7-4706-82e6-349e2d0c39c7 at /dev/vda
Oct 16 09:45:59 user nova-compute[74342]: DEBUG os_brick.utils [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:45:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:59 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c96d30-0fc9-469c-802f-3de9a3acd5d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:45:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:59 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[600f98ea-393b-4d66-bdce-87d86b29e619]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:45:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:45:59 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-fec04da2-036f-4174-b2f6-04c515d0aa29 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Snapshot image upload complete
Oct 16 09:45:59 user nova-compute[74342]: INFO nova.compute.manager [None req-fec04da2-036f-4174-b2f6-04c515d0aa29 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Took 6.09 seconds to snapshot the instance on the hypervisor.
Oct 16 09:45:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:45:59 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[aac8997e-3ea5-4a56-8ced-537234e8dc7f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7778974-8387-4270-b08b-4da3fddbadaf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:46:00 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:46:00 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[457d51a1-3709-4462-8b3e-ea914eb90081]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG os_brick.utils [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Updating existing volume attachment record: 43398980-cb72-4478-97ea-418f59ea3e1e {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG nova.network.neutron [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Successfully updated port: 349cab86-e97a-496e-936b-53dbfbfc694e {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG nova.compute.manager [req-ed712960-61eb-4685-bb5d-e6928f833c41 req-569873a8-d32d-44c1-ac27-457a2332ce61 service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Received event network-changed-13518a35-eebd-4937-a344-06940941505a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG nova.compute.manager [req-ed712960-61eb-4685-bb5d-e6928f833c41 req-569873a8-d32d-44c1-ac27-457a2332ce61 service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Refreshing instance network info cache due to event network-changed-13518a35-eebd-4937-a344-06940941505a. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ed712960-61eb-4685-bb5d-e6928f833c41 req-569873a8-d32d-44c1-ac27-457a2332ce61 service nova] Acquiring lock "refresh_cache-347c7f16-6bd0-4a51-b40a-1d9d705acc27" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ed712960-61eb-4685-bb5d-e6928f833c41 req-569873a8-d32d-44c1-ac27-457a2332ce61 service nova] Acquired lock "refresh_cache-347c7f16-6bd0-4a51-b40a-1d9d705acc27" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG nova.network.neutron [req-ed712960-61eb-4685-bb5d-e6928f833c41 req-569873a8-d32d-44c1-ac27-457a2332ce61 service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Refreshing network info cache for port 13518a35-eebd-4937-a344-06940941505a {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Acquiring lock "refresh_cache-347c7f16-6bd0-4a51-b40a-1d9d705acc27" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG nova.network.neutron [req-ed712960-61eb-4685-bb5d-e6928f833c41 req-569873a8-d32d-44c1-ac27-457a2332ce61 service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG nova.network.neutron [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Successfully created port: dbc8fb36-eabb-4e35-be2c-b7927cd8dd93 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG nova.network.neutron [req-ed712960-61eb-4685-bb5d-e6928f833c41 req-569873a8-d32d-44c1-ac27-457a2332ce61 service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ed712960-61eb-4685-bb5d-e6928f833c41 req-569873a8-d32d-44c1-ac27-457a2332ce61 service nova] Releasing lock "refresh_cache-347c7f16-6bd0-4a51-b40a-1d9d705acc27" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG nova.compute.manager [req-ed712960-61eb-4685-bb5d-e6928f833c41 req-569873a8-d32d-44c1-ac27-457a2332ce61 service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Received event network-changed-6ed92d36-33db-4d62-abe8-6ddc1961a364 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG nova.compute.manager [req-ed712960-61eb-4685-bb5d-e6928f833c41 req-569873a8-d32d-44c1-ac27-457a2332ce61 service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Refreshing instance network info cache due to event network-changed-6ed92d36-33db-4d62-abe8-6ddc1961a364. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ed712960-61eb-4685-bb5d-e6928f833c41 req-569873a8-d32d-44c1-ac27-457a2332ce61 service nova] Acquiring lock "refresh_cache-347c7f16-6bd0-4a51-b40a-1d9d705acc27" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ed712960-61eb-4685-bb5d-e6928f833c41 req-569873a8-d32d-44c1-ac27-457a2332ce61 service nova] Acquired lock "refresh_cache-347c7f16-6bd0-4a51-b40a-1d9d705acc27" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG nova.network.neutron [req-ed712960-61eb-4685-bb5d-e6928f833c41 req-569873a8-d32d-44c1-ac27-457a2332ce61 service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Refreshing network info cache for port 6ed92d36-33db-4d62-abe8-6ddc1961a364 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG nova.network.neutron [req-ed712960-61eb-4685-bb5d-e6928f833c41 req-569873a8-d32d-44c1-ac27-457a2332ce61 service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG nova.network.neutron [req-ed712960-61eb-4685-bb5d-e6928f833c41 req-569873a8-d32d-44c1-ac27-457a2332ce61 service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ed712960-61eb-4685-bb5d-e6928f833c41 req-569873a8-d32d-44c1-ac27-457a2332ce61 service nova] Releasing lock "refresh_cache-347c7f16-6bd0-4a51-b40a-1d9d705acc27" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Acquired lock "refresh_cache-347c7f16-6bd0-4a51-b40a-1d9d705acc27" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG nova.network.neutron [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG nova.network.neutron [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:46:00 user nova-compute[74342]: DEBUG nova.network.neutron [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Successfully created port: e4e58571-669a-4120-be1e-285ce59f6540 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:46:01 user nova-compute[74342]: DEBUG nova.network.neutron [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Successfully created port: 2e2ece9b-5e92-4a2e-b1b7-0866bed03bbe {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:46:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-2670ae00-8053-481f-a7db-d4edd84cdfb5 req-6cfc1072-8146-4fb4-9ad2-25565411ddc8 service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Received event network-changed-349cab86-e97a-496e-936b-53dbfbfc694e {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:46:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-2670ae00-8053-481f-a7db-d4edd84cdfb5 req-6cfc1072-8146-4fb4-9ad2-25565411ddc8 service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Refreshing instance network info cache due to event network-changed-349cab86-e97a-496e-936b-53dbfbfc694e. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:46:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-2670ae00-8053-481f-a7db-d4edd84cdfb5 req-6cfc1072-8146-4fb4-9ad2-25565411ddc8 service nova] Acquiring lock "refresh_cache-347c7f16-6bd0-4a51-b40a-1d9d705acc27" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:46:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:02 user nova-compute[74342]: DEBUG nova.network.neutron [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Successfully created port: 16e436d9-950f-421e-b85a-bd0ad1a67465 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:46:03 user nova-compute[74342]: DEBUG nova.network.neutron [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Updating instance_info_cache with network_info: [{"id": "a0a154df-669a-4799-9ed9-ccb9f0790d74", "address": "fa:16:3e:45:5d:be", "network": {"id": "2dfb7a78-ecff-4578-8d70-1ba2afeae38a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1942641106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a154df-66", "ovs_interfaceid": "a0a154df-669a-4799-9ed9-ccb9f0790d74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "173fea01-20c0-43e0-9d3b-5435bceb4f12", "address": "fa:16:3e:7a:a3:e1", "network": {"id": "578174b2-6a57-4658-b908-8da7864bf01b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1858898971", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap173fea01-20", "ovs_interfaceid": "173fea01-20c0-43e0-9d3b-5435bceb4f12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b723dc46-4fec-4be3-ba77-33792c72330b", "address": "fa:16:3e:5d:22:04", "network": {"id": "578174b2-6a57-4658-b908-8da7864bf01b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1858898971", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb723dc46-4f", "ovs_interfaceid": "b723dc46-4fec-4be3-ba77-33792c72330b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f1019bc-8ce5-4b55-972b-25f0d84b47b5", "address": "fa:16:3e:9a:59:ea", "network": {"id": "578174b2-6a57-4658-b908-8da7864bf01b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1858898971", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1019bc-8c", "ovs_interfaceid": "0f1019bc-8ce5-4b55-972b-25f0d84b47b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13518a35-eebd-4937-a344-06940941505a", "address": "fa:16:3e:89:52:f3", "network": {"id": "578174b2-6a57-4658-b908-8da7864bf01b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1858898971", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13518a35-ee", "ovs_interfaceid": "13518a35-eebd-4937-a344-06940941505a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ed92d36-33db-4d62-abe8-6ddc1961a364", "address": "fa:16:3e:f2:10:1e", "network": {"id": "f17d2296-784e-415b-9d03-fda53086e730", "bridge": "br-int", "label": "tempest-device-tagging-net2-1505077802", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed92d36-33", "ovs_interfaceid": "6ed92d36-33db-4d62-abe8-6ddc1961a364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "349cab86-e97a-496e-936b-53dbfbfc694e", "address": "fa:16:3e:a5:7a:06", "network": {"id": "f17d2296-784e-415b-9d03-fda53086e730", "bridge": "br-int", "label": "tempest-device-tagging-net2-1505077802", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap349cab86-e9", "ovs_interfaceid": "349cab86-e97a-496e-936b-53dbfbfc694e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:46:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Releasing lock "refresh_cache-347c7f16-6bd0-4a51-b40a-1d9d705acc27" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:46:03 user nova-compute[74342]: DEBUG nova.compute.manager [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Instance network_info: |[{"id": "a0a154df-669a-4799-9ed9-ccb9f0790d74", "address": "fa:16:3e:45:5d:be", "network": {"id": "2dfb7a78-ecff-4578-8d70-1ba2afeae38a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1942641106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a154df-66", "ovs_interfaceid": "a0a154df-669a-4799-9ed9-ccb9f0790d74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "173fea01-20c0-43e0-9d3b-5435bceb4f12", "address": "fa:16:3e:7a:a3:e1", "network": {"id": "578174b2-6a57-4658-b908-8da7864bf01b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1858898971", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap173fea01-20", "ovs_interfaceid": "173fea01-20c0-43e0-9d3b-5435bceb4f12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b723dc46-4fec-4be3-ba77-33792c72330b", "address": "fa:16:3e:5d:22:04", "network": {"id": "578174b2-6a57-4658-b908-8da7864bf01b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1858898971", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb723dc46-4f", "ovs_interfaceid": "b723dc46-4fec-4be3-ba77-33792c72330b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f1019bc-8ce5-4b55-972b-25f0d84b47b5", "address": "fa:16:3e:9a:59:ea", "network": {"id": "578174b2-6a57-4658-b908-8da7864bf01b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1858898971", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1019bc-8c", "ovs_interfaceid": "0f1019bc-8ce5-4b55-972b-25f0d84b47b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13518a35-eebd-4937-a344-06940941505a", "address": "fa:16:3e:89:52:f3", "network": {"id": "578174b2-6a57-4658-b908-8da7864bf01b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1858898971", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13518a35-ee", "ovs_interfaceid": "13518a35-eebd-4937-a344-06940941505a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ed92d36-33db-4d62-abe8-6ddc1961a364", "address": "fa:16:3e:f2:10:1e", "network": {"id": "f17d2296-784e-415b-9d03-fda53086e730", "bridge": "br-int", "label": "tempest-device-tagging-net2-1505077802", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed92d36-33", "ovs_interfaceid": "6ed92d36-33db-4d62-abe8-6ddc1961a364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "349cab86-e97a-496e-936b-53dbfbfc694e", "address": "fa:16:3e:a5:7a:06", "network": {"id": "f17d2296-784e-415b-9d03-fda53086e730", "bridge": "br-int", "label": "tempest-device-tagging-net2-1505077802", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap349cab86-e9", "ovs_interfaceid": "349cab86-e97a-496e-936b-53dbfbfc694e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:46:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-2670ae00-8053-481f-a7db-d4edd84cdfb5 req-6cfc1072-8146-4fb4-9ad2-25565411ddc8 service nova] Acquired lock "refresh_cache-347c7f16-6bd0-4a51-b40a-1d9d705acc27" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:46:03 user nova-compute[74342]: DEBUG nova.network.neutron [req-2670ae00-8053-481f-a7db-d4edd84cdfb5 req-6cfc1072-8146-4fb4-9ad2-25565411ddc8 service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Refreshing network info cache for port 349cab86-e97a-496e-936b-53dbfbfc694e {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:46:03 user nova-compute[74342]: DEBUG nova.network.neutron [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Successfully created port: 448d515a-af97-4efe-ab4c-9f2105e8901d {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:46:03 user nova-compute[74342]: DEBUG nova.network.neutron [req-2670ae00-8053-481f-a7db-d4edd84cdfb5 req-6cfc1072-8146-4fb4-9ad2-25565411ddc8 service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Updated VIF entry in instance network info cache for port 349cab86-e97a-496e-936b-53dbfbfc694e. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:46:03 user nova-compute[74342]: DEBUG nova.network.neutron [req-2670ae00-8053-481f-a7db-d4edd84cdfb5 req-6cfc1072-8146-4fb4-9ad2-25565411ddc8 service nova] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Updating instance_info_cache with network_info: [{"id": "a0a154df-669a-4799-9ed9-ccb9f0790d74", "address": "fa:16:3e:45:5d:be", "network": {"id": "2dfb7a78-ecff-4578-8d70-1ba2afeae38a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1942641106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a154df-66", "ovs_interfaceid": "a0a154df-669a-4799-9ed9-ccb9f0790d74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "173fea01-20c0-43e0-9d3b-5435bceb4f12", "address": "fa:16:3e:7a:a3:e1", "network": {"id": "578174b2-6a57-4658-b908-8da7864bf01b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1858898971", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap173fea01-20", "ovs_interfaceid": "173fea01-20c0-43e0-9d3b-5435bceb4f12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b723dc46-4fec-4be3-ba77-33792c72330b", "address": "fa:16:3e:5d:22:04", "network": {"id": "578174b2-6a57-4658-b908-8da7864bf01b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1858898971", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb723dc46-4f", "ovs_interfaceid": "b723dc46-4fec-4be3-ba77-33792c72330b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "0f1019bc-8ce5-4b55-972b-25f0d84b47b5", "address": "fa:16:3e:9a:59:ea", "network": {"id": "578174b2-6a57-4658-b908-8da7864bf01b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1858898971", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1019bc-8c", "ovs_interfaceid": "0f1019bc-8ce5-4b55-972b-25f0d84b47b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "13518a35-eebd-4937-a344-06940941505a", "address": "fa:16:3e:89:52:f3", "network": {"id": "578174b2-6a57-4658-b908-8da7864bf01b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1858898971", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13518a35-ee", "ovs_interfaceid": "13518a35-eebd-4937-a344-06940941505a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "6ed92d36-33db-4d62-abe8-6ddc1961a364", "address": "fa:16:3e:f2:10:1e", "network": {"id": "f17d2296-784e-415b-9d03-fda53086e730", "bridge": "br-int", "label": "tempest-device-tagging-net2-1505077802", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed92d36-33", "ovs_interfaceid": "6ed92d36-33db-4d62-abe8-6ddc1961a364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "349cab86-e97a-496e-936b-53dbfbfc694e", "address": "fa:16:3e:a5:7a:06", "network": {"id": "f17d2296-784e-415b-9d03-fda53086e730", "bridge": "br-int", "label": "tempest-device-tagging-net2-1505077802", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap349cab86-e9", "ovs_interfaceid": "349cab86-e97a-496e-936b-53dbfbfc694e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:46:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-2670ae00-8053-481f-a7db-d4edd84cdfb5 req-6cfc1072-8146-4fb4-9ad2-25565411ddc8 service nova] Releasing lock "refresh_cache-347c7f16-6bd0-4a51-b40a-1d9d705acc27" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:46:03 user nova-compute[74342]: DEBUG nova.network.neutron [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Successfully updated port: dbc8fb36-eabb-4e35-be2c-b7927cd8dd93 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:46:04 user nova-compute[74342]: DEBUG nova.compute.manager [req-62bb0fba-99d3-4832-84a1-3734e8174e28 req-5e961961-0038-4321-93a9-1ea11555ad6e service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Received event network-changed-dbc8fb36-eabb-4e35-be2c-b7927cd8dd93 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:46:04 user nova-compute[74342]: DEBUG nova.compute.manager [req-62bb0fba-99d3-4832-84a1-3734e8174e28 req-5e961961-0038-4321-93a9-1ea11555ad6e service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Refreshing instance network info cache due to event network-changed-dbc8fb36-eabb-4e35-be2c-b7927cd8dd93. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:46:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-62bb0fba-99d3-4832-84a1-3734e8174e28 req-5e961961-0038-4321-93a9-1ea11555ad6e service nova] Acquiring lock "refresh_cache-79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:46:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-62bb0fba-99d3-4832-84a1-3734e8174e28 req-5e961961-0038-4321-93a9-1ea11555ad6e service nova] Acquired lock "refresh_cache-79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:46:04 user nova-compute[74342]: DEBUG nova.network.neutron [req-62bb0fba-99d3-4832-84a1-3734e8174e28 req-5e961961-0038-4321-93a9-1ea11555ad6e service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Refreshing network info cache for port dbc8fb36-eabb-4e35-be2c-b7927cd8dd93 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:46:04 user nova-compute[74342]: DEBUG nova.network.neutron [req-62bb0fba-99d3-4832-84a1-3734e8174e28 req-5e961961-0038-4321-93a9-1ea11555ad6e service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:46:04 user nova-compute[74342]: DEBUG nova.compute.manager [req-4e6e0961-02f9-4264-9844-b1fb58cf298d req-693a8ebf-d601-4518-bd23-4f9d94867ecf service nova] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Received event network-changed-c7e71629-bc93-41ff-bd86-e1f6be6aec6b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:46:04 user nova-compute[74342]: DEBUG nova.compute.manager [req-4e6e0961-02f9-4264-9844-b1fb58cf298d req-693a8ebf-d601-4518-bd23-4f9d94867ecf service nova] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Refreshing instance network info cache due to event network-changed-c7e71629-bc93-41ff-bd86-e1f6be6aec6b. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:46:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4e6e0961-02f9-4264-9844-b1fb58cf298d req-693a8ebf-d601-4518-bd23-4f9d94867ecf service nova] Acquiring lock "refresh_cache-d3ed0377-ff2b-4a15-9175-a70624aa913d" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:46:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4e6e0961-02f9-4264-9844-b1fb58cf298d req-693a8ebf-d601-4518-bd23-4f9d94867ecf service nova] Acquired lock "refresh_cache-d3ed0377-ff2b-4a15-9175-a70624aa913d" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:46:04 user nova-compute[74342]: DEBUG nova.network.neutron [req-4e6e0961-02f9-4264-9844-b1fb58cf298d req-693a8ebf-d601-4518-bd23-4f9d94867ecf service nova] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Refreshing network info cache for port c7e71629-bc93-41ff-bd86-e1f6be6aec6b {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:46:04 user nova-compute[74342]: DEBUG nova.network.neutron [req-62bb0fba-99d3-4832-84a1-3734e8174e28 req-5e961961-0038-4321-93a9-1ea11555ad6e service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:46:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-62bb0fba-99d3-4832-84a1-3734e8174e28 req-5e961961-0038-4321-93a9-1ea11555ad6e service nova] Releasing lock "refresh_cache-79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:46:04 user nova-compute[74342]: DEBUG nova.network.neutron [req-4e6e0961-02f9-4264-9844-b1fb58cf298d req-693a8ebf-d601-4518-bd23-4f9d94867ecf service nova] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Updated VIF entry in instance network info cache for port c7e71629-bc93-41ff-bd86-e1f6be6aec6b. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:46:04 user nova-compute[74342]: DEBUG nova.network.neutron [req-4e6e0961-02f9-4264-9844-b1fb58cf298d req-693a8ebf-d601-4518-bd23-4f9d94867ecf service nova] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Updating instance_info_cache with network_info: [{"id": "c7e71629-bc93-41ff-bd86-e1f6be6aec6b", "address": "fa:16:3e:c2:4d:5a", "network": {"id": "cf087024-9089-47c1-b7ce-dbc5b1d3232c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1070425141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698c3910471646ee8bb8632484e3787b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e71629-bc", "ovs_interfaceid": "c7e71629-bc93-41ff-bd86-e1f6be6aec6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:46:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4e6e0961-02f9-4264-9844-b1fb58cf298d req-693a8ebf-d601-4518-bd23-4f9d94867ecf service nova] Releasing lock "refresh_cache-d3ed0377-ff2b-4a15-9175-a70624aa913d" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:46:04 user nova-compute[74342]: DEBUG nova.network.neutron [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Successfully updated port: 08227f9b-6a0a-417b-87f9-a55db2a0db4c {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:46:05 user nova-compute[74342]: DEBUG nova.network.neutron [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Successfully updated port: ee333c40-496c-4672-8740-b5798c67f89f {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:46:06 user nova-compute[74342]: DEBUG nova.compute.manager [req-472c6665-562b-4032-be04-fbfa7c1210b2 req-2fd54114-1b5b-4a8b-bf44-20383fa076ef service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Received event network-changed-08227f9b-6a0a-417b-87f9-a55db2a0db4c {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:46:06 user nova-compute[74342]: DEBUG nova.compute.manager [req-472c6665-562b-4032-be04-fbfa7c1210b2 req-2fd54114-1b5b-4a8b-bf44-20383fa076ef service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Refreshing instance network info cache due to event network-changed-08227f9b-6a0a-417b-87f9-a55db2a0db4c. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:46:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-472c6665-562b-4032-be04-fbfa7c1210b2 req-2fd54114-1b5b-4a8b-bf44-20383fa076ef service nova] Acquiring lock "refresh_cache-79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:46:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-472c6665-562b-4032-be04-fbfa7c1210b2 req-2fd54114-1b5b-4a8b-bf44-20383fa076ef service nova] Acquired lock "refresh_cache-79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:46:06 user nova-compute[74342]: DEBUG nova.network.neutron [req-472c6665-562b-4032-be04-fbfa7c1210b2 req-2fd54114-1b5b-4a8b-bf44-20383fa076ef service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Refreshing network info cache for port 08227f9b-6a0a-417b-87f9-a55db2a0db4c {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:46:06 user nova-compute[74342]: DEBUG nova.network.neutron [req-472c6665-562b-4032-be04-fbfa7c1210b2 req-2fd54114-1b5b-4a8b-bf44-20383fa076ef service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:46:06 user nova-compute[74342]: DEBUG nova.network.neutron [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Successfully updated port: e4e58571-669a-4120-be1e-285ce59f6540 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:46:06 user nova-compute[74342]: DEBUG nova.network.neutron [req-472c6665-562b-4032-be04-fbfa7c1210b2 req-2fd54114-1b5b-4a8b-bf44-20383fa076ef service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:46:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-472c6665-562b-4032-be04-fbfa7c1210b2 req-2fd54114-1b5b-4a8b-bf44-20383fa076ef service nova] Releasing lock "refresh_cache-79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:46:06 user nova-compute[74342]: DEBUG nova.compute.manager [req-472c6665-562b-4032-be04-fbfa7c1210b2 req-2fd54114-1b5b-4a8b-bf44-20383fa076ef service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Received event network-changed-ee333c40-496c-4672-8740-b5798c67f89f {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:46:06 user nova-compute[74342]: DEBUG nova.compute.manager [req-472c6665-562b-4032-be04-fbfa7c1210b2 req-2fd54114-1b5b-4a8b-bf44-20383fa076ef service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Refreshing instance network info cache due to event network-changed-ee333c40-496c-4672-8740-b5798c67f89f. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:46:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-472c6665-562b-4032-be04-fbfa7c1210b2 req-2fd54114-1b5b-4a8b-bf44-20383fa076ef service nova] Acquiring lock "refresh_cache-79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:46:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-472c6665-562b-4032-be04-fbfa7c1210b2 req-2fd54114-1b5b-4a8b-bf44-20383fa076ef service nova] Acquired lock "refresh_cache-79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:46:06 user nova-compute[74342]: DEBUG nova.network.neutron [req-472c6665-562b-4032-be04-fbfa7c1210b2 req-2fd54114-1b5b-4a8b-bf44-20383fa076ef service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Refreshing network info cache for port ee333c40-496c-4672-8740-b5798c67f89f {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:46:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:06 user nova-compute[74342]: DEBUG nova.network.neutron [req-472c6665-562b-4032-be04-fbfa7c1210b2 req-2fd54114-1b5b-4a8b-bf44-20383fa076ef service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:46:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:07 user nova-compute[74342]: DEBUG nova.network.neutron [req-472c6665-562b-4032-be04-fbfa7c1210b2 req-2fd54114-1b5b-4a8b-bf44-20383fa076ef service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:46:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-472c6665-562b-4032-be04-fbfa7c1210b2 req-2fd54114-1b5b-4a8b-bf44-20383fa076ef service nova] Releasing lock "refresh_cache-79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:46:07 user nova-compute[74342]: DEBUG nova.network.neutron [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Successfully updated port: 2e2ece9b-5e92-4a2e-b1b7-0866bed03bbe {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:46:08 user nova-compute[74342]: DEBUG nova.compute.manager [req-f5b96100-8f4e-4d0f-bfc6-b481c618aa6f req-a8120965-7461-463f-8284-64a8d420302a service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Received event network-changed-e4e58571-669a-4120-be1e-285ce59f6540 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:46:08 user nova-compute[74342]: DEBUG nova.compute.manager [req-f5b96100-8f4e-4d0f-bfc6-b481c618aa6f req-a8120965-7461-463f-8284-64a8d420302a service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Refreshing instance network info cache due to event network-changed-e4e58571-669a-4120-be1e-285ce59f6540. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:46:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f5b96100-8f4e-4d0f-bfc6-b481c618aa6f req-a8120965-7461-463f-8284-64a8d420302a service nova] Acquiring lock "refresh_cache-79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:46:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f5b96100-8f4e-4d0f-bfc6-b481c618aa6f req-a8120965-7461-463f-8284-64a8d420302a service nova] Acquired lock "refresh_cache-79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:46:08 user nova-compute[74342]: DEBUG nova.network.neutron [req-f5b96100-8f4e-4d0f-bfc6-b481c618aa6f req-a8120965-7461-463f-8284-64a8d420302a service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Refreshing network info cache for port e4e58571-669a-4120-be1e-285ce59f6540 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:46:08 user nova-compute[74342]: DEBUG nova.network.neutron [req-f5b96100-8f4e-4d0f-bfc6-b481c618aa6f req-a8120965-7461-463f-8284-64a8d420302a service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:46:08 user nova-compute[74342]: DEBUG nova.network.neutron [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Successfully updated port: 16e436d9-950f-421e-b85a-bd0ad1a67465 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:46:08 user nova-compute[74342]: DEBUG nova.network.neutron [req-f5b96100-8f4e-4d0f-bfc6-b481c618aa6f req-a8120965-7461-463f-8284-64a8d420302a service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:46:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f5b96100-8f4e-4d0f-bfc6-b481c618aa6f req-a8120965-7461-463f-8284-64a8d420302a service nova] Releasing lock "refresh_cache-79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:46:08 user nova-compute[74342]: DEBUG nova.compute.manager [req-f5b96100-8f4e-4d0f-bfc6-b481c618aa6f req-a8120965-7461-463f-8284-64a8d420302a service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Received event network-changed-2e2ece9b-5e92-4a2e-b1b7-0866bed03bbe {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:46:08 user nova-compute[74342]: DEBUG nova.compute.manager [req-f5b96100-8f4e-4d0f-bfc6-b481c618aa6f req-a8120965-7461-463f-8284-64a8d420302a service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Refreshing instance network info cache due to event network-changed-2e2ece9b-5e92-4a2e-b1b7-0866bed03bbe. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:46:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f5b96100-8f4e-4d0f-bfc6-b481c618aa6f req-a8120965-7461-463f-8284-64a8d420302a service nova] Acquiring lock "refresh_cache-79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:46:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f5b96100-8f4e-4d0f-bfc6-b481c618aa6f req-a8120965-7461-463f-8284-64a8d420302a service nova] Acquired lock "refresh_cache-79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:46:08 user nova-compute[74342]: DEBUG nova.network.neutron [req-f5b96100-8f4e-4d0f-bfc6-b481c618aa6f req-a8120965-7461-463f-8284-64a8d420302a service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Refreshing network info cache for port 2e2ece9b-5e92-4a2e-b1b7-0866bed03bbe {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:46:08 user nova-compute[74342]: DEBUG nova.network.neutron [req-f5b96100-8f4e-4d0f-bfc6-b481c618aa6f req-a8120965-7461-463f-8284-64a8d420302a service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:46:08 user nova-compute[74342]: DEBUG nova.network.neutron [req-f5b96100-8f4e-4d0f-bfc6-b481c618aa6f req-a8120965-7461-463f-8284-64a8d420302a service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:46:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f5b96100-8f4e-4d0f-bfc6-b481c618aa6f req-a8120965-7461-463f-8284-64a8d420302a service nova] Releasing lock "refresh_cache-79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:46:09 user nova-compute[74342]: DEBUG nova.network.neutron [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Successfully updated port: 448d515a-af97-4efe-ab4c-9f2105e8901d {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:46:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Acquiring lock "refresh_cache-79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:46:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Acquired lock "refresh_cache-79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:46:09 user nova-compute[74342]: DEBUG nova.network.neutron [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:46:09 user nova-compute[74342]: DEBUG nova.network.neutron [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:46:10 user nova-compute[74342]: DEBUG nova.compute.manager [req-0b7ec452-a6f4-4aa9-b85c-f45b1d27e18d req-6cfda017-3c53-4fa6-98f7-e51bfbd3fcbb service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Received event network-changed-16e436d9-950f-421e-b85a-bd0ad1a67465 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:46:10 user nova-compute[74342]: DEBUG nova.compute.manager [req-0b7ec452-a6f4-4aa9-b85c-f45b1d27e18d req-6cfda017-3c53-4fa6-98f7-e51bfbd3fcbb service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Refreshing instance network info cache due to event network-changed-16e436d9-950f-421e-b85a-bd0ad1a67465. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:46:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0b7ec452-a6f4-4aa9-b85c-f45b1d27e18d req-6cfda017-3c53-4fa6-98f7-e51bfbd3fcbb service nova] Acquiring lock "refresh_cache-79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:46:10 user nova-compute[74342]: DEBUG nova.network.neutron [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Updating instance_info_cache with network_info: [{"id": "dbc8fb36-eabb-4e35-be2c-b7927cd8dd93", "address": "fa:16:3e:39:55:94", "network": {"id": "800822d5-14d4-47bb-9cfa-d8ad634b374b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2023130200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc8fb36-ea", "ovs_interfaceid": "dbc8fb36-eabb-4e35-be2c-b7927cd8dd93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08227f9b-6a0a-417b-87f9-a55db2a0db4c", "address": "fa:16:3e:57:b3:3e", "network": {"id": "593778f5-87b9-4daf-86b2-fb84bdcfe3aa", "bridge": "br-int", "label": "tempest-device-tagging-net1-491590125", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08227f9b-6a", "ovs_interfaceid": "08227f9b-6a0a-417b-87f9-a55db2a0db4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ee333c40-496c-4672-8740-b5798c67f89f", "address": "fa:16:3e:25:30:b3", "network": {"id": "593778f5-87b9-4daf-86b2-fb84bdcfe3aa", "bridge": "br-int", "label": "tempest-device-tagging-net1-491590125", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee333c40-49", "ovs_interfaceid": "ee333c40-496c-4672-8740-b5798c67f89f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e4e58571-669a-4120-be1e-285ce59f6540", "address": "fa:16:3e:7a:54:11", "network": {"id": "593778f5-87b9-4daf-86b2-fb84bdcfe3aa", "bridge": "br-int", "label": "tempest-device-tagging-net1-491590125", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e58571-66", "ovs_interfaceid": "e4e58571-669a-4120-be1e-285ce59f6540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e2ece9b-5e92-4a2e-b1b7-0866bed03bbe", "address": "fa:16:3e:65:99:f7", "network": {"id": "593778f5-87b9-4daf-86b2-fb84bdcfe3aa", "bridge": "br-int", "label": "tempest-device-tagging-net1-491590125", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2ece9b-5e", "ovs_interfaceid": "2e2ece9b-5e92-4a2e-b1b7-0866bed03bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16e436d9-950f-421e-b85a-bd0ad1a67465", "address": "fa:16:3e:9b:2d:2b", "network": {"id": "b1cf0cb2-de9d-433d-8129-9c94f785303a", "bridge": "br-int", "label": "tempest-device-tagging-net2-908365697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e436d9-95", "ovs_interfaceid": "16e436d9-950f-421e-b85a-bd0ad1a67465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "448d515a-af97-4efe-ab4c-9f2105e8901d", "address": "fa:16:3e:46:d1:73", "network": {"id": "b1cf0cb2-de9d-433d-8129-9c94f785303a", "bridge": "br-int", "label": "tempest-device-tagging-net2-908365697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap448d515a-af", "ovs_interfaceid": "448d515a-af97-4efe-ab4c-9f2105e8901d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:46:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Releasing lock "refresh_cache-79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:46:10 user nova-compute[74342]: DEBUG nova.compute.manager [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Instance network_info: |[{"id": "dbc8fb36-eabb-4e35-be2c-b7927cd8dd93", "address": "fa:16:3e:39:55:94", "network": {"id": "800822d5-14d4-47bb-9cfa-d8ad634b374b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2023130200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc8fb36-ea", "ovs_interfaceid": "dbc8fb36-eabb-4e35-be2c-b7927cd8dd93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08227f9b-6a0a-417b-87f9-a55db2a0db4c", "address": "fa:16:3e:57:b3:3e", "network": {"id": "593778f5-87b9-4daf-86b2-fb84bdcfe3aa", "bridge": "br-int", "label": "tempest-device-tagging-net1-491590125", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08227f9b-6a", "ovs_interfaceid": "08227f9b-6a0a-417b-87f9-a55db2a0db4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ee333c40-496c-4672-8740-b5798c67f89f", "address": "fa:16:3e:25:30:b3", "network": {"id": "593778f5-87b9-4daf-86b2-fb84bdcfe3aa", "bridge": "br-int", "label": "tempest-device-tagging-net1-491590125", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee333c40-49", "ovs_interfaceid": "ee333c40-496c-4672-8740-b5798c67f89f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e4e58571-669a-4120-be1e-285ce59f6540", "address": "fa:16:3e:7a:54:11", "network": {"id": "593778f5-87b9-4daf-86b2-fb84bdcfe3aa", "bridge": "br-int", "label": "tempest-device-tagging-net1-491590125", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e58571-66", "ovs_interfaceid": "e4e58571-669a-4120-be1e-285ce59f6540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e2ece9b-5e92-4a2e-b1b7-0866bed03bbe", "address": "fa:16:3e:65:99:f7", "network": {"id": "593778f5-87b9-4daf-86b2-fb84bdcfe3aa", "bridge": "br-int", "label": "tempest-device-tagging-net1-491590125", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2ece9b-5e", "ovs_interfaceid": "2e2ece9b-5e92-4a2e-b1b7-0866bed03bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16e436d9-950f-421e-b85a-bd0ad1a67465", "address": "fa:16:3e:9b:2d:2b", "network": {"id": "b1cf0cb2-de9d-433d-8129-9c94f785303a", "bridge": "br-int", "label": "tempest-device-tagging-net2-908365697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e436d9-95", "ovs_interfaceid": "16e436d9-950f-421e-b85a-bd0ad1a67465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "448d515a-af97-4efe-ab4c-9f2105e8901d", "address": "fa:16:3e:46:d1:73", "network": {"id": "b1cf0cb2-de9d-433d-8129-9c94f785303a", "bridge": "br-int", "label": "tempest-device-tagging-net2-908365697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap448d515a-af", "ovs_interfaceid": "448d515a-af97-4efe-ab4c-9f2105e8901d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:46:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0b7ec452-a6f4-4aa9-b85c-f45b1d27e18d req-6cfda017-3c53-4fa6-98f7-e51bfbd3fcbb service nova] Acquired lock "refresh_cache-79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:46:10 user nova-compute[74342]: DEBUG nova.network.neutron [req-0b7ec452-a6f4-4aa9-b85c-f45b1d27e18d req-6cfda017-3c53-4fa6-98f7-e51bfbd3fcbb service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Refreshing network info cache for port 16e436d9-950f-421e-b85a-bd0ad1a67465 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:46:11 user nova-compute[74342]: DEBUG nova.compute.manager [req-3158ffc0-19b0-4ad9-a55d-d0cfc942b5db req-c28bbf3f-257f-467b-abf2-e3dd005f630a service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Received event network-changed-ecb4fcc0-8f58-493c-9804-76bf3603b899 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:46:11 user nova-compute[74342]: DEBUG nova.compute.manager [req-3158ffc0-19b0-4ad9-a55d-d0cfc942b5db req-c28bbf3f-257f-467b-abf2-e3dd005f630a service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Refreshing instance network info cache due to event network-changed-ecb4fcc0-8f58-493c-9804-76bf3603b899. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:46:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-3158ffc0-19b0-4ad9-a55d-d0cfc942b5db req-c28bbf3f-257f-467b-abf2-e3dd005f630a service nova] Acquiring lock "refresh_cache-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:46:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-3158ffc0-19b0-4ad9-a55d-d0cfc942b5db req-c28bbf3f-257f-467b-abf2-e3dd005f630a service nova] Acquired lock "refresh_cache-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:46:11 user nova-compute[74342]: DEBUG nova.network.neutron [req-3158ffc0-19b0-4ad9-a55d-d0cfc942b5db req-c28bbf3f-257f-467b-abf2-e3dd005f630a service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Refreshing network info cache for port ecb4fcc0-8f58-493c-9804-76bf3603b899 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:46:11 user nova-compute[74342]: DEBUG nova.network.neutron [req-0b7ec452-a6f4-4aa9-b85c-f45b1d27e18d req-6cfda017-3c53-4fa6-98f7-e51bfbd3fcbb service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Updated VIF entry in instance network info cache for port 16e436d9-950f-421e-b85a-bd0ad1a67465. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:46:11 user nova-compute[74342]: DEBUG nova.network.neutron [req-0b7ec452-a6f4-4aa9-b85c-f45b1d27e18d req-6cfda017-3c53-4fa6-98f7-e51bfbd3fcbb service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Updating instance_info_cache with network_info: [{"id": "dbc8fb36-eabb-4e35-be2c-b7927cd8dd93", "address": "fa:16:3e:39:55:94", "network": {"id": "800822d5-14d4-47bb-9cfa-d8ad634b374b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2023130200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc8fb36-ea", "ovs_interfaceid": "dbc8fb36-eabb-4e35-be2c-b7927cd8dd93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08227f9b-6a0a-417b-87f9-a55db2a0db4c", "address": "fa:16:3e:57:b3:3e", "network": {"id": "593778f5-87b9-4daf-86b2-fb84bdcfe3aa", "bridge": "br-int", "label": "tempest-device-tagging-net1-491590125", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08227f9b-6a", "ovs_interfaceid": "08227f9b-6a0a-417b-87f9-a55db2a0db4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ee333c40-496c-4672-8740-b5798c67f89f", "address": "fa:16:3e:25:30:b3", "network": {"id": "593778f5-87b9-4daf-86b2-fb84bdcfe3aa", "bridge": "br-int", "label": "tempest-device-tagging-net1-491590125", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee333c40-49", "ovs_interfaceid": "ee333c40-496c-4672-8740-b5798c67f89f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e4e58571-669a-4120-be1e-285ce59f6540", "address": "fa:16:3e:7a:54:11", "network": {"id": "593778f5-87b9-4daf-86b2-fb84bdcfe3aa", "bridge": "br-int", "label": "tempest-device-tagging-net1-491590125", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e58571-66", "ovs_interfaceid": "e4e58571-669a-4120-be1e-285ce59f6540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e2ece9b-5e92-4a2e-b1b7-0866bed03bbe", "address": "fa:16:3e:65:99:f7", "network": {"id": "593778f5-87b9-4daf-86b2-fb84bdcfe3aa", "bridge": "br-int", "label": "tempest-device-tagging-net1-491590125", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2ece9b-5e", "ovs_interfaceid": "2e2ece9b-5e92-4a2e-b1b7-0866bed03bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16e436d9-950f-421e-b85a-bd0ad1a67465", "address": "fa:16:3e:9b:2d:2b", "network": {"id": "b1cf0cb2-de9d-433d-8129-9c94f785303a", "bridge": "br-int", "label": "tempest-device-tagging-net2-908365697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e436d9-95", "ovs_interfaceid": "16e436d9-950f-421e-b85a-bd0ad1a67465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "448d515a-af97-4efe-ab4c-9f2105e8901d", "address": "fa:16:3e:46:d1:73", "network": {"id": "b1cf0cb2-de9d-433d-8129-9c94f785303a", "bridge": "br-int", "label": "tempest-device-tagging-net2-908365697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap448d515a-af", "ovs_interfaceid": "448d515a-af97-4efe-ab4c-9f2105e8901d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:46:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0b7ec452-a6f4-4aa9-b85c-f45b1d27e18d req-6cfda017-3c53-4fa6-98f7-e51bfbd3fcbb service nova] Releasing lock "refresh_cache-79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:46:11 user nova-compute[74342]: DEBUG nova.compute.manager [req-0b7ec452-a6f4-4aa9-b85c-f45b1d27e18d req-6cfda017-3c53-4fa6-98f7-e51bfbd3fcbb service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Received event network-changed-448d515a-af97-4efe-ab4c-9f2105e8901d {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:46:11 user nova-compute[74342]: DEBUG nova.compute.manager [req-0b7ec452-a6f4-4aa9-b85c-f45b1d27e18d req-6cfda017-3c53-4fa6-98f7-e51bfbd3fcbb service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Refreshing instance network info cache due to event network-changed-448d515a-af97-4efe-ab4c-9f2105e8901d. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:46:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0b7ec452-a6f4-4aa9-b85c-f45b1d27e18d req-6cfda017-3c53-4fa6-98f7-e51bfbd3fcbb service nova] Acquiring lock "refresh_cache-79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:46:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0b7ec452-a6f4-4aa9-b85c-f45b1d27e18d req-6cfda017-3c53-4fa6-98f7-e51bfbd3fcbb service nova] Acquired lock "refresh_cache-79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:46:11 user nova-compute[74342]: DEBUG nova.network.neutron [req-0b7ec452-a6f4-4aa9-b85c-f45b1d27e18d req-6cfda017-3c53-4fa6-98f7-e51bfbd3fcbb service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Refreshing network info cache for port 448d515a-af97-4efe-ab4c-9f2105e8901d {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:46:11 user nova-compute[74342]: DEBUG nova.network.neutron [req-3158ffc0-19b0-4ad9-a55d-d0cfc942b5db req-c28bbf3f-257f-467b-abf2-e3dd005f630a service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Updated VIF entry in instance network info cache for port ecb4fcc0-8f58-493c-9804-76bf3603b899. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:46:11 user nova-compute[74342]: DEBUG nova.network.neutron [req-3158ffc0-19b0-4ad9-a55d-d0cfc942b5db req-c28bbf3f-257f-467b-abf2-e3dd005f630a service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Updating instance_info_cache with network_info: [{"id": "ecb4fcc0-8f58-493c-9804-76bf3603b899", "address": "fa:16:3e:27:36:3d", "network": {"id": "7cc9829f-36e8-4fd9-9d62-78f3f0019d1f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-252337481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a64826b7567493ab7deee5994b261e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecb4fcc0-8f", "ovs_interfaceid": "ecb4fcc0-8f58-493c-9804-76bf3603b899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:46:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-3158ffc0-19b0-4ad9-a55d-d0cfc942b5db req-c28bbf3f-257f-467b-abf2-e3dd005f630a service nova] Releasing lock "refresh_cache-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:46:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-da1048d6-4d5c-4ab9-877d-4aa02c023291 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Acquiring lock "interface-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:46:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-da1048d6-4d5c-4ab9-877d-4aa02c023291 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "interface-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:46:11 user nova-compute[74342]: DEBUG nova.objects.instance [None req-da1048d6-4d5c-4ab9-877d-4aa02c023291 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lazy-loading 'flavor' on Instance uuid 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:46:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:12 user nova-compute[74342]: DEBUG nova.objects.instance [None req-da1048d6-4d5c-4ab9-877d-4aa02c023291 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lazy-loading 'pci_requests' on Instance uuid 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:46:12 user nova-compute[74342]: DEBUG nova.network.neutron [req-0b7ec452-a6f4-4aa9-b85c-f45b1d27e18d req-6cfda017-3c53-4fa6-98f7-e51bfbd3fcbb service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Updated VIF entry in instance network info cache for port 448d515a-af97-4efe-ab4c-9f2105e8901d. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:46:12 user nova-compute[74342]: DEBUG nova.network.neutron [req-0b7ec452-a6f4-4aa9-b85c-f45b1d27e18d req-6cfda017-3c53-4fa6-98f7-e51bfbd3fcbb service nova] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Updating instance_info_cache with network_info: [{"id": "dbc8fb36-eabb-4e35-be2c-b7927cd8dd93", "address": "fa:16:3e:39:55:94", "network": {"id": "800822d5-14d4-47bb-9cfa-d8ad634b374b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2023130200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc8fb36-ea", "ovs_interfaceid": "dbc8fb36-eabb-4e35-be2c-b7927cd8dd93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "08227f9b-6a0a-417b-87f9-a55db2a0db4c", "address": "fa:16:3e:57:b3:3e", "network": {"id": "593778f5-87b9-4daf-86b2-fb84bdcfe3aa", "bridge": "br-int", "label": "tempest-device-tagging-net1-491590125", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08227f9b-6a", "ovs_interfaceid": "08227f9b-6a0a-417b-87f9-a55db2a0db4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ee333c40-496c-4672-8740-b5798c67f89f", "address": "fa:16:3e:25:30:b3", "network": {"id": "593778f5-87b9-4daf-86b2-fb84bdcfe3aa", "bridge": "br-int", "label": "tempest-device-tagging-net1-491590125", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee333c40-49", "ovs_interfaceid": "ee333c40-496c-4672-8740-b5798c67f89f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e4e58571-669a-4120-be1e-285ce59f6540", "address": "fa:16:3e:7a:54:11", "network": {"id": "593778f5-87b9-4daf-86b2-fb84bdcfe3aa", "bridge": "br-int", "label": "tempest-device-tagging-net1-491590125", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e58571-66", "ovs_interfaceid": "e4e58571-669a-4120-be1e-285ce59f6540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "2e2ece9b-5e92-4a2e-b1b7-0866bed03bbe", "address": "fa:16:3e:65:99:f7", "network": {"id": "593778f5-87b9-4daf-86b2-fb84bdcfe3aa", "bridge": "br-int", "label": "tempest-device-tagging-net1-491590125", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2ece9b-5e", "ovs_interfaceid": "2e2ece9b-5e92-4a2e-b1b7-0866bed03bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "16e436d9-950f-421e-b85a-bd0ad1a67465", "address": "fa:16:3e:9b:2d:2b", "network": {"id": "b1cf0cb2-de9d-433d-8129-9c94f785303a", "bridge": "br-int", "label": "tempest-device-tagging-net2-908365697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e436d9-95", "ovs_interfaceid": "16e436d9-950f-421e-b85a-bd0ad1a67465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "448d515a-af97-4efe-ab4c-9f2105e8901d", "address": "fa:16:3e:46:d1:73", "network": {"id": "b1cf0cb2-de9d-433d-8129-9c94f785303a", "bridge": "br-int", "label": "tempest-device-tagging-net2-908365697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap448d515a-af", "ovs_interfaceid": "448d515a-af97-4efe-ab4c-9f2105e8901d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:46:12 user nova-compute[74342]: DEBUG nova.objects.base [None req-da1048d6-4d5c-4ab9-877d-4aa02c023291 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Object Instance<1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4> lazy-loaded attributes: flavor,pci_requests {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 09:46:12 user nova-compute[74342]: DEBUG nova.network.neutron [None req-da1048d6-4d5c-4ab9-877d-4aa02c023291 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:46:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0b7ec452-a6f4-4aa9-b85c-f45b1d27e18d req-6cfda017-3c53-4fa6-98f7-e51bfbd3fcbb service nova] Releasing lock "refresh_cache-79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:46:12 user nova-compute[74342]: DEBUG nova.policy [None req-da1048d6-4d5c-4ab9-877d-4aa02c023291 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '580c2bb824f04735a5a0b0d6f594bde3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a64826b7567493ab7deee5994b261e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:46:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:12 user nova-compute[74342]: DEBUG nova.network.neutron [None req-da1048d6-4d5c-4ab9-877d-4aa02c023291 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Successfully created port: dbff0b7a-6769-4dfc-bfa0-5273815bdc08 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG nova.network.neutron [None req-da1048d6-4d5c-4ab9-877d-4aa02c023291 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Successfully updated port: dbff0b7a-6769-4dfc-bfa0-5273815bdc08 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-da1048d6-4d5c-4ab9-877d-4aa02c023291 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Acquiring lock "refresh_cache-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-da1048d6-4d5c-4ab9-877d-4aa02c023291 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Acquired lock "refresh_cache-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG nova.network.neutron [None req-da1048d6-4d5c-4ab9-877d-4aa02c023291 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG nova.compute.manager [req-a014d80a-ea33-48ec-8cee-fbd9fdf8db80 req-ca7a177f-b973-46a5-938e-eb0e72d8c0f3 service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Received event network-changed-dbff0b7a-6769-4dfc-bfa0-5273815bdc08 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG nova.compute.manager [req-a014d80a-ea33-48ec-8cee-fbd9fdf8db80 req-ca7a177f-b973-46a5-938e-eb0e72d8c0f3 service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Refreshing instance network info cache due to event network-changed-dbff0b7a-6769-4dfc-bfa0-5273815bdc08. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a014d80a-ea33-48ec-8cee-fbd9fdf8db80 req-ca7a177f-b973-46a5-938e-eb0e72d8c0f3 service nova] Acquiring lock "refresh_cache-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG nova.network.neutron [None req-da1048d6-4d5c-4ab9-877d-4aa02c023291 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Updating instance_info_cache with network_info: [{"id": "ecb4fcc0-8f58-493c-9804-76bf3603b899", "address": "fa:16:3e:27:36:3d", "network": {"id": "7cc9829f-36e8-4fd9-9d62-78f3f0019d1f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-252337481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a64826b7567493ab7deee5994b261e7", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecb4fcc0-8f", "ovs_interfaceid": "ecb4fcc0-8f58-493c-9804-76bf3603b899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dbff0b7a-6769-4dfc-bfa0-5273815bdc08", "address": "fa:16:3e:dd:08:71", "network": {"id": "39a0bf3b-4fbd-49ec-b90c-8f14f2ab4045", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-705696688", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3a64826b7567493ab7deee5994b261e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbff0b7a-67", "ovs_interfaceid": "dbff0b7a-6769-4dfc-bfa0-5273815bdc08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-da1048d6-4d5c-4ab9-877d-4aa02c023291 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Releasing lock "refresh_cache-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a014d80a-ea33-48ec-8cee-fbd9fdf8db80 req-ca7a177f-b973-46a5-938e-eb0e72d8c0f3 service nova] Acquired lock "refresh_cache-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG nova.network.neutron [req-a014d80a-ea33-48ec-8cee-fbd9fdf8db80 req-ca7a177f-b973-46a5-938e-eb0e72d8c0f3 service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Refreshing network info cache for port dbff0b7a-6769-4dfc-bfa0-5273815bdc08 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-da1048d6-4d5c-4ab9-877d-4aa02c023291 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T09:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-640949209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-640949209',id=6,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpYhQn0nZA6I7ZVLvCwhw5MRkVm+i8dhF9cA+w+3K6essQXKu4e2BqUgXONrqsgQPLMNC9JJK382LUfvK2FFKrfh3cM12JiZnpdknV1HPaHjSi3tgNn41IJGEsjJsOpHg==',key_name='tempest-keypair-1377321458',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:44:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3a64826b7567493ab7deee5994b261e7',ramdisk_id='',reservation_id='r-v3nxv2mx',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1445023395',owner_user_name='tempest-TaggedAttachmentsTest-1445023395-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:44:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='580c2bb824f04735a5a0b0d6f594bde3',uuid=1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbff0b7a-6769-4dfc-bfa0-5273815bdc08", "address": "fa:16:3e:dd:08:71", "network": {"id": "39a0bf3b-4fbd-49ec-b90c-8f14f2ab4045", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-705696688", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3a64826b7567493ab7deee5994b261e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbff0b7a-67", "ovs_interfaceid": "dbff0b7a-6769-4dfc-bfa0-5273815bdc08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-da1048d6-4d5c-4ab9-877d-4aa02c023291 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Converting VIF {"id": "dbff0b7a-6769-4dfc-bfa0-5273815bdc08", "address": "fa:16:3e:dd:08:71", "network": {"id": "39a0bf3b-4fbd-49ec-b90c-8f14f2ab4045", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-705696688", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3a64826b7567493ab7deee5994b261e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbff0b7a-67", "ovs_interfaceid": "dbff0b7a-6769-4dfc-bfa0-5273815bdc08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-da1048d6-4d5c-4ab9-877d-4aa02c023291 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:08:71,bridge_name='br-int',has_traffic_filtering=True,id=dbff0b7a-6769-4dfc-bfa0-5273815bdc08,network=Network(39a0bf3b-4fbd-49ec-b90c-8f14f2ab4045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbff0b7a-67') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG os_vif [None req-da1048d6-4d5c-4ab9-877d-4aa02c023291 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:08:71,bridge_name='br-int',has_traffic_filtering=True,id=dbff0b7a-6769-4dfc-bfa0-5273815bdc08,network=Network(39a0bf3b-4fbd-49ec-b90c-8f14f2ab4045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbff0b7a-67') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '723e7234-72c8-5376-982b-fea547c0d967', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdbff0b7a-67, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdbff0b7a-67, col_values=(('qos', UUID('00895a21-b701-4e32-a5eb-6c9254ae4e5b')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdbff0b7a-67, col_values=(('external_ids', {'iface-id': 'dbff0b7a-6769-4dfc-bfa0-5273815bdc08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:08:71', 'vm-uuid': '1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:13 user nova-compute[74342]: INFO os_vif [None req-da1048d6-4d5c-4ab9-877d-4aa02c023291 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:08:71,bridge_name='br-int',has_traffic_filtering=True,id=dbff0b7a-6769-4dfc-bfa0-5273815bdc08,network=Network(39a0bf3b-4fbd-49ec-b90c-8f14f2ab4045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbff0b7a-67')
Oct 16 09:46:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-da1048d6-4d5c-4ab9-877d-4aa02c023291 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T09:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-640949209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-640949209',id=6,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpYhQn0nZA6I7ZVLvCwhw5MRkVm+i8dhF9cA+w+3K6essQXKu4e2BqUgXONrqsgQPLMNC9JJK382LUfvK2FFKrfh3cM12JiZnpdknV1HPaHjSi3tgNn41IJGEsjJsOpHg==',key_name='tempest-keypair-1377321458',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:44:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='3a64826b7567493ab7deee5994b261e7',ramdisk_id='',reservation_id='r-v3nxv2mx',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1445023395',owner_user_name='tempest-TaggedAttachmentsTest-1445023395-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:44:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='580c2bb824f04735a5a0b0d6f594bde3',uuid=1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbff0b7a-6769-4dfc-bfa0-5273815bdc08", "address": "fa:16:3e:dd:08:71", "network": {"id": "39a0bf3b-4fbd-49ec-b90c-8f14f2ab4045", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-705696688", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3a64826b7567493ab7deee5994b261e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbff0b7a-67", "ovs_interfaceid": "dbff0b7a-6769-4dfc-bfa0-5273815bdc08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-da1048d6-4d5c-4ab9-877d-4aa02c023291 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Converting VIF {"id": "dbff0b7a-6769-4dfc-bfa0-5273815bdc08", "address": "fa:16:3e:dd:08:71", "network": {"id": "39a0bf3b-4fbd-49ec-b90c-8f14f2ab4045", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-705696688", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3a64826b7567493ab7deee5994b261e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbff0b7a-67", "ovs_interfaceid": "dbff0b7a-6769-4dfc-bfa0-5273815bdc08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-da1048d6-4d5c-4ab9-877d-4aa02c023291 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:08:71,bridge_name='br-int',has_traffic_filtering=True,id=dbff0b7a-6769-4dfc-bfa0-5273815bdc08,network=Network(39a0bf3b-4fbd-49ec-b90c-8f14f2ab4045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbff0b7a-67') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-da1048d6-4d5c-4ab9-877d-4aa02c023291 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] attach device xml: <interface type="ethernet">
Oct 16 09:46:13 user nova-compute[74342]:   <mac address="fa:16:3e:dd:08:71"/>
Oct 16 09:46:13 user nova-compute[74342]:   <model type="virtio"/>
Oct 16 09:46:13 user nova-compute[74342]:   <mtu size="1442"/>
Oct 16 09:46:13 user nova-compute[74342]:   <target dev="tapdbff0b7a-67"/>
Oct 16 09:46:13 user nova-compute[74342]: </interface>
Oct 16 09:46:13 user nova-compute[74342]:  {{(pid=74342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:14 user nova-compute[74342]: DEBUG nova.compute.manager [req-47150d8e-fc62-4fde-94da-c182f3bd67eb req-11401555-8765-4d0d-9375-cf90a42fda00 service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Received event network-vif-plugged-dbff0b7a-6769-4dfc-bfa0-5273815bdc08 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:46:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-47150d8e-fc62-4fde-94da-c182f3bd67eb req-11401555-8765-4d0d-9375-cf90a42fda00 service nova] Acquiring lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:46:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-47150d8e-fc62-4fde-94da-c182f3bd67eb req-11401555-8765-4d0d-9375-cf90a42fda00 service nova] Lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:46:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-47150d8e-fc62-4fde-94da-c182f3bd67eb req-11401555-8765-4d0d-9375-cf90a42fda00 service nova] Lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:46:14 user nova-compute[74342]: DEBUG nova.compute.manager [req-47150d8e-fc62-4fde-94da-c182f3bd67eb req-11401555-8765-4d0d-9375-cf90a42fda00 service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] No waiting events found dispatching network-vif-plugged-dbff0b7a-6769-4dfc-bfa0-5273815bdc08 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:46:14 user nova-compute[74342]: WARNING nova.compute.manager [req-47150d8e-fc62-4fde-94da-c182f3bd67eb req-11401555-8765-4d0d-9375-cf90a42fda00 service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Received unexpected event network-vif-plugged-dbff0b7a-6769-4dfc-bfa0-5273815bdc08 for instance with vm_state active and task_state None.
Oct 16 09:46:14 user nova-compute[74342]: DEBUG nova.network.neutron [req-a014d80a-ea33-48ec-8cee-fbd9fdf8db80 req-ca7a177f-b973-46a5-938e-eb0e72d8c0f3 service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Updated VIF entry in instance network info cache for port dbff0b7a-6769-4dfc-bfa0-5273815bdc08. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:46:14 user nova-compute[74342]: DEBUG nova.network.neutron [req-a014d80a-ea33-48ec-8cee-fbd9fdf8db80 req-ca7a177f-b973-46a5-938e-eb0e72d8c0f3 service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Updating instance_info_cache with network_info: [{"id": "ecb4fcc0-8f58-493c-9804-76bf3603b899", "address": "fa:16:3e:27:36:3d", "network": {"id": "7cc9829f-36e8-4fd9-9d62-78f3f0019d1f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-252337481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a64826b7567493ab7deee5994b261e7", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecb4fcc0-8f", "ovs_interfaceid": "ecb4fcc0-8f58-493c-9804-76bf3603b899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dbff0b7a-6769-4dfc-bfa0-5273815bdc08", "address": "fa:16:3e:dd:08:71", "network": {"id": "39a0bf3b-4fbd-49ec-b90c-8f14f2ab4045", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-705696688", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3a64826b7567493ab7deee5994b261e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbff0b7a-67", "ovs_interfaceid": "dbff0b7a-6769-4dfc-bfa0-5273815bdc08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:46:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a014d80a-ea33-48ec-8cee-fbd9fdf8db80 req-ca7a177f-b973-46a5-938e-eb0e72d8c0f3 service nova] Releasing lock "refresh_cache-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:46:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-da1048d6-4d5c-4ab9-877d-4aa02c023291 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:46:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-da1048d6-4d5c-4ab9-877d-4aa02c023291 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] No BDM found with device name hda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:46:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-da1048d6-4d5c-4ab9-877d-4aa02c023291 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] No VIF found with MAC fa:16:3e:27:36:3d, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:46:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-da1048d6-4d5c-4ab9-877d-4aa02c023291 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:46:14 user nova-compute[74342]:   <nova:package version="0.0.0"/>
Oct 16 09:46:14 user nova-compute[74342]:   <nova:name>tempest-device-tagging-server-640949209</nova:name>
Oct 16 09:46:14 user nova-compute[74342]:   <nova:creationTime>2023-10-16 09:46:14</nova:creationTime>
Oct 16 09:46:14 user nova-compute[74342]:   <nova:flavor name="m1.tiny">
Oct 16 09:46:14 user nova-compute[74342]:     <nova:memory>512</nova:memory>
Oct 16 09:46:14 user nova-compute[74342]:     <nova:disk>1</nova:disk>
Oct 16 09:46:14 user nova-compute[74342]:     <nova:swap>0</nova:swap>
Oct 16 09:46:14 user nova-compute[74342]:     <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:46:14 user nova-compute[74342]:     <nova:vcpus>1</nova:vcpus>
Oct 16 09:46:14 user nova-compute[74342]:   </nova:flavor>
Oct 16 09:46:14 user nova-compute[74342]:   <nova:owner>
Oct 16 09:46:14 user nova-compute[74342]:     <nova:user uuid="580c2bb824f04735a5a0b0d6f594bde3">tempest-TaggedAttachmentsTest-1445023395-project-member</nova:user>
Oct 16 09:46:14 user nova-compute[74342]:     <nova:project uuid="3a64826b7567493ab7deee5994b261e7">tempest-TaggedAttachmentsTest-1445023395</nova:project>
Oct 16 09:46:14 user nova-compute[74342]:   </nova:owner>
Oct 16 09:46:14 user nova-compute[74342]:   <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:46:14 user nova-compute[74342]:   <nova:ports>
Oct 16 09:46:14 user nova-compute[74342]:     <nova:port uuid="ecb4fcc0-8f58-493c-9804-76bf3603b899">
Oct 16 09:46:14 user nova-compute[74342]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 09:46:14 user nova-compute[74342]:     </nova:port>
Oct 16 09:46:14 user nova-compute[74342]:     <nova:port uuid="dbff0b7a-6769-4dfc-bfa0-5273815bdc08">
Oct 16 09:46:14 user nova-compute[74342]:       <nova:ip type="fixed" address="10.10.10.10" ipVersion="4"/>
Oct 16 09:46:14 user nova-compute[74342]:     </nova:port>
Oct 16 09:46:14 user nova-compute[74342]:   </nova:ports>
Oct 16 09:46:14 user nova-compute[74342]: </nova:instance>
Oct 16 09:46:14 user nova-compute[74342]:  {{(pid=74342) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 16 09:46:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-da1048d6-4d5c-4ab9-877d-4aa02c023291 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "interface-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.656s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:46:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:16 user nova-compute[74342]: DEBUG nova.compute.manager [req-f925fc03-8a72-4cb0-94c2-db2b835d837d req-75b02ee5-f572-497f-9314-f76df0ee7ef4 service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Received event network-vif-plugged-dbff0b7a-6769-4dfc-bfa0-5273815bdc08 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:46:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f925fc03-8a72-4cb0-94c2-db2b835d837d req-75b02ee5-f572-497f-9314-f76df0ee7ef4 service nova] Acquiring lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:46:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f925fc03-8a72-4cb0-94c2-db2b835d837d req-75b02ee5-f572-497f-9314-f76df0ee7ef4 service nova] Lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:46:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f925fc03-8a72-4cb0-94c2-db2b835d837d req-75b02ee5-f572-497f-9314-f76df0ee7ef4 service nova] Lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:46:16 user nova-compute[74342]: DEBUG nova.compute.manager [req-f925fc03-8a72-4cb0-94c2-db2b835d837d req-75b02ee5-f572-497f-9314-f76df0ee7ef4 service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] No waiting events found dispatching network-vif-plugged-dbff0b7a-6769-4dfc-bfa0-5273815bdc08 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:46:16 user nova-compute[74342]: WARNING nova.compute.manager [req-f925fc03-8a72-4cb0-94c2-db2b835d837d req-75b02ee5-f572-497f-9314-f76df0ee7ef4 service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Received unexpected event network-vif-plugged-dbff0b7a-6769-4dfc-bfa0-5273815bdc08 for instance with vm_state active and task_state None.
Oct 16 09:46:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Acquiring lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:46:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:46:17 user nova-compute[74342]: DEBUG nova.objects.instance [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lazy-loading 'flavor' on Instance uuid 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:46:18 user nova-compute[74342]: INFO nova.virt.block_device [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Booting with volume e812ff78-fd6a-453f-a3e3-82ff43a99b44 at /dev/vdb
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Acquiring lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:46:18 user nova-compute[74342]: INFO nova.compute.manager [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Attaching volume 5f8fa500-ec2f-41f3-b6f6-f92655f15d1d to /dev/vdb
Oct 16 09:46:18 user nova-compute[74342]: DEBUG os_brick.utils [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a652ef1-1618-4b3b-910e-2a7b73ebf438]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25e99bf-e62a-4dec-a651-7f1f44e50d5a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f5b4fa-e5d9-4b9d-8828-8d9b9098a385]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5ed442-94f7-4aa3-9782-792b6bba4607]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG os_brick.utils [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9f5e16-6a3a-49fa-afb1-3ad903f35e4a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:46:18 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[55751ae6-022e-453a-9312-9a4b1eae9ca0]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG os_brick.utils [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] <== get_connector_properties: return (157ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Updating existing volume attachment record: 1ea7040e-adf1-4e5f-9eaa-935c758df9e1 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc29f041-c752-45a1-80a3-3202b7e6a222]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb51a1e7-29b2-410c-bc48-8af5bd941ee6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d46014-bc31-463f-8698-6052f2c2221a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:46:18 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:46:18 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca578a9d-8400-47bb-9d23-06b3f53424af]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG os_brick.utils [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Updating existing volume attachment record: 636831bc-3c5d-4f0d-96d1-a106b686bc67 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 09:46:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:22 user nova-compute[74342]: DEBUG nova.compute.manager [req-a175bfc2-e3e3-44a7-85bd-0bd2c3e737df req-8329d843-44f8-4a0a-8ccd-a084a194d6d9 service nova] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Received event network-changed-32030b48-4c52-4cf9-ba4f-0dc3b580fbdc {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:46:22 user nova-compute[74342]: DEBUG nova.compute.manager [req-a175bfc2-e3e3-44a7-85bd-0bd2c3e737df req-8329d843-44f8-4a0a-8ccd-a084a194d6d9 service nova] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Refreshing instance network info cache due to event network-changed-32030b48-4c52-4cf9-ba4f-0dc3b580fbdc. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:46:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a175bfc2-e3e3-44a7-85bd-0bd2c3e737df req-8329d843-44f8-4a0a-8ccd-a084a194d6d9 service nova] Acquiring lock "refresh_cache-719428d6-025b-4baa-97a2-c8ebdd49f57e" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:46:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a175bfc2-e3e3-44a7-85bd-0bd2c3e737df req-8329d843-44f8-4a0a-8ccd-a084a194d6d9 service nova] Acquired lock "refresh_cache-719428d6-025b-4baa-97a2-c8ebdd49f57e" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:46:22 user nova-compute[74342]: DEBUG nova.network.neutron [req-a175bfc2-e3e3-44a7-85bd-0bd2c3e737df req-8329d843-44f8-4a0a-8ccd-a084a194d6d9 service nova] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Refreshing network info cache for port 32030b48-4c52-4cf9-ba4f-0dc3b580fbdc {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:46:23 user nova-compute[74342]: DEBUG nova.network.neutron [req-a175bfc2-e3e3-44a7-85bd-0bd2c3e737df req-8329d843-44f8-4a0a-8ccd-a084a194d6d9 service nova] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Updated VIF entry in instance network info cache for port 32030b48-4c52-4cf9-ba4f-0dc3b580fbdc. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:46:23 user nova-compute[74342]: DEBUG nova.network.neutron [req-a175bfc2-e3e3-44a7-85bd-0bd2c3e737df req-8329d843-44f8-4a0a-8ccd-a084a194d6d9 service nova] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Updating instance_info_cache with network_info: [{"id": "32030b48-4c52-4cf9-ba4f-0dc3b580fbdc", "address": "fa:16:3e:90:75:c6", "network": {"id": "58954713-04d6-4123-bfc0-74f8babdad45", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1482868561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d38497173ac495483e9f5c564415da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32030b48-4c", "ovs_interfaceid": "32030b48-4c52-4cf9-ba4f-0dc3b580fbdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:46:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a175bfc2-e3e3-44a7-85bd-0bd2c3e737df req-8329d843-44f8-4a0a-8ccd-a084a194d6d9 service nova] Releasing lock "refresh_cache-719428d6-025b-4baa-97a2-c8ebdd49f57e" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:46:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 09:46:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wbndfzXs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:46:25 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:46:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:46:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:46:25 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:46:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:46:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:46:25 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 09:46:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:25 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7a3cd0-0946-4428-9707-f7c72e1e150a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 09:46:25 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:46:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a1c8e1-cde3-4588-8f06-539a18c24070]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d] added
Oct 16 09:46:26 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[40881272-e811-492a-98b5-89163b9a1ce9]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[755c7519-e9c1-4fc5-9c2f-73692792610a]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wbndfzXs {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wbndfzXs" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9032dac-d045-4611-8a72-52d47e572424]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wbndfzXs'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89cd81c-dad3-422b-a54e-9d76f4bbbae8]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16efe4f-ea4a-49cb-b303-9233be1c33da]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)
Oct 16 09:46:26 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)
Oct 16 09:46:26 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Acquiring lock "719428d6-025b-4baa-97a2-c8ebdd49f57e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Lock "719428d6-025b-4baa-97a2-c8ebdd49f57e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG nova.objects.instance [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Lazy-loading 'flavor' on Instance uuid 719428d6-025b-4baa-97a2-c8ebdd49f57e {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3de4ff0b-79a0-416b-a6d3-22dfea50d020]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d, portal: 172.16.0.220,3260]
Oct 16 09:46:26 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d, portal: 172.16.0.220,3260] successful.
Oct 16 09:46:26 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:26 user nova-compute[74342]: INFO nova.virt.block_device [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Booting with volume 6cd07ef1-0354-4cfd-82a8-08c488a5641d at /dev/vdb
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da71f83-e4c3-42ca-a7f7-3a322a025109]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Acquiring lock "d3ed0377-ff2b-4a15-9175-a70624aa913d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lock "d3ed0377-ff2b-4a15-9175-a70624aa913d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbe22ad-9b33-4ef8-b43d-31abf088df98]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)
Oct 16 09:46:26 user nova-compute[74342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d (non-flash)
Oct 16 09:46:26 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)
Oct 16 09:46:26 user nova-compute[74342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d (non-flash)
Oct 16 09:46:26 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Lock "719428d6-025b-4baa-97a2-c8ebdd49f57e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.108s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG nova.objects.instance [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lazy-loading 'flavor' on Instance uuid d3ed0377-ff2b-4a15-9175-a70624aa913d {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[749482d4-5f56-4a05-83a9-d709626eb653]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wbndfzXs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG os_brick.utils [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[904d9eae-8e80-4b05-b6e8-600cb5892694]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lock "d3ed0377-ff2b-4a15-9175-a70624aa913d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfa00307-3469-4dc9-84b9-fedb1821f421]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.030s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb31da0-e7b4-40ce-bba6-9550db65dba3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[78aaa9a4-63a8-4ab2-83d0-a193bc90ba7c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:46:26 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b62867f-ac76-464b-ac1d-24afa2e94725]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG os_brick.utils [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Updating existing volume attachment record: f7f080cf-49b3-472c-bf37-126c1d0245b0 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Acquiring lock "719428d6-025b-4baa-97a2-c8ebdd49f57e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Lock "719428d6-025b-4baa-97a2-c8ebdd49f57e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:46:26 user nova-compute[74342]: INFO nova.compute.manager [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Attaching volume 2aa56297-5103-428d-b382-19e18719567e to /dev/vdb
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Acquiring lock "d3ed0377-ff2b-4a15-9175-a70624aa913d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:46:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lock "d3ed0377-ff2b-4a15-9175-a70624aa913d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:46:26 user nova-compute[74342]: INFO nova.compute.manager [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Attaching volume 2f4c6dd9-aa93-4f79-a40f-35156152ef39 to /dev/sdc
Oct 16 09:46:27 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:46:27 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23136383931373662', 'path': '/dev/sdc'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:46:27 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136383931373662', 'path': '/dev/sdc'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 09:46:27 user nova-compute[74342]: DEBUG nova.objects.instance [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Lazy-loading 'flavor' on Instance uuid 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:46:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:27 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 09:46:27 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:46:27 user nova-compute[74342]:   <source dev="/dev/sdc"/>
Oct 16 09:46:27 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:46:27 user nova-compute[74342]:   <serial>d6f56e0f-db06-4754-ac87-c15addca786d</serial>
Oct 16 09:46:27 user nova-compute[74342]: </disk>
Oct 16 09:46:27 user nova-compute[74342]:  {{(pid=74342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 09:46:27 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:46:27 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:46:27 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] No VIF found with MAC fa:16:3e:75:76:65, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:46:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:34 user nova-compute[74342]: DEBUG nova.compute.manager [req-06007fb5-c9da-4434-86bb-e03cc160a045 req-e8748ff2-8b14-4087-953d-e9ad7f59ffe2 service nova] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Received event network-changed-4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:46:34 user nova-compute[74342]: DEBUG nova.compute.manager [req-06007fb5-c9da-4434-86bb-e03cc160a045 req-e8748ff2-8b14-4087-953d-e9ad7f59ffe2 service nova] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Refreshing instance network info cache due to event network-changed-4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:46:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-06007fb5-c9da-4434-86bb-e03cc160a045 req-e8748ff2-8b14-4087-953d-e9ad7f59ffe2 service nova] Acquiring lock "refresh_cache-1c0d394c-6e6b-41f6-b6eb-e5d54b82990f" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:46:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-06007fb5-c9da-4434-86bb-e03cc160a045 req-e8748ff2-8b14-4087-953d-e9ad7f59ffe2 service nova] Acquired lock "refresh_cache-1c0d394c-6e6b-41f6-b6eb-e5d54b82990f" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:46:34 user nova-compute[74342]: DEBUG nova.network.neutron [req-06007fb5-c9da-4434-86bb-e03cc160a045 req-e8748ff2-8b14-4087-953d-e9ad7f59ffe2 service nova] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Refreshing network info cache for port 4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:46:35 user nova-compute[74342]: DEBUG nova.network.neutron [req-06007fb5-c9da-4434-86bb-e03cc160a045 req-e8748ff2-8b14-4087-953d-e9ad7f59ffe2 service nova] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Updated VIF entry in instance network info cache for port 4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:46:35 user nova-compute[74342]: DEBUG nova.network.neutron [req-06007fb5-c9da-4434-86bb-e03cc160a045 req-e8748ff2-8b14-4087-953d-e9ad7f59ffe2 service nova] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Updating instance_info_cache with network_info: [{"id": "4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9", "address": "fa:16:3e:42:54:d6", "network": {"id": "b6011a11-a0a3-40cb-bf20-d1df67f13d18", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1041414891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96d85f52140448bca8fa0646bea02d75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4900a7e6-eb", "ovs_interfaceid": "4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:46:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-06007fb5-c9da-4434-86bb-e03cc160a045 req-e8748ff2-8b14-4087-953d-e9ad7f59ffe2 service nova] Releasing lock "refresh_cache-1c0d394c-6e6b-41f6-b6eb-e5d54b82990f" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:46:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ad23f51e-0302-4417-98f9-aa86090c732f tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Lock "89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 44.652s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:46:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-baae67b5-d3ed-421e-97b6-a8e882aace7e tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Acquiring lock "1c0d394c-6e6b-41f6-b6eb-e5d54b82990f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:46:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-baae67b5-d3ed-421e-97b6-a8e882aace7e tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Lock "1c0d394c-6e6b-41f6-b6eb-e5d54b82990f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:46:35 user nova-compute[74342]: DEBUG nova.objects.instance [None req-baae67b5-d3ed-421e-97b6-a8e882aace7e tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Lazy-loading 'flavor' on Instance uuid 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:46:35 user nova-compute[74342]: DEBUG os_brick.utils [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:46:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e88c4e8-7a8b-4481-8791-56698d819fd1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-baae67b5-d3ed-421e-97b6-a8e882aace7e tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Lock "1c0d394c-6e6b-41f6-b6eb-e5d54b82990f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:46:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dafdd138-0771-4587-8f78-188f280ba81d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[359cb6a6-81ee-4f68-9ca4-2027e2277330]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[614976b4-72b3-4089-9134-6972bb517cb0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:46:35 user nova-compute[74342]: DEBUG os_brick.utils [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:46:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:46:36 user nova-compute[74342]: INFO nova.virt.block_device [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Booting with volume f6dacc5c-08b8-448c-9f43-e53e59704e05 at /dev/vdc
Oct 16 09:46:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbe4f7c-c73a-40c2-8850-e7b8a1dbd371]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:46:36 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:46:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8589b33a-b16e-49f8-8741-1a49982ab567]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:46:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:46:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:46:36 user nova-compute[74342]: DEBUG os_brick.utils [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:46:36 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Updating existing volume attachment record: 2c59886b-bcb4-4efd-b401-c67a9aa72b4f {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 09:46:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4f956c-faf4-4d33-aa39-a5b2368348e6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.013s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[63db4dce-b245-46ff-a1b4-80249ed50967]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9bd758-49f3-4b96-9d86-515f2080072f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:46:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:46:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:46:36 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:46:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[542d4f89-12f7-4179-8a0d-40c20cb1c3a0]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:46:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:46:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:46:36 user nova-compute[74342]: DEBUG os_brick.utils [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:46:36 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Updating existing volume attachment record: 054a28b2-ad4e-4b8d-b5f4-64475febdf87 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 09:46:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-baae67b5-d3ed-421e-97b6-a8e882aace7e tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Acquiring lock "1c0d394c-6e6b-41f6-b6eb-e5d54b82990f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:46:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-baae67b5-d3ed-421e-97b6-a8e882aace7e tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Lock "1c0d394c-6e6b-41f6-b6eb-e5d54b82990f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:46:36 user nova-compute[74342]: INFO nova.compute.manager [None req-baae67b5-d3ed-421e-97b6-a8e882aace7e tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Attaching volume 337baae2-5ce3-4443-847d-c7eff116e231 to /dev/vdb
Oct 16 09:46:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:43 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:46:43 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:46:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:46:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:46:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:46:43 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 09:46:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:44 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:46:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:44 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:46:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719428d6-025b-4baa-97a2-c8ebdd49f57e/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719428d6-025b-4baa-97a2-c8ebdd49f57e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719428d6-025b-4baa-97a2-c8ebdd49f57e/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719428d6-025b-4baa-97a2-c8ebdd49f57e/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ed0377-ff2b-4a15-9175-a70624aa913d/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ed0377-ff2b-4a15-9175-a70624aa913d/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ed0377-ff2b-4a15-9175-a70624aa913d/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d3ed0377-ff2b-4a15-9175-a70624aa913d/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:47 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:46:47 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:46:47 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=7663MB free_disk=25.384754180908203GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 09:46:47 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:46:47 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:46:47 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance d45abd20-3a58-4657-8f4c-a426d8e39be3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:46:47 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 98367a96-22f0-4edb-ab03-a8eb286b437b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:46:47 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:46:47 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance bdcd2e60-b36c-4d87-94d7-076e7430e1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:46:47 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance d3ed0377-ff2b-4a15-9175-a70624aa913d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:46:47 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:46:47 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 719428d6-025b-4baa-97a2-c8ebdd49f57e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:46:47 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:46:47 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 017caffb-5be2-4e78-ab48-a8091c5c00f4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:46:47 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 347c7f16-6bd0-4a51-b40a-1d9d705acc27 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:46:47 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:46:47 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 09:46:47 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 09:46:47 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:46:47 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:46:47 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 09:46:47 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.549s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:46:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:46:51 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:46:51 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:46:51 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 09:46:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:46:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:46:51 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 09:46:52 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Updating instance_info_cache with network_info: [{"id": "dd087947-aab3-4ee2-81c4-71d884fb003b", "address": "fa:16:3e:75:76:65", "network": {"id": "976fca4a-3d61-444a-abc9-845ebf17a00e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-205035660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fb407ddf1914bfe814d5ef3d8301a06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd087947-aa", "ovs_interfaceid": "dd087947-aab3-4ee2-81c4-71d884fb003b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:46:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:46:52 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 09:46:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:52 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:46:52 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:46:52 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:46:52 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:46:52 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:46:52 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 09:46:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ARmpJenS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:46:54 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:46:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:46:54 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:46:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:46:54 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd64659-4a19-4ff2-b709-e60d1fbb5c00]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "16d64ca5-035b-4c15-a6ec-7c0dfe64724f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "16d64ca5-035b-4c15-a6ec-7c0dfe64724f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 09:46:54 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f961959-12f0-4b52-815d-a77cc3ff039d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e] added
Oct 16 09:46:54 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c772e646-fdf5-4a8c-8ca9-0d7678df6908]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG os_brick.utils [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d9f849-dd83-4bc0-9939-bd5db7db3204]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[527e2d3a-870b-443a-a233-347b9db094ab]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ARmpJenS {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67b5aa7-d93d-401a-ba82-8f25ba2b825b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ARmpJenS" returned: 0 in 0.028s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1c1313-5db6-4d4c-94a7-ab9d461a6010]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c457537-68bc-4467-8285-5cce1fd5fc60]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ARmpJenS'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:46:54 user nova-compute[74342]: INFO nova.compute.claims [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Claim successful on node user
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[edff9ef1-c464-4626-a9c4-9201825932f4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97f7b46-c8a5-4419-8950-891e1139006b]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:46:54 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b7e472-965e-465c-9b89-c84491a6320c]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG os_brick.utils [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Updating existing volume attachment record: 69d4618c-6fef-418e-81f2-0c612d953977 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cbd6c7b-4b2c-4867-8094-47a25d307a37]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)
Oct 16 09:46:54 user nova-compute[74342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d (non-flash)
Oct 16 09:46:54 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)
Oct 16 09:46:54 user nova-compute[74342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d (non-flash)
Oct 16 09:46:54 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88dc06d-5ef9-4c67-aaea-356662612188]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e, portal: 172.16.0.220,3260]
Oct 16 09:46:54 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e, portal: 172.16.0.220,3260] successful.
Oct 16 09:46:54 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b638ded-d443-47e0-8c0d-f116d3353282]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c92b0aa3-d4a0-40f3-b28a-b9882bb0e4f1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)
Oct 16 09:46:54 user nova-compute[74342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d (non-flash)
Oct 16 09:46:54 user nova-compute[74342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e (non-flash)
Oct 16 09:46:54 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)
Oct 16 09:46:54 user nova-compute[74342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d (non-flash)
Oct 16 09:46:54 user nova-compute[74342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e (non-flash)
Oct 16 09:46:54 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.392s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[94f9b71f-0a89-4298-bcb0-3a31f2459c2f]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:46:54 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:46:55 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:46:55 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:46:55 user nova-compute[74342]: INFO nova.virt.block_device [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Booting with blank volume at /dev/vda
Oct 16 09:46:55 user nova-compute[74342]: DEBUG nova.policy [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f90f091b76254a13957807feaeaef3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fcf2437a2d413ea584d0cc2508bed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:46:55 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:46:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ARmpJenS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 09:46:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.430s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:46:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] <== connect_volume: return (1432ms) {'type': 'block', 'scsi_wwn': '26463313861306233', 'path': '/dev/sdd'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:46:55 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463313861306233', 'path': '/dev/sdd'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 09:46:55 user nova-compute[74342]: DEBUG nova.objects.instance [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Lazy-loading 'flavor' on Instance uuid 719428d6-025b-4baa-97a2-c8ebdd49f57e {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:46:55 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] attach device xml: <disk type="block" device="disk">
Oct 16 09:46:55 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:46:55 user nova-compute[74342]:   <source dev="/dev/sdd"/>
Oct 16 09:46:55 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:46:55 user nova-compute[74342]:   <serial>2aa56297-5103-428d-b382-19e18719567e</serial>
Oct 16 09:46:55 user nova-compute[74342]: </disk>
Oct 16 09:46:55 user nova-compute[74342]:  {{(pid=74342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 09:46:55 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:55 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Successfully created port: 0cf84b4d-3498-43f4-a970-758aa193bb1e {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:46:55 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:46:55 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:46:55 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] No VIF found with MAC fa:16:3e:90:75:c6, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:46:56 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Successfully updated port: 0cf84b4d-3498-43f4-a970-758aa193bb1e {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:46:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "refresh_cache-16d64ca5-035b-4c15-a6ec-7c0dfe64724f" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:46:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquired lock "refresh_cache-16d64ca5-035b-4c15-a6ec-7c0dfe64724f" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:46:56 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:46:56 user nova-compute[74342]: DEBUG nova.compute.manager [req-ee49a9bd-4ea2-4ba5-a094-038c8b4bff7d req-711b9000-3533-4eb2-ad79-28339b936aff service nova] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Received event network-changed-0cf84b4d-3498-43f4-a970-758aa193bb1e {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:46:56 user nova-compute[74342]: DEBUG nova.compute.manager [req-ee49a9bd-4ea2-4ba5-a094-038c8b4bff7d req-711b9000-3533-4eb2-ad79-28339b936aff service nova] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Refreshing instance network info cache due to event network-changed-0cf84b4d-3498-43f4-a970-758aa193bb1e. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:46:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ee49a9bd-4ea2-4ba5-a094-038c8b4bff7d req-711b9000-3533-4eb2-ad79-28339b936aff service nova] Acquiring lock "refresh_cache-16d64ca5-035b-4c15-a6ec-7c0dfe64724f" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:46:56 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:46:56 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Updating instance_info_cache with network_info: [{"id": "0cf84b4d-3498-43f4-a970-758aa193bb1e", "address": "fa:16:3e:2a:64:44", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf84b4d-34", "ovs_interfaceid": "0cf84b4d-3498-43f4-a970-758aa193bb1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:46:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Releasing lock "refresh_cache-16d64ca5-035b-4c15-a6ec-7c0dfe64724f" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:46:56 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Instance network_info: |[{"id": "0cf84b4d-3498-43f4-a970-758aa193bb1e", "address": "fa:16:3e:2a:64:44", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf84b4d-34", "ovs_interfaceid": "0cf84b4d-3498-43f4-a970-758aa193bb1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:46:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ee49a9bd-4ea2-4ba5-a094-038c8b4bff7d req-711b9000-3533-4eb2-ad79-28339b936aff service nova] Acquired lock "refresh_cache-16d64ca5-035b-4c15-a6ec-7c0dfe64724f" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:46:56 user nova-compute[74342]: DEBUG nova.network.neutron [req-ee49a9bd-4ea2-4ba5-a094-038c8b4bff7d req-711b9000-3533-4eb2-ad79-28339b936aff service nova] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Refreshing network info cache for port 0cf84b4d-3498-43f4-a970-758aa193bb1e {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:46:57 user nova-compute[74342]: DEBUG nova.network.neutron [req-ee49a9bd-4ea2-4ba5-a094-038c8b4bff7d req-711b9000-3533-4eb2-ad79-28339b936aff service nova] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Updated VIF entry in instance network info cache for port 0cf84b4d-3498-43f4-a970-758aa193bb1e. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:46:57 user nova-compute[74342]: DEBUG nova.network.neutron [req-ee49a9bd-4ea2-4ba5-a094-038c8b4bff7d req-711b9000-3533-4eb2-ad79-28339b936aff service nova] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Updating instance_info_cache with network_info: [{"id": "0cf84b4d-3498-43f4-a970-758aa193bb1e", "address": "fa:16:3e:2a:64:44", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf84b4d-34", "ovs_interfaceid": "0cf84b4d-3498-43f4-a970-758aa193bb1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:46:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ee49a9bd-4ea2-4ba5-a094-038c8b4bff7d req-711b9000-3533-4eb2-ad79-28339b936aff service nova] Releasing lock "refresh_cache-16d64ca5-035b-4c15-a6ec-7c0dfe64724f" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:46:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:46:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 09:47:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lgIoXhvP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:47:01 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:47:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:47:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:47:01 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:47:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:47:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:47:01 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 09:47:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:01 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8146fe65-0b7e-40d9-9076-1ebaba402844]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 09:47:01 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:01 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c835dd8-e465-47d1-8b72-5ecc0f698665]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d] added
Oct 16 09:47:01 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:01 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1fef59c-d0b9-4e5f-9535-92c7461124cc]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:01 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b1298f-aa6d-4b3b-adb9-aaef9e45b014]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lgIoXhvP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v lgIoXhvP" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:01 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac29fed1-ed83-4125-a23b-a89dbb07e63f]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'lgIoXhvP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:01 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6277814-d873-465c-8777-b363de9d0275]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf435633-6b60-4da5-9fa6-6170abf648e8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)
Oct 16 09:47:02 user nova-compute[74342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d (non-flash)
Oct 16 09:47:02 user nova-compute[74342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e (non-flash)
Oct 16 09:47:02 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)
Oct 16 09:47:02 user nova-compute[74342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d (non-flash)
Oct 16 09:47:02 user nova-compute[74342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e (non-flash)
Oct 16 09:47:02 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5521b26-6af2-4d3e-913d-f807daf99a1a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d, portal: 172.16.0.220,3260]
Oct 16 09:47:02 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d, portal: 172.16.0.220,3260] successful.
Oct 16 09:47:02 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbad1c3-3fae-4c26-8b7a-82eb85f98794]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e37d9182-399d-4235-9989-5227d7890e7c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)
Oct 16 09:47:02 user nova-compute[74342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d (non-flash)
Oct 16 09:47:02 user nova-compute[74342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e (non-flash)
Oct 16 09:47:02 user nova-compute[74342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d (non-flash)
Oct 16 09:47:02 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)
Oct 16 09:47:02 user nova-compute[74342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d (non-flash)
Oct 16 09:47:02 user nova-compute[74342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e (non-flash)
Oct 16 09:47:02 user nova-compute[74342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d (non-flash)
Oct 16 09:47:02 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcad1312-f185-4338-889f-3e0acdf8e3f9]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lgIoXhvP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-55c30eba-4224-460c-af40-28993c530358 tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Lock "719428d6-025b-4baa-97a2-c8ebdd49f57e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 35.957s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG os_brick.utils [None req-baae67b5-d3ed-421e-97b6-a8e882aace7e tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5d10b3-94bb-44fc-8bc6-30df68f479c7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6194c0a1-831d-48ee-94f0-a401ee1140f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e68d993-126d-4ab6-b554-d22844ac2f68]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b7a6a2-e038-447a-844c-fbc97b96b709]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-baae67b5-d3ed-421e-97b6-a8e882aace7e tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-baae67b5-d3ed-421e-97b6-a8e882aace7e tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-baae67b5-d3ed-421e-97b6-a8e882aace7e tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:02 user nova-compute[74342]: INFO nova.virt.block_device [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Booting with volume 47e3235c-fa0b-4896-ab7c-eea043469405 at /dev/vdc
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:47:02 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e438f05-f6a2-48b9-a07d-f2e5a92a363f]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-baae67b5-d3ed-421e-97b6-a8e882aace7e tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-baae67b5-d3ed-421e-97b6-a8e882aace7e tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-baae67b5-d3ed-421e-97b6-a8e882aace7e tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG os_brick.utils [None req-baae67b5-d3ed-421e-97b6-a8e882aace7e tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-baae67b5-d3ed-421e-97b6-a8e882aace7e tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Updating existing volume attachment record: f1fe6ea2-1b90-48e4-b132-b6680189bf52 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Acquiring lock "89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Lock "89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Acquiring lock "89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Lock "89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Lock "89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:02 user nova-compute[74342]: INFO nova.compute.manager [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Terminating instance
Oct 16 09:47:02 user nova-compute[74342]: DEBUG nova.compute.manager [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG nova.compute.manager [req-42b672d9-a8fb-4b82-af36-2195df5f8565 req-41ba69ec-e787-44b4-8631-c8e90125ddbd service nova] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Received event network-vif-unplugged-dd087947-aab3-4ee2-81c4-71d884fb003b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-42b672d9-a8fb-4b82-af36-2195df5f8565 req-41ba69ec-e787-44b4-8631-c8e90125ddbd service nova] Acquiring lock "89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-42b672d9-a8fb-4b82-af36-2195df5f8565 req-41ba69ec-e787-44b4-8631-c8e90125ddbd service nova] Lock "89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-42b672d9-a8fb-4b82-af36-2195df5f8565 req-41ba69ec-e787-44b4-8631-c8e90125ddbd service nova] Lock "89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG nova.compute.manager [req-42b672d9-a8fb-4b82-af36-2195df5f8565 req-41ba69ec-e787-44b4-8631-c8e90125ddbd service nova] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] No waiting events found dispatching network-vif-unplugged-dd087947-aab3-4ee2-81c4-71d884fb003b {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG nova.compute.manager [req-42b672d9-a8fb-4b82-af36-2195df5f8565 req-41ba69ec-e787-44b4-8631-c8e90125ddbd service nova] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Received event network-vif-unplugged-dd087947-aab3-4ee2-81c4-71d884fb003b for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.385s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] <== connect_volume: return (1387ms) {'type': 'block', 'scsi_wwn': '23032386630336230', 'path': '/dev/sde'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23032386630336230', 'path': '/dev/sde'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG nova.objects.instance [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lazy-loading 'flavor' on Instance uuid 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 09:47:03 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:47:03 user nova-compute[74342]:   <source dev="/dev/sde"/>
Oct 16 09:47:03 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:47:03 user nova-compute[74342]:   <serial>5f8fa500-ec2f-41f3-b6f6-f92655f15d1d</serial>
Oct 16 09:47:03 user nova-compute[74342]: </disk>
Oct 16 09:47:03 user nova-compute[74342]:  {{(pid=74342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:03 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Instance destroyed successfully.
Oct 16 09:47:03 user nova-compute[74342]: DEBUG nova.objects.instance [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Lazy-loading 'resources' on Instance uuid 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:43:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1499584542',display_name='tempest-DeleteServersTestJSON-server-1499584542',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1499584542',id=3,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:44:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1fb407ddf1914bfe814d5ef3d8301a06',ramdisk_id='',reservation_id='r-gas22d5c',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-431827328',owner_user_name='tempest-DeleteServersTestJSON-431827328-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:44:15Z,user_data=None,user_id='03e4a514221849f08812551e45abf14e',uuid=89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dd087947-aab3-4ee2-81c4-71d884fb003b", "address": "fa:16:3e:75:76:65", "network": {"id": "976fca4a-3d61-444a-abc9-845ebf17a00e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-205035660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fb407ddf1914bfe814d5ef3d8301a06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd087947-aa", "ovs_interfaceid": "dd087947-aab3-4ee2-81c4-71d884fb003b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Converting VIF {"id": "dd087947-aab3-4ee2-81c4-71d884fb003b", "address": "fa:16:3e:75:76:65", "network": {"id": "976fca4a-3d61-444a-abc9-845ebf17a00e", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-205035660-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1fb407ddf1914bfe814d5ef3d8301a06", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdd087947-aa", "ovs_interfaceid": "dd087947-aab3-4ee2-81c4-71d884fb003b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:76:65,bridge_name='br-int',has_traffic_filtering=True,id=dd087947-aab3-4ee2-81c4-71d884fb003b,network=Network(976fca4a-3d61-444a-abc9-845ebf17a00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd087947-aa') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG os_vif [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:76:65,bridge_name='br-int',has_traffic_filtering=True,id=dd087947-aab3-4ee2-81c4-71d884fb003b,network=Network(976fca4a-3d61-444a-abc9-845ebf17a00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd087947-aa') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdd087947-aa, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c7edad58-335a-4272-a5ce-6d65e179a506) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:47:03 user nova-compute[74342]: INFO os_vif [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:76:65,bridge_name='br-int',has_traffic_filtering=True,id=dd087947-aab3-4ee2-81c4-71d884fb003b,network=Network(976fca4a-3d61-444a-abc9-845ebf17a00e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdd087947-aa')
Oct 16 09:47:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wbndfzXs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:47:03 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:47:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] No BDM found with device name hda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] No VIF found with MAC fa:16:3e:27:36:3d, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b9c910-9c1b-48b9-87f8-fb9c0b02dffa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 09:47:03 user nova-compute[74342]: No targets found.
Oct 16 09:47:03 user nova-compute[74342]: iSNS:
Oct 16 09:47:03 user nova-compute[74342]: No targets found.
Oct 16 09:47:03 user nova-compute[74342]: STATIC:
Oct 16 09:47:03 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d
Oct 16 09:47:03 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:47:03 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:47:03 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d
Oct 16 09:47:03 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:47:03 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:47:03 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d
Oct 16 09:47:03 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:47:03 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:47:03 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e
Oct 16 09:47:03 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:47:03 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:47:03 user nova-compute[74342]: FIRMWARE:
Oct 16 09:47:03 user nova-compute[74342]: No targets found.
Oct 16 09:47:03 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 09:47:03 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 09:47:03 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7466e26-ca2b-45d5-a8bf-ec53bbf42469]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2e8164-7e13-4357-b518-717a786726c1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)
Oct 16 09:47:03 user nova-compute[74342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d (non-flash)
Oct 16 09:47:03 user nova-compute[74342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e (non-flash)
Oct 16 09:47:03 user nova-compute[74342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d (non-flash)
Oct 16 09:47:03 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)
Oct 16 09:47:03 user nova-compute[74342]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d (non-flash)
Oct 16 09:47:03 user nova-compute[74342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e (non-flash)
Oct 16 09:47:03 user nova-compute[74342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d (non-flash)
Oct 16 09:47:03 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b80135750>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d'): ({'sdc'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Removing single pathed devices sdc {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 09:47:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dedfda27-218e-4257-9f1f-e6331e9945f5]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[378671b7-dca4-4711-b22f-2e9a318e6d07]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Flushing IO for device /dev/sdc {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cef18c6-5c7f-4d1b-bf97-01538fd2372f]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.036s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fee338d6-732e-486b-a6a1-2d25d6ed0e5b]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] SCSI volumes sdc have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a60809c-fff9-47ee-8f6f-252258436e0b]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ece8f2-f0be-42d1-a920-b5da3c17bb4e]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d, portal: 172.16.0.220,3260]
Oct 16 09:47:04 user nova-compute[74342]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d, portal: 172.16.0.220,3260] successful.
Oct 16 09:47:04 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d6f56e0f-db06-4754-ac87-c15addca786d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d588c001-38d0-4b30-90d0-66f257157b95]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] <== disconnect_volume: return (315ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 09:47:04 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Deleting instance files /opt/stack/data/nova/instances/89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce_del
Oct 16 09:47:04 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Deletion of /opt/stack/data/nova/instances/89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce_del complete
Oct 16 09:47:04 user nova-compute[74342]: INFO nova.compute.manager [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Took 1.54 seconds to destroy the instance on the hypervisor.
Oct 16 09:47:04 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 09:47:04 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:47:05 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Took 0.73 seconds to deallocate network for instance.
Oct 16 09:47:05 user nova-compute[74342]: DEBUG nova.compute.manager [req-78d2f0f9-ce5e-41c3-a204-dbf42969dc63 req-240ccc7c-0031-4618-82e8-49ad68c1e502 service nova] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Received event network-vif-deleted-dd087947-aab3-4ee2-81c4-71d884fb003b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:47:05 user nova-compute[74342]: DEBUG nova.compute.manager [req-be0fe56e-9bde-4d6f-ad36-572498e0a2f6 req-565b2aca-21fb-4121-80c8-fd6046e63c45 service nova] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Received event network-vif-plugged-dd087947-aab3-4ee2-81c4-71d884fb003b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:47:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-be0fe56e-9bde-4d6f-ad36-572498e0a2f6 req-565b2aca-21fb-4121-80c8-fd6046e63c45 service nova] Acquiring lock "89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-be0fe56e-9bde-4d6f-ad36-572498e0a2f6 req-565b2aca-21fb-4121-80c8-fd6046e63c45 service nova] Lock "89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-be0fe56e-9bde-4d6f-ad36-572498e0a2f6 req-565b2aca-21fb-4121-80c8-fd6046e63c45 service nova] Lock "89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:05 user nova-compute[74342]: DEBUG nova.compute.manager [req-be0fe56e-9bde-4d6f-ad36-572498e0a2f6 req-565b2aca-21fb-4121-80c8-fd6046e63c45 service nova] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] No waiting events found dispatching network-vif-plugged-dd087947-aab3-4ee2-81c4-71d884fb003b {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:47:05 user nova-compute[74342]: WARNING nova.compute.manager [req-be0fe56e-9bde-4d6f-ad36-572498e0a2f6 req-565b2aca-21fb-4121-80c8-fd6046e63c45 service nova] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Received unexpected event network-vif-plugged-dd087947-aab3-4ee2-81c4-71d884fb003b for instance with vm_state active and task_state deleting.
Oct 16 09:47:07 user nova-compute[74342]: DEBUG nova.compute.manager [req-93f7dfca-152f-4b04-b2b4-1de8eb57f07c req-713e6ef3-2460-4799-8cea-1fa4d442bfd4 service nova] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Received event network-changed-0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:47:07 user nova-compute[74342]: DEBUG nova.compute.manager [req-93f7dfca-152f-4b04-b2b4-1de8eb57f07c req-713e6ef3-2460-4799-8cea-1fa4d442bfd4 service nova] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Refreshing instance network info cache due to event network-changed-0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:47:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-93f7dfca-152f-4b04-b2b4-1de8eb57f07c req-713e6ef3-2460-4799-8cea-1fa4d442bfd4 service nova] Acquiring lock "refresh_cache-017caffb-5be2-4e78-ab48-a8091c5c00f4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:47:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-93f7dfca-152f-4b04-b2b4-1de8eb57f07c req-713e6ef3-2460-4799-8cea-1fa4d442bfd4 service nova] Acquired lock "refresh_cache-017caffb-5be2-4e78-ab48-a8091c5c00f4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:47:07 user nova-compute[74342]: DEBUG nova.network.neutron [req-93f7dfca-152f-4b04-b2b4-1de8eb57f07c req-713e6ef3-2460-4799-8cea-1fa4d442bfd4 service nova] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Refreshing network info cache for port 0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:47:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:07 user nova-compute[74342]: DEBUG nova.network.neutron [req-93f7dfca-152f-4b04-b2b4-1de8eb57f07c req-713e6ef3-2460-4799-8cea-1fa4d442bfd4 service nova] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Updated VIF entry in instance network info cache for port 0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:47:07 user nova-compute[74342]: DEBUG nova.network.neutron [req-93f7dfca-152f-4b04-b2b4-1de8eb57f07c req-713e6ef3-2460-4799-8cea-1fa4d442bfd4 service nova] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Updating instance_info_cache with network_info: [{"id": "0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6", "address": "fa:16:3e:56:bd:70", "network": {"id": "9c306d1c-3407-47dd-a04f-e185b1d1788a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1404292047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbba73e7218148b492aca0b1c2673b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad97513-e2", "ovs_interfaceid": "0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:47:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-93f7dfca-152f-4b04-b2b4-1de8eb57f07c req-713e6ef3-2460-4799-8cea-1fa4d442bfd4 service nova] Releasing lock "refresh_cache-017caffb-5be2-4e78-ab48-a8091c5c00f4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:47:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvRwjGpQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:47:12 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:47:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:47:12 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:47:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:47:12 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d262370d-4473-40d5-8780-9c83b95a8c88]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 09:47:12 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[54f514e1-d12f-4384-8ea4-29a69604959d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39] added
Oct 16 09:47:12 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bd3822-7b37-49dc-8641-0c1bd3b92886]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbef898-a2a7-43ab-9508-6642e462cc85]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dvRwjGpQ {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dvRwjGpQ" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[40275443-5aba-4fd4-8db2-bd6d97cba8b7]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dvRwjGpQ'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ffc30a-74c5-43ed-8b13-77904b9d476c]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG os_brick.utils [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[852c6c3c-aa91-4636-ad50-ef34f76d0198]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)
Oct 16 09:47:12 user nova-compute[74342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e (non-flash)
Oct 16 09:47:12 user nova-compute[74342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d (non-flash)
Oct 16 09:47:12 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)
Oct 16 09:47:12 user nova-compute[74342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e (non-flash)
Oct 16 09:47:12 user nova-compute[74342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d (non-flash)
Oct 16 09:47:12 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0642f503-99d8-4bff-af53-700c930b57d2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af8e8df-193c-4cfa-a1f3-524f1e4b8fec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff19951d-6004-4eff-afaa-91d468dce400]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[943f43ff-3360-49cc-bed3-08e7c20a5ca7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a770bf-ff9d-4d67-8b04-79eafb24171f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39, portal: 172.16.0.220,3260]
Oct 16 09:47:12 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39, portal: 172.16.0.220,3260] successful.
Oct 16 09:47:12 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:47:12 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd3cd405-9073-4db3-933c-d440f0b30d69]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG os_brick.utils [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Updating existing volume attachment record: 9a1c3d03-6c96-4b81-b72b-542c7d456ec1 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8e48ad-1b62-4a3b-9bb4-588819956b4c]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[32dd7652-99b6-4cf7-83b0-934bc3ce5aaa]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)
Oct 16 09:47:12 user nova-compute[74342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e (non-flash)
Oct 16 09:47:12 user nova-compute[74342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d (non-flash)
Oct 16 09:47:12 user nova-compute[74342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 (non-flash)
Oct 16 09:47:12 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)
Oct 16 09:47:12 user nova-compute[74342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e (non-flash)
Oct 16 09:47:12 user nova-compute[74342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d (non-flash)
Oct 16 09:47:12 user nova-compute[74342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 (non-flash)
Oct 16 09:47:12 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.311s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] HCTL ('34', '-', '-', 0) found on session 6 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d7c77d-6037-4398-af17-5adfeacf476f]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Searching for a device in session 6 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:47:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvRwjGpQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 09:47:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d78d862e-516f-4454-b8a5-23889edd4460 tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 54.646s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:13 user nova-compute[74342]: INFO nova.compute.manager [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] [instance: 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce] Took 8.76 seconds to detach 1 volumes for instance.
Oct 16 09:47:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:47:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23237316231363963', 'path': '/dev/sdc'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:47:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237316231363963', 'path': '/dev/sdc'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 09:47:13 user nova-compute[74342]: DEBUG nova.objects.instance [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lazy-loading 'flavor' on Instance uuid d3ed0377-ff2b-4a15-9175-a70624aa913d {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:47:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 09:47:13 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:47:13 user nova-compute[74342]:   <source dev="/dev/sdc"/>
Oct 16 09:47:13 user nova-compute[74342]:   <target dev="sdc" bus="scsi"/>
Oct 16 09:47:13 user nova-compute[74342]:   <serial>2f4c6dd9-aa93-4f79-a40f-35156152ef39</serial>
Oct 16 09:47:13 user nova-compute[74342]:   <address type="drive" controller="0" unit="2"/>
Oct 16 09:47:13 user nova-compute[74342]: </disk>
Oct 16 09:47:13 user nova-compute[74342]:  {{(pid=74342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.volume.cinder [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Update attachment failed for attachment 69d4618c-6fef-418e-81f2-0c612d953977. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0c1721eb-0025-440d-abcb-37e1d5f57257) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0c1721eb-0025-440d-abcb-37e1d5f57257)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0c1721eb-0025-440d-abcb-37e1d5f57257)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Traceback (most recent call last):
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]     driver_block_device.attach_block_devices(
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]     _log_and_attach(device)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]     bdm.attach(*attach_args, **attach_kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]     ret_val = method(obj, context, *args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]     self._do_attach(context, instance, volume, volume_api,
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]     self._volume_attach(context, volume, connector, instance,
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]     connection_info = volume_api.attachment_update(
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]     res = method(self, ctx, *args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]     with excutils.save_and_reraise_exception():
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]     self.force_reraise()
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]     raise self.value
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]     context, '3.44', skip_version_check=True).attachments.update(
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]     return method.func(obj, *args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]     resp = self._update('/attachments/%s' % id, body)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]     return self._cs_request(url, 'PUT', **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]     return self.request(url, method, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5]     raise exceptions.from_response(resp, body)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0c1721eb-0025-440d-abcb-37e1d5f57257)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] 
Oct 16 09:47:14 user nova-compute[74342]: DEBUG nova.compute.claims [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Aborting claim: <nova.compute.claims.Claim object at 0x7f2b60727be0> {{(pid=74342) abort /opt/stack/nova/nova/compute/claims.py:84}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.483s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.232s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:14 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Deleted allocations for instance 89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce
Oct 16 09:47:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] No BDM found with device name sda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] No BDM found with device name sdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] No BDM found with device name sdc, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] No VIF found with MAC fa:16:3e:c2:4d:5a, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.volume.cinder [None req-baae67b5-d3ed-421e-97b6-a8e882aace7e tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Update attachment failed for attachment f1fe6ea2-1b90-48e4-b132-b6680189bf52. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4e3a7a08-9e2e-4a78-9a12-48c53ada3c58) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4e3a7a08-9e2e-4a78-9a12-48c53ada3c58)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [None req-baae67b5-d3ed-421e-97b6-a8e882aace7e tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Failed to attach 337baae2-5ce3-4443-847d-c7eff116e231 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4e3a7a08-9e2e-4a78-9a12-48c53ada3c58)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Traceback (most recent call last):
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]     ret_val = method(obj, context, *args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]     self._do_attach(context, instance, volume, volume_api,
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]     self._volume_attach(context, volume, connector, instance,
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]     connection_info = volume_api.attachment_update(
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]     res = method(self, ctx, *args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]     with excutils.save_and_reraise_exception():
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]     self.force_reraise()
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]     raise self.value
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]     context, '3.44', skip_version_check=True).attachments.update(
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]     return method.func(obj, *args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]     resp = self._update('/attachments/%s' % id, body)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]     return self._cs_request(url, 'PUT', **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]     return self.request(url, method, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f]     raise exceptions.from_response(resp, body)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4e3a7a08-9e2e-4a78-9a12-48c53ada3c58)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] 
Oct 16 09:47:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ef9423ca-3c5f-471d-a039-ab97fbab389a tempest-VolumesAssistedSnapshotsTest-6628803 tempest-VolumesAssistedSnapshotsTest-6628803-project] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] volume_snapshot_create: create_info: {'snapshot_id': 'ef873cc7-64e4-4466-bbb6-e18b4c49cb14', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=74342) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-1ee2590e-263f-4563-ba35-3e55307ea34d tempest-DeleteServersTestJSON-431827328 tempest-DeleteServersTestJSON-431827328-project-member] Lock "89f5ebc8-0d71-46ae-9a2f-c04c0327b0ce" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.854s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ef9423ca-3c5f-471d-a039-ab97fbab389a tempest-VolumesAssistedSnapshotsTest-6628803 tempest-VolumesAssistedSnapshotsTest-6628803-project] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] snap xml: <domainsnapshot>
Oct 16 09:47:14 user nova-compute[74342]:   <disks>
Oct 16 09:47:14 user nova-compute[74342]:     <disk name="/dev/sdd" snapshot="external" type="file">
Oct 16 09:47:14 user nova-compute[74342]:       <source file="/dev/new_file"/>
Oct 16 09:47:14 user nova-compute[74342]:     </disk>
Oct 16 09:47:14 user nova-compute[74342]:     <disk name="vda" snapshot="no"/>
Oct 16 09:47:14 user nova-compute[74342]:   </disks>
Oct 16 09:47:14 user nova-compute[74342]: </domainsnapshot>
Oct 16 09:47:14 user nova-compute[74342]:  {{(pid=74342) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG nova.objects.instance [None req-ef9423ca-3c5f-471d-a039-ab97fbab389a tempest-VolumesAssistedSnapshotsTest-6628803 tempest-VolumesAssistedSnapshotsTest-6628803-project] Lazy-loading 'system_metadata' on Instance uuid 719428d6-025b-4baa-97a2-c8ebdd49f57e {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9a7fe49f-4b3b-45b6-b6eb-d10e7f0850a9 tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lock "d3ed0377-ff2b-4a15-9175-a70624aa913d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 48.052s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG os_brick.utils [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:14 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-ef9423ca-3c5f-471d-a039-ab97fbab389a tempest-VolumesAssistedSnapshotsTest-6628803 tempest-VolumesAssistedSnapshotsTest-6628803-project] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 16 09:47:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e310745-927d-4c02-a2e7-c57593179104]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-e59baf35-cabf-4742-9124-a2cb9a5ba944 tempest-VolumesAssistedSnapshotsTest-6628803 tempest-VolumesAssistedSnapshotsTest-6628803-project] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] volume_snapshot_delete: delete_info: {'volume_id': '2aa56297-5103-428d-b382-19e18719567e'} {{(pid=74342) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [None req-e59baf35-cabf-4742-9124-a2cb9a5ba944 tempest-VolumesAssistedSnapshotsTest-6628803 tempest-VolumesAssistedSnapshotsTest-6628803-project] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Traceback (most recent call last):
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]     self._volume_snapshot_delete(context, instance, volume_id,
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]     if delete_info['type'] != 'qcow2':
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] KeyError: 'type'
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] 
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [None req-ef9423ca-3c5f-471d-a039-ab97fbab389a tempest-VolumesAssistedSnapshotsTest-6628803 tempest-VolumesAssistedSnapshotsTest-6628803-project] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Traceback (most recent call last):
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]     rv = execute(f, *args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]     six.reraise(c, e, tb)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]     raise value
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]     rv = meth(*args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] 
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [None req-ef9423ca-3c5f-471d-a039-ab97fbab389a tempest-VolumesAssistedSnapshotsTest-6628803 tempest-VolumesAssistedSnapshotsTest-6628803-project] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Traceback (most recent call last):
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]     self._volume_snapshot_create(context, instance, guest,
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]     rv = execute(f, *args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]     six.reraise(c, e, tb)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]     raise value
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]     rv = meth(*args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] 
Oct 16 09:47:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc25a933-c60f-4855-a524-122eb793c540]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-baae67b5-d3ed-421e-97b6-a8e882aace7e tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Lock "1c0d394c-6e6b-41f6-b6eb-e5d54b82990f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 38.584s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [None req-e59baf35-cabf-4742-9124-a2cb9a5ba944 tempest-VolumesAssistedSnapshotsTest-6628803 tempest-VolumesAssistedSnapshotsTest-6628803-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver 
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver 
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-a566d88b-d6bb-4f47-8208-a5b1fb5c2c0a)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver 
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver 
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver 
Oct 16 09:47:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3082e9-5c36-43e5-93c6-548ad85e1170]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde6221d-43ad-4c53-9bb2-89aacff21ccf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver [None req-ef9423ca-3c5f-471d-a039-ab97fbab389a tempest-VolumesAssistedSnapshotsTest-6628803 tempest-VolumesAssistedSnapshotsTest-6628803-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot ef873cc7-64e4-4466-bbb6-e18b4c49cb14 could not be found.
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     raise value
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver 
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver 
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot ef873cc7-64e4-4466-bbb6-e18b4c49cb14 could not be found. (HTTP 404) (Request-ID: req-986ce570-b180-4b02-8902-74a9ed680da2)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver 
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver 
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot ef873cc7-64e4-4466-bbb6-e18b4c49cb14 could not be found.
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.virt.libvirt.driver 
Oct 16 09:47:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server [None req-e59baf35-cabf-4742-9124-a2cb9a5ba944 tempest-VolumesAssistedSnapshotsTest-6628803 tempest-VolumesAssistedSnapshotsTest-6628803-project] Exception during message handling: KeyError: 'type'
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4516, in volume_snapshot_delete
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server 
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server [None req-ef9423ca-3c5f-471d-a039-ab97fbab389a tempest-VolumesAssistedSnapshotsTest-6628803 tempest-VolumesAssistedSnapshotsTest-6628803-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4504, in volume_snapshot_create
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     raise value
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server 
Oct 16 09:47:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:47:14 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:47:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c549dea8-14cf-483c-92b5-31576179e054]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG os_brick.utils [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Updating existing volume attachment record: 678ed51a-8dcc-4812-bb61-0ca9be97696c {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server [None req-baae67b5-d3ed-421e-97b6-a8e882aace7e tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4e3a7a08-9e2e-4a78-9a12-48c53ada3c58)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7552, in attach_volume
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7549, in do_attach_volume
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7547, in do_attach_volume
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7569, in _attach_volume
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7566, in _attach_volume
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-4e3a7a08-9e2e-4a78-9a12-48c53ada3c58)
Oct 16 09:47:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server 
Oct 16 09:47:14 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.625s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG nova.compute.manager [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Build of instance 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0c1721eb-0025-440d-abcb-37e1d5f57257) {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG nova.compute.utils [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Build of instance 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=74342) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Oct 16 09:47:14 user nova-compute[74342]: ERROR nova.compute.manager [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Build of instance 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0c1721eb-0025-440d-abcb-37e1d5f57257): nova.exception.BuildAbortException: Build of instance 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-0c1721eb-0025-440d-abcb-37e1d5f57257)
Oct 16 09:47:14 user nova-compute[74342]: DEBUG nova.compute.manager [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Unplugging VIFs for instance {{(pid=74342) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T09:45:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1793993723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1793993723',id=11,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtvAyAc5YlgzGpyZmfRiypAVaH+Rw6q2lPR3YzpV0waVPwnCIFebqosu2U3xljUpjxa2E1+FpLnBOiuenmANhx59O2YDUDKTumlLtxemEjwJiLdC6/tsqipCgPMZiH0dw==',key_name='tempest-keypair-1939131193',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e0176e92bc48c3b79999f47fa4f6d1',ramdisk_id='',reservation_id='r-aqvk3kz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1477645559',owner_user_name='tempest-TaggedBootDevicesTest-1477645559-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:45:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77333a3273b5429fbabb5cb5f229f38f',uuid=79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dbc8fb36-eabb-4e35-be2c-b7927cd8dd93", "address": "fa:16:3e:39:55:94", "network": {"id": "800822d5-14d4-47bb-9cfa-d8ad634b374b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2023130200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc8fb36-ea", "ovs_interfaceid": "dbc8fb36-eabb-4e35-be2c-b7927cd8dd93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Converting VIF {"id": "dbc8fb36-eabb-4e35-be2c-b7927cd8dd93", "address": "fa:16:3e:39:55:94", "network": {"id": "800822d5-14d4-47bb-9cfa-d8ad634b374b", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-2023130200-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbc8fb36-ea", "ovs_interfaceid": "dbc8fb36-eabb-4e35-be2c-b7927cd8dd93", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:55:94,bridge_name='br-int',has_traffic_filtering=True,id=dbc8fb36-eabb-4e35-be2c-b7927cd8dd93,network=Network(800822d5-14d4-47bb-9cfa-d8ad634b374b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbc8fb36-ea') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG os_vif [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:55:94,bridge_name='br-int',has_traffic_filtering=True,id=dbc8fb36-eabb-4e35-be2c-b7927cd8dd93,network=Network(800822d5-14d4-47bb-9cfa-d8ad634b374b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbc8fb36-ea') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:47:14 user nova-compute[74342]: INFO nova.compute.manager [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Rebuilding instance
Oct 16 09:47:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbc8fb36-ea, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:47:14 user nova-compute[74342]: INFO os_vif [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:55:94,bridge_name='br-int',has_traffic_filtering=True,id=dbc8fb36-eabb-4e35-be2c-b7927cd8dd93,network=Network(800822d5-14d4-47bb-9cfa-d8ad634b374b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbc8fb36-ea')
Oct 16 09:47:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T09:45:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1793993723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1793993723',id=11,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtvAyAc5YlgzGpyZmfRiypAVaH+Rw6q2lPR3YzpV0waVPwnCIFebqosu2U3xljUpjxa2E1+FpLnBOiuenmANhx59O2YDUDKTumlLtxemEjwJiLdC6/tsqipCgPMZiH0dw==',key_name='tempest-keypair-1939131193',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e0176e92bc48c3b79999f47fa4f6d1',ramdisk_id='',reservation_id='r-aqvk3kz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1477645559',owner_user_name='tempest-TaggedBootDevicesTest-1477645559-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:45:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77333a3273b5429fbabb5cb5f229f38f',uuid=79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08227f9b-6a0a-417b-87f9-a55db2a0db4c", "address": "fa:16:3e:57:b3:3e", "network": {"id": "593778f5-87b9-4daf-86b2-fb84bdcfe3aa", "bridge": "br-int", "label": "tempest-device-tagging-net1-491590125", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08227f9b-6a", "ovs_interfaceid": "08227f9b-6a0a-417b-87f9-a55db2a0db4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Converting VIF {"id": "08227f9b-6a0a-417b-87f9-a55db2a0db4c", "address": "fa:16:3e:57:b3:3e", "network": {"id": "593778f5-87b9-4daf-86b2-fb84bdcfe3aa", "bridge": "br-int", "label": "tempest-device-tagging-net1-491590125", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.199", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08227f9b-6a", "ovs_interfaceid": "08227f9b-6a0a-417b-87f9-a55db2a0db4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:57:b3:3e,bridge_name='br-int',has_traffic_filtering=True,id=08227f9b-6a0a-417b-87f9-a55db2a0db4c,network=Network(593778f5-87b9-4daf-86b2-fb84bdcfe3aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap08227f9b-6a') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG os_vif [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:b3:3e,bridge_name='br-int',has_traffic_filtering=True,id=08227f9b-6a0a-417b-87f9-a55db2a0db4c,network=Network(593778f5-87b9-4daf-86b2-fb84bdcfe3aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap08227f9b-6a') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08227f9b-6a, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:47:15 user nova-compute[74342]: INFO os_vif [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:57:b3:3e,bridge_name='br-int',has_traffic_filtering=True,id=08227f9b-6a0a-417b-87f9-a55db2a0db4c,network=Network(593778f5-87b9-4daf-86b2-fb84bdcfe3aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap08227f9b-6a')
Oct 16 09:47:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T09:45:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1793993723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1793993723',id=11,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtvAyAc5YlgzGpyZmfRiypAVaH+Rw6q2lPR3YzpV0waVPwnCIFebqosu2U3xljUpjxa2E1+FpLnBOiuenmANhx59O2YDUDKTumlLtxemEjwJiLdC6/tsqipCgPMZiH0dw==',key_name='tempest-keypair-1939131193',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e0176e92bc48c3b79999f47fa4f6d1',ramdisk_id='',reservation_id='r-aqvk3kz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1477645559',owner_user_name='tempest-TaggedBootDevicesTest-1477645559-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:45:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77333a3273b5429fbabb5cb5f229f38f',uuid=79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ee333c40-496c-4672-8740-b5798c67f89f", "address": "fa:16:3e:25:30:b3", "network": {"id": "593778f5-87b9-4daf-86b2-fb84bdcfe3aa", "bridge": "br-int", "label": "tempest-device-tagging-net1-491590125", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee333c40-49", "ovs_interfaceid": "ee333c40-496c-4672-8740-b5798c67f89f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Converting VIF {"id": "ee333c40-496c-4672-8740-b5798c67f89f", "address": "fa:16:3e:25:30:b3", "network": {"id": "593778f5-87b9-4daf-86b2-fb84bdcfe3aa", "bridge": "br-int", "label": "tempest-device-tagging-net1-491590125", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.136", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapee333c40-49", "ovs_interfaceid": "ee333c40-496c-4672-8740-b5798c67f89f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:30:b3,bridge_name='br-int',has_traffic_filtering=True,id=ee333c40-496c-4672-8740-b5798c67f89f,network=Network(593778f5-87b9-4daf-86b2-fb84bdcfe3aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapee333c40-49') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG os_vif [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:30:b3,bridge_name='br-int',has_traffic_filtering=True,id=ee333c40-496c-4672-8740-b5798c67f89f,network=Network(593778f5-87b9-4daf-86b2-fb84bdcfe3aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapee333c40-49') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapee333c40-49, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:47:15 user nova-compute[74342]: INFO os_vif [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:30:b3,bridge_name='br-int',has_traffic_filtering=True,id=ee333c40-496c-4672-8740-b5798c67f89f,network=Network(593778f5-87b9-4daf-86b2-fb84bdcfe3aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapee333c40-49')
Oct 16 09:47:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T09:45:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1793993723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1793993723',id=11,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtvAyAc5YlgzGpyZmfRiypAVaH+Rw6q2lPR3YzpV0waVPwnCIFebqosu2U3xljUpjxa2E1+FpLnBOiuenmANhx59O2YDUDKTumlLtxemEjwJiLdC6/tsqipCgPMZiH0dw==',key_name='tempest-keypair-1939131193',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e0176e92bc48c3b79999f47fa4f6d1',ramdisk_id='',reservation_id='r-aqvk3kz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1477645559',owner_user_name='tempest-TaggedBootDevicesTest-1477645559-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:45:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77333a3273b5429fbabb5cb5f229f38f',uuid=79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e4e58571-669a-4120-be1e-285ce59f6540", "address": "fa:16:3e:7a:54:11", "network": {"id": "593778f5-87b9-4daf-86b2-fb84bdcfe3aa", "bridge": "br-int", "label": "tempest-device-tagging-net1-491590125", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e58571-66", "ovs_interfaceid": "e4e58571-669a-4120-be1e-285ce59f6540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Converting VIF {"id": "e4e58571-669a-4120-be1e-285ce59f6540", "address": "fa:16:3e:7a:54:11", "network": {"id": "593778f5-87b9-4daf-86b2-fb84bdcfe3aa", "bridge": "br-int", "label": "tempest-device-tagging-net1-491590125", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape4e58571-66", "ovs_interfaceid": "e4e58571-669a-4120-be1e-285ce59f6540", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:54:11,bridge_name='br-int',has_traffic_filtering=True,id=e4e58571-669a-4120-be1e-285ce59f6540,network=Network(593778f5-87b9-4daf-86b2-fb84bdcfe3aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e58571-66') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG os_vif [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:54:11,bridge_name='br-int',has_traffic_filtering=True,id=e4e58571-669a-4120-be1e-285ce59f6540,network=Network(593778f5-87b9-4daf-86b2-fb84bdcfe3aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e58571-66') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape4e58571-66, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:47:15 user nova-compute[74342]: INFO os_vif [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:54:11,bridge_name='br-int',has_traffic_filtering=True,id=e4e58571-669a-4120-be1e-285ce59f6540,network=Network(593778f5-87b9-4daf-86b2-fb84bdcfe3aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape4e58571-66')
Oct 16 09:47:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T09:45:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1793993723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1793993723',id=11,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtvAyAc5YlgzGpyZmfRiypAVaH+Rw6q2lPR3YzpV0waVPwnCIFebqosu2U3xljUpjxa2E1+FpLnBOiuenmANhx59O2YDUDKTumlLtxemEjwJiLdC6/tsqipCgPMZiH0dw==',key_name='tempest-keypair-1939131193',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e0176e92bc48c3b79999f47fa4f6d1',ramdisk_id='',reservation_id='r-aqvk3kz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1477645559',owner_user_name='tempest-TaggedBootDevicesTest-1477645559-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:45:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77333a3273b5429fbabb5cb5f229f38f',uuid=79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e2ece9b-5e92-4a2e-b1b7-0866bed03bbe", "address": "fa:16:3e:65:99:f7", "network": {"id": "593778f5-87b9-4daf-86b2-fb84bdcfe3aa", "bridge": "br-int", "label": "tempest-device-tagging-net1-491590125", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2ece9b-5e", "ovs_interfaceid": "2e2ece9b-5e92-4a2e-b1b7-0866bed03bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Converting VIF {"id": "2e2ece9b-5e92-4a2e-b1b7-0866bed03bbe", "address": "fa:16:3e:65:99:f7", "network": {"id": "593778f5-87b9-4daf-86b2-fb84bdcfe3aa", "bridge": "br-int", "label": "tempest-device-tagging-net1-491590125", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.91", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e2ece9b-5e", "ovs_interfaceid": "2e2ece9b-5e92-4a2e-b1b7-0866bed03bbe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:99:f7,bridge_name='br-int',has_traffic_filtering=True,id=2e2ece9b-5e92-4a2e-b1b7-0866bed03bbe,network=Network(593778f5-87b9-4daf-86b2-fb84bdcfe3aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2ece9b-5e') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG os_vif [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:99:f7,bridge_name='br-int',has_traffic_filtering=True,id=2e2ece9b-5e92-4a2e-b1b7-0866bed03bbe,network=Network(593778f5-87b9-4daf-86b2-fb84bdcfe3aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2ece9b-5e') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e2ece9b-5e, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:47:15 user nova-compute[74342]: INFO os_vif [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:99:f7,bridge_name='br-int',has_traffic_filtering=True,id=2e2ece9b-5e92-4a2e-b1b7-0866bed03bbe,network=Network(593778f5-87b9-4daf-86b2-fb84bdcfe3aa),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e2ece9b-5e')
Oct 16 09:47:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T09:45:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1793993723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1793993723',id=11,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtvAyAc5YlgzGpyZmfRiypAVaH+Rw6q2lPR3YzpV0waVPwnCIFebqosu2U3xljUpjxa2E1+FpLnBOiuenmANhx59O2YDUDKTumlLtxemEjwJiLdC6/tsqipCgPMZiH0dw==',key_name='tempest-keypair-1939131193',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e0176e92bc48c3b79999f47fa4f6d1',ramdisk_id='',reservation_id='r-aqvk3kz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1477645559',owner_user_name='tempest-TaggedBootDevicesTest-1477645559-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:45:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77333a3273b5429fbabb5cb5f229f38f',uuid=79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "16e436d9-950f-421e-b85a-bd0ad1a67465", "address": "fa:16:3e:9b:2d:2b", "network": {"id": "b1cf0cb2-de9d-433d-8129-9c94f785303a", "bridge": "br-int", "label": "tempest-device-tagging-net2-908365697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e436d9-95", "ovs_interfaceid": "16e436d9-950f-421e-b85a-bd0ad1a67465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Converting VIF {"id": "16e436d9-950f-421e-b85a-bd0ad1a67465", "address": "fa:16:3e:9b:2d:2b", "network": {"id": "b1cf0cb2-de9d-433d-8129-9c94f785303a", "bridge": "br-int", "label": "tempest-device-tagging-net2-908365697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap16e436d9-95", "ovs_interfaceid": "16e436d9-950f-421e-b85a-bd0ad1a67465", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:2d:2b,bridge_name='br-int',has_traffic_filtering=True,id=16e436d9-950f-421e-b85a-bd0ad1a67465,network=Network(b1cf0cb2-de9d-433d-8129-9c94f785303a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e436d9-95') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG os_vif [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:2d:2b,bridge_name='br-int',has_traffic_filtering=True,id=16e436d9-950f-421e-b85a-bd0ad1a67465,network=Network(b1cf0cb2-de9d-433d-8129-9c94f785303a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e436d9-95') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap16e436d9-95, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Acquiring lock "719428d6-025b-4baa-97a2-c8ebdd49f57e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Lock "719428d6-025b-4baa-97a2-c8ebdd49f57e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:15 user nova-compute[74342]: INFO os_vif [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:2d:2b,bridge_name='br-int',has_traffic_filtering=True,id=16e436d9-950f-421e-b85a-bd0ad1a67465,network=Network(b1cf0cb2-de9d-433d-8129-9c94f785303a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap16e436d9-95')
Oct 16 09:47:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T09:45:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1793993723',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1793993723',id=11,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHtvAyAc5YlgzGpyZmfRiypAVaH+Rw6q2lPR3YzpV0waVPwnCIFebqosu2U3xljUpjxa2E1+FpLnBOiuenmANhx59O2YDUDKTumlLtxemEjwJiLdC6/tsqipCgPMZiH0dw==',key_name='tempest-keypair-1939131193',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23e0176e92bc48c3b79999f47fa4f6d1',ramdisk_id='',reservation_id='r-aqvk3kz0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1477645559',owner_user_name='tempest-TaggedBootDevicesTest-1477645559-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:45:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='77333a3273b5429fbabb5cb5f229f38f',uuid=79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "448d515a-af97-4efe-ab4c-9f2105e8901d", "address": "fa:16:3e:46:d1:73", "network": {"id": "b1cf0cb2-de9d-433d-8129-9c94f785303a", "bridge": "br-int", "label": "tempest-device-tagging-net2-908365697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap448d515a-af", "ovs_interfaceid": "448d515a-af97-4efe-ab4c-9f2105e8901d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Converting VIF {"id": "448d515a-af97-4efe-ab4c-9f2105e8901d", "address": "fa:16:3e:46:d1:73", "network": {"id": "b1cf0cb2-de9d-433d-8129-9c94f785303a", "bridge": "br-int", "label": "tempest-device-tagging-net2-908365697", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "23e0176e92bc48c3b79999f47fa4f6d1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap448d515a-af", "ovs_interfaceid": "448d515a-af97-4efe-ab4c-9f2105e8901d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:d1:73,bridge_name='br-int',has_traffic_filtering=True,id=448d515a-af97-4efe-ab4c-9f2105e8901d,network=Network(b1cf0cb2-de9d-433d-8129-9c94f785303a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap448d515a-af') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG os_vif [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:d1:73,bridge_name='br-int',has_traffic_filtering=True,id=448d515a-af97-4efe-ab4c-9f2105e8901d,network=Network(b1cf0cb2-de9d-433d-8129-9c94f785303a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap448d515a-af') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG nova.compute.manager [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap448d515a-af, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:47:15 user nova-compute[74342]: INFO nova.compute.manager [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Detaching volume 2aa56297-5103-428d-b382-19e18719567e
Oct 16 09:47:15 user nova-compute[74342]: INFO os_vif [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:d1:73,bridge_name='br-int',has_traffic_filtering=True,id=448d515a-af97-4efe-ab4c-9f2105e8901d,network=Network(b1cf0cb2-de9d-433d-8129-9c94f785303a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap448d515a-af')
Oct 16 09:47:15 user nova-compute[74342]: DEBUG nova.compute.manager [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Unplugged VIFs for instance {{(pid=74342) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG nova.compute.manager [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG nova.network.neutron [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 09:47:15 user nova-compute[74342]: INFO nova.virt.block_device [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Attempting to driver detach volume 2aa56297-5103-428d-b382-19e18719567e from mountpoint /dev/vdb
Oct 16 09:47:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Attempting to detach device vdb from instance 719428d6-025b-4baa-97a2-c8ebdd49f57e from the persistent domain config. {{(pid=74342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] detach device xml: <disk type="block" device="disk">
Oct 16 09:47:15 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:47:15 user nova-compute[74342]:   <source dev="/dev/sdd"/>
Oct 16 09:47:15 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:47:15 user nova-compute[74342]:   <serial>2aa56297-5103-428d-b382-19e18719567e</serial>
Oct 16 09:47:15 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 09:47:15 user nova-compute[74342]: </disk>
Oct 16 09:47:15 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 09:47:15 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Successfully detached device vdb from instance 719428d6-025b-4baa-97a2-c8ebdd49f57e from the persistent domain config.
Oct 16 09:47:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 719428d6-025b-4baa-97a2-c8ebdd49f57e from the live domain config. {{(pid=74342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] detach device xml: <disk type="block" device="disk">
Oct 16 09:47:15 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:47:15 user nova-compute[74342]:   <source dev="/dev/sdd"/>
Oct 16 09:47:15 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:47:15 user nova-compute[74342]:   <serial>2aa56297-5103-428d-b382-19e18719567e</serial>
Oct 16 09:47:15 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 09:47:15 user nova-compute[74342]: </disk>
Oct 16 09:47:15 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Acquiring lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:15 user nova-compute[74342]: INFO nova.compute.manager [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Detaching volume 5f8fa500-ec2f-41f3-b6f6-f92655f15d1d
Oct 16 09:47:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-2e75e69d-35a9-4973-9ca5-51930f73b460 req-6926de0c-cdf5-4006-89ee-69518962a8b8 service nova] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Received event network-vif-unplugged-0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-2e75e69d-35a9-4973-9ca5-51930f73b460 req-6926de0c-cdf5-4006-89ee-69518962a8b8 service nova] Acquiring lock "017caffb-5be2-4e78-ab48-a8091c5c00f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-2e75e69d-35a9-4973-9ca5-51930f73b460 req-6926de0c-cdf5-4006-89ee-69518962a8b8 service nova] Lock "017caffb-5be2-4e78-ab48-a8091c5c00f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-2e75e69d-35a9-4973-9ca5-51930f73b460 req-6926de0c-cdf5-4006-89ee-69518962a8b8 service nova] Lock "017caffb-5be2-4e78-ab48-a8091c5c00f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-2e75e69d-35a9-4973-9ca5-51930f73b460 req-6926de0c-cdf5-4006-89ee-69518962a8b8 service nova] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] No waiting events found dispatching network-vif-unplugged-0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:47:15 user nova-compute[74342]: WARNING nova.compute.manager [req-2e75e69d-35a9-4973-9ca5-51930f73b460 req-6926de0c-cdf5-4006-89ee-69518962a8b8 service nova] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Received unexpected event network-vif-unplugged-0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6 for instance with vm_state active and task_state rebuilding.
Oct 16 09:47:15 user nova-compute[74342]: INFO nova.virt.block_device [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Attempting to driver detach volume 5f8fa500-ec2f-41f3-b6f6-f92655f15d1d from mountpoint /dev/vdb
Oct 16 09:47:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 719428d6-025b-4baa-97a2-c8ebdd49f57e {{(pid=74342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Attempting to detach device vdb from instance 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4 from the persistent domain config. {{(pid=74342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 09:47:15 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:47:15 user nova-compute[74342]:   <source dev="/dev/sde"/>
Oct 16 09:47:15 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:47:15 user nova-compute[74342]:   <serial>5f8fa500-ec2f-41f3-b6f6-f92655f15d1d</serial>
Oct 16 09:47:15 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 16 09:47:15 user nova-compute[74342]: </disk>
Oct 16 09:47:15 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 09:47:15 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Successfully detached device vdb from instance 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4 from the persistent domain config.
Oct 16 09:47:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4 from the live domain config. {{(pid=74342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 09:47:15 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:47:15 user nova-compute[74342]:   <source dev="/dev/sde"/>
Oct 16 09:47:15 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:47:15 user nova-compute[74342]:   <serial>5f8fa500-ec2f-41f3-b6f6-f92655f15d1d</serial>
Oct 16 09:47:15 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 16 09:47:15 user nova-compute[74342]: </disk>
Oct 16 09:47:15 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Acquiring lock "d3ed0377-ff2b-4a15-9175-a70624aa913d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lock "d3ed0377-ff2b-4a15-9175-a70624aa913d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:15 user nova-compute[74342]: INFO nova.compute.manager [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Detaching volume 2f4c6dd9-aa93-4f79-a40f-35156152ef39
Oct 16 09:47:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:16 user nova-compute[74342]: INFO nova.virt.block_device [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Attempting to driver detach volume 2f4c6dd9-aa93-4f79-a40f-35156152ef39 from mountpoint /dev/sdc
Oct 16 09:47:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Attempting to detach device sdc from instance d3ed0377-ff2b-4a15-9175-a70624aa913d from the persistent domain config. {{(pid=74342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 09:47:16 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:47:16 user nova-compute[74342]:   <source dev="/dev/sdc"/>
Oct 16 09:47:16 user nova-compute[74342]:   <target dev="sdc" bus="scsi"/>
Oct 16 09:47:16 user nova-compute[74342]:   <serial>2f4c6dd9-aa93-4f79-a40f-35156152ef39</serial>
Oct 16 09:47:16 user nova-compute[74342]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 16 09:47:16 user nova-compute[74342]: </disk>
Oct 16 09:47:16 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 09:47:16 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Successfully detached device sdc from instance d3ed0377-ff2b-4a15-9175-a70624aa913d from the persistent domain config.
Oct 16 09:47:16 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance d3ed0377-ff2b-4a15-9175-a70624aa913d from the live domain config. {{(pid=74342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 09:47:16 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:47:16 user nova-compute[74342]:   <source dev="/dev/sdc"/>
Oct 16 09:47:16 user nova-compute[74342]:   <target dev="sdc" bus="scsi"/>
Oct 16 09:47:16 user nova-compute[74342]:   <serial>2f4c6dd9-aa93-4f79-a40f-35156152ef39</serial>
Oct 16 09:47:16 user nova-compute[74342]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Oct 16 09:47:16 user nova-compute[74342]: </disk>
Oct 16 09:47:16 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4 {{(pid=74342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance d3ed0377-ff2b-4a15-9175-a70624aa913d {{(pid=74342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 09:47:16 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Instance destroyed successfully.
Oct 16 09:47:16 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Instance destroyed successfully.
Oct 16 09:47:16 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:45:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-615225718',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-6026343',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPciwGhgOXmWKxPktygR+HbYTK8AUs1Crujmt54eoK4xAiI8i1PAFebnNjbXBPGkoIS2iiZYgHukiKRdajQWHqMDi5/QPWZiz5/7sETFrH4JlOPioPfUP9OLnmHgasCJMg==',key_name='tempest-keypair-1307970994',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:45:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='cbba73e7218148b492aca0b1c2673b85',ramdisk_id='',reservation_id='r-pg3x8ny5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1575697015',owner_user_name='tempest-ServerActionsV293TestJSON-1575697015-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:47:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='596268e3d8b7413ba90094ae370971f9',uuid=017caffb-5be2-4e78-ab48-a8091c5c00f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6", "address": "fa:16:3e:56:bd:70", "network": {"id": "9c306d1c-3407-47dd-a04f-e185b1d1788a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1404292047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbba73e7218148b492aca0b1c2673b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad97513-e2", "ovs_interfaceid": "0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Converting VIF {"id": "0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6", "address": "fa:16:3e:56:bd:70", "network": {"id": "9c306d1c-3407-47dd-a04f-e185b1d1788a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1404292047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbba73e7218148b492aca0b1c2673b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad97513-e2", "ovs_interfaceid": "0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:bd:70,bridge_name='br-int',has_traffic_filtering=True,id=0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6,network=Network(9c306d1c-3407-47dd-a04f-e185b1d1788a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad97513-e2') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG os_vif [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:bd:70,bridge_name='br-int',has_traffic_filtering=True,id=0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6,network=Network(9c306d1c-3407-47dd-a04f-e185b1d1788a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad97513-e2') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ad97513-e2, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e87d6e01-15a5-473f-8675-43f3659134e3) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:16 user nova-compute[74342]: INFO os_vif [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:bd:70,bridge_name='br-int',has_traffic_filtering=True,id=0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6,network=Network(9c306d1c-3407-47dd-a04f-e185b1d1788a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad97513-e2')
Oct 16 09:47:16 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QSPrXWFi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:47:16 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 16 09:47:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a7f883-b818-4c92-b25e-60f9a80d76fc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 09:47:16 user nova-compute[74342]: No targets found.
Oct 16 09:47:16 user nova-compute[74342]: iSNS:
Oct 16 09:47:16 user nova-compute[74342]: No targets found.
Oct 16 09:47:16 user nova-compute[74342]: STATIC:
Oct 16 09:47:16 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d
Oct 16 09:47:16 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:47:16 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:47:16 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d
Oct 16 09:47:16 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:47:16 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:47:16 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39
Oct 16 09:47:16 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:47:16 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:47:16 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e
Oct 16 09:47:16 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:47:16 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:47:16 user nova-compute[74342]: FIRMWARE:
Oct 16 09:47:16 user nova-compute[74342]: No targets found.
Oct 16 09:47:16 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 09:47:16 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 09:47:16 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7855196d-4b0c-4f2d-aca8-4edcfe51e980]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a921227-0a3c-41d8-8a71-8c4b9fdd7624]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)
Oct 16 09:47:16 user nova-compute[74342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e (non-flash)
Oct 16 09:47:16 user nova-compute[74342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d (non-flash)
Oct 16 09:47:16 user nova-compute[74342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 (non-flash)
Oct 16 09:47:16 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d (non-flash)
Oct 16 09:47:16 user nova-compute[74342]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e (non-flash)
Oct 16 09:47:16 user nova-compute[74342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d (non-flash)
Oct 16 09:47:16 user nova-compute[74342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 (non-flash)
Oct 16 09:47:16 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b83fd51b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d'): ({'sdb'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Removing single pathed devices sdb {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8a5f21-8673-4d6d-9af7-9d8b69eed0aa]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1b78714-e8dd-43fa-a2d0-061ea562b05b]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Flushing IO for device /dev/sdb {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b3f32d-ab82-40b6-8860-593c9e9779d8]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e230fcdc-5ffc-4bfb-bf72-cac5b4045bef]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[766f5090-ab45-4453-8c9b-2755138991c2]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad3ae93-c980-4a05-814f-1291c4dbf20c]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d, portal: 172.16.0.220,3260]
Oct 16 09:47:17 user nova-compute[74342]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d, portal: 172.16.0.220,3260] successful.
Oct 16 09:47:17 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe14b8bf-63ca-4817-91dd-54950ec36977]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] <== disconnect_volume: return (315ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 09:47:17 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Deleting instance files /opt/stack/data/nova/instances/017caffb-5be2-4e78-ab48-a8091c5c00f4_del
Oct 16 09:47:17 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Deletion of /opt/stack/data/nova/instances/017caffb-5be2-4e78-ab48-a8091c5c00f4_del complete
Oct 16 09:47:17 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 017caffb-5be2-4e78-ab48-a8091c5c00f4 could not be found.
Oct 16 09:47:17 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QSPrXWFi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:47:17 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 16 09:47:17 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d969be96-0ebf-4277-b50d-61311b1a4935]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 09:47:17 user nova-compute[74342]: No targets found.
Oct 16 09:47:17 user nova-compute[74342]: iSNS:
Oct 16 09:47:17 user nova-compute[74342]: No targets found.
Oct 16 09:47:17 user nova-compute[74342]: STATIC:
Oct 16 09:47:17 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d
Oct 16 09:47:17 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:47:17 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:47:17 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39
Oct 16 09:47:17 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:47:17 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:47:17 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e
Oct 16 09:47:17 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:47:17 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:47:17 user nova-compute[74342]: FIRMWARE:
Oct 16 09:47:17 user nova-compute[74342]: No targets found.
Oct 16 09:47:17 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 09:47:17 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 09:47:17 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5eeaad-af36-4322-a226-3b106b051bd0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a24abe7a-b45d-4cbe-8569-e2aff2bfbdca]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e (non-flash)
Oct 16 09:47:17 user nova-compute[74342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d (non-flash)
Oct 16 09:47:17 user nova-compute[74342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 (non-flash)
Oct 16 09:47:17 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e (non-flash)
Oct 16 09:47:17 user nova-compute[74342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d (non-flash)
Oct 16 09:47:17 user nova-compute[74342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 (non-flash)
Oct 16 09:47:17 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b83fd71c0>, {}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Disconnecting from: [] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.083s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] <== disconnect_volume: return (85ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG nova.compute.manager [req-ca290e56-9d17-4cb5-8777-805a2c348315 req-12e10170-88cc-4350-b5a4-4273e2455e2a service nova] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Received event network-vif-plugged-0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ca290e56-9d17-4cb5-8777-805a2c348315 req-12e10170-88cc-4350-b5a4-4273e2455e2a service nova] Acquiring lock "017caffb-5be2-4e78-ab48-a8091c5c00f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ca290e56-9d17-4cb5-8777-805a2c348315 req-12e10170-88cc-4350-b5a4-4273e2455e2a service nova] Lock "017caffb-5be2-4e78-ab48-a8091c5c00f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ca290e56-9d17-4cb5-8777-805a2c348315 req-12e10170-88cc-4350-b5a4-4273e2455e2a service nova] Lock "017caffb-5be2-4e78-ab48-a8091c5c00f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:17 user nova-compute[74342]: DEBUG nova.compute.manager [req-ca290e56-9d17-4cb5-8777-805a2c348315 req-12e10170-88cc-4350-b5a4-4273e2455e2a service nova] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] No waiting events found dispatching network-vif-plugged-0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:47:17 user nova-compute[74342]: WARNING nova.compute.manager [req-ca290e56-9d17-4cb5-8777-805a2c348315 req-12e10170-88cc-4350-b5a4-4273e2455e2a service nova] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Received unexpected event network-vif-plugged-0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6 for instance with vm_state active and task_state rebuilding.
Oct 16 09:47:18 user nova-compute[74342]: DEBUG nova.compute.manager [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Preparing to wait for external event volume-reimaged-fe2aa7c1-4340-4adb-915f-3be7ae4a985d {{(pid=74342) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Oct 16 09:47:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Acquiring lock "017caffb-5be2-4e78-ab48-a8091c5c00f4-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Lock "017caffb-5be2-4e78-ab48-a8091c5c00f4-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Lock "017caffb-5be2-4e78-ab48-a8091c5c00f4-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:18 user nova-compute[74342]: DEBUG nova.network.neutron [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:47:18 user nova-compute[74342]: INFO nova.compute.manager [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Took 3.29 seconds to deallocate network for instance.
Oct 16 09:47:18 user nova-compute[74342]: DEBUG nova.compute.manager [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Detaching volume: 5b359a4f-7da7-4706-82e6-349e2d0c39c7 {{(pid=74342) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Oct 16 09:47:18 user nova-compute[74342]: INFO nova.compute.manager [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Detaching volume 5b359a4f-7da7-4706-82e6-349e2d0c39c7
Oct 16 09:47:18 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Skipping driver_detach during remote rebuild. {{(pid=74342) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Oct 16 09:47:19 user nova-compute[74342]: WARNING nova.compute.manager [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Failed to detach volume: 5b359a4f-7da7-4706-82e6-349e2d0c39c7 due to 'NoneType' object has no attribute 'devices'
Oct 16 09:47:19 user nova-compute[74342]: DEBUG nova.compute.manager [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Detaching volume: e812ff78-fd6a-453f-a3e3-82ff43a99b44 {{(pid=74342) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Oct 16 09:47:19 user nova-compute[74342]: INFO nova.compute.manager [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Detaching volume e812ff78-fd6a-453f-a3e3-82ff43a99b44
Oct 16 09:47:19 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Skipping driver_detach during remote rebuild. {{(pid=74342) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Oct 16 09:47:20 user nova-compute[74342]: WARNING nova.compute.manager [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Failed to detach volume: e812ff78-fd6a-453f-a3e3-82ff43a99b44 due to 'NoneType' object has no attribute 'devices'
Oct 16 09:47:20 user nova-compute[74342]: DEBUG nova.compute.manager [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Detaching volume: f6dacc5c-08b8-448c-9f43-e53e59704e05 {{(pid=74342) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Oct 16 09:47:20 user nova-compute[74342]: INFO nova.compute.manager [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Detaching volume f6dacc5c-08b8-448c-9f43-e53e59704e05
Oct 16 09:47:20 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] [instance: 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5] Skipping driver_detach during remote rebuild. {{(pid=74342) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Oct 16 09:47:20 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Deleted allocations for instance 79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5
Oct 16 09:47:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-26bef127-3032-4526-b8e3-6d78a9142a8f tempest-TaggedBootDevicesTest-1477645559 tempest-TaggedBootDevicesTest-1477645559-project-member] Lock "79e27c8c-ff77-4cf4-a66a-d5d0b5296ec5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 82.609s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.volume.cinder [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Update attachment failed for attachment 9a1c3d03-6c96-4b81-b72b-542c7d456ec1. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5243ee2f-1a5b-4a01-8c1a-d37a77bbcdee) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5243ee2f-1a5b-4a01-8c1a-d37a77bbcdee)
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5243ee2f-1a5b-4a01-8c1a-d37a77bbcdee)
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Traceback (most recent call last):
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]     driver_block_device.attach_block_devices(
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]     _log_and_attach(device)
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]     bdm.attach(*attach_args, **attach_kwargs)
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]     ret_val = method(obj, context, *args, **kwargs)
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]     self._do_attach(context, instance, volume, volume_api,
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]     self._volume_attach(context, volume, connector, instance,
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]     connection_info = volume_api.attachment_update(
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]     res = method(self, ctx, *args, **kwargs)
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]     with excutils.save_and_reraise_exception():
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]     self.force_reraise()
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]     raise self.value
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]     context, '3.44', skip_version_check=True).attachments.update(
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]     return method.func(obj, *args, **kwargs)
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]     resp = self._update('/attachments/%s' % id, body)
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]     return self._cs_request(url, 'PUT', **kwargs)
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]     return self.request(url, method, **kwargs)
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27]     raise exceptions.from_response(resp, body)
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5243ee2f-1a5b-4a01-8c1a-d37a77bbcdee)
Oct 16 09:47:20 user nova-compute[74342]: ERROR nova.compute.manager [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] 
Oct 16 09:47:20 user nova-compute[74342]: DEBUG nova.compute.claims [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Aborting claim: <nova.compute.claims.Claim object at 0x7f2b801a2410> {{(pid=74342) abort /opt/stack/nova/nova/compute/claims.py:84}}
Oct 16 09:47:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.379s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG nova.compute.manager [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Build of instance 347c7f16-6bd0-4a51-b40a-1d9d705acc27 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5243ee2f-1a5b-4a01-8c1a-d37a77bbcdee) {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG nova.compute.utils [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Build of instance 347c7f16-6bd0-4a51-b40a-1d9d705acc27 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=74342) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Oct 16 09:47:21 user nova-compute[74342]: ERROR nova.compute.manager [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Build of instance 347c7f16-6bd0-4a51-b40a-1d9d705acc27 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5243ee2f-1a5b-4a01-8c1a-d37a77bbcdee): nova.exception.BuildAbortException: Build of instance 347c7f16-6bd0-4a51-b40a-1d9d705acc27 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-5243ee2f-1a5b-4a01-8c1a-d37a77bbcdee)
Oct 16 09:47:21 user nova-compute[74342]: DEBUG nova.compute.manager [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Unplugging VIFs for instance {{(pid=74342) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T09:45:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-939582709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-939582709',id=10,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFL2a0dPx9IUjSNeyDHnw3YNse+Rjl4IPS+dVggjyzrum8Wsz+oFxhbB8Z2kb9InIY1DznDWT858GfhzOSi9VXUYNO9rhqKlHvjMF2x++LbIOg4yPYaGSWNgVCYj/ffd6w==',key_name='tempest-keypair-200879109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b01b25d1cea4707925f30c00ae5b22c',ramdisk_id='',reservation_id='r-tjcqf32v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-883246743',owner_user_name='tempest-TaggedBootDevicesTest_v242-883246743-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:45:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fab6c328617247fcb87f3470224ff649',uuid=347c7f16-6bd0-4a51-b40a-1d9d705acc27,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0a154df-669a-4799-9ed9-ccb9f0790d74", "address": "fa:16:3e:45:5d:be", "network": {"id": "2dfb7a78-ecff-4578-8d70-1ba2afeae38a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1942641106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a154df-66", "ovs_interfaceid": "a0a154df-669a-4799-9ed9-ccb9f0790d74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Converting VIF {"id": "a0a154df-669a-4799-9ed9-ccb9f0790d74", "address": "fa:16:3e:45:5d:be", "network": {"id": "2dfb7a78-ecff-4578-8d70-1ba2afeae38a", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1942641106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0a154df-66", "ovs_interfaceid": "a0a154df-669a-4799-9ed9-ccb9f0790d74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:5d:be,bridge_name='br-int',has_traffic_filtering=True,id=a0a154df-669a-4799-9ed9-ccb9f0790d74,network=Network(2dfb7a78-ecff-4578-8d70-1ba2afeae38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a154df-66') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG os_vif [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:5d:be,bridge_name='br-int',has_traffic_filtering=True,id=a0a154df-669a-4799-9ed9-ccb9f0790d74,network=Network(2dfb7a78-ecff-4578-8d70-1ba2afeae38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a154df-66') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0a154df-66, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:47:21 user nova-compute[74342]: INFO os_vif [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:5d:be,bridge_name='br-int',has_traffic_filtering=True,id=a0a154df-669a-4799-9ed9-ccb9f0790d74,network=Network(2dfb7a78-ecff-4578-8d70-1ba2afeae38a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0a154df-66')
Oct 16 09:47:21 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T09:45:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-939582709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-939582709',id=10,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFL2a0dPx9IUjSNeyDHnw3YNse+Rjl4IPS+dVggjyzrum8Wsz+oFxhbB8Z2kb9InIY1DznDWT858GfhzOSi9VXUYNO9rhqKlHvjMF2x++LbIOg4yPYaGSWNgVCYj/ffd6w==',key_name='tempest-keypair-200879109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b01b25d1cea4707925f30c00ae5b22c',ramdisk_id='',reservation_id='r-tjcqf32v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-883246743',owner_user_name='tempest-TaggedBootDevicesTest_v242-883246743-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:45:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fab6c328617247fcb87f3470224ff649',uuid=347c7f16-6bd0-4a51-b40a-1d9d705acc27,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "173fea01-20c0-43e0-9d3b-5435bceb4f12", "address": "fa:16:3e:7a:a3:e1", "network": {"id": "578174b2-6a57-4658-b908-8da7864bf01b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1858898971", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap173fea01-20", "ovs_interfaceid": "173fea01-20c0-43e0-9d3b-5435bceb4f12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Converting VIF {"id": "173fea01-20c0-43e0-9d3b-5435bceb4f12", "address": "fa:16:3e:7a:a3:e1", "network": {"id": "578174b2-6a57-4658-b908-8da7864bf01b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1858898971", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.168", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap173fea01-20", "ovs_interfaceid": "173fea01-20c0-43e0-9d3b-5435bceb4f12", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:a3:e1,bridge_name='br-int',has_traffic_filtering=True,id=173fea01-20c0-43e0-9d3b-5435bceb4f12,network=Network(578174b2-6a57-4658-b908-8da7864bf01b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap173fea01-20') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG os_vif [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:a3:e1,bridge_name='br-int',has_traffic_filtering=True,id=173fea01-20c0-43e0-9d3b-5435bceb4f12,network=Network(578174b2-6a57-4658-b908-8da7864bf01b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap173fea01-20') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap173fea01-20, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:47:21 user nova-compute[74342]: INFO os_vif [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:a3:e1,bridge_name='br-int',has_traffic_filtering=True,id=173fea01-20c0-43e0-9d3b-5435bceb4f12,network=Network(578174b2-6a57-4658-b908-8da7864bf01b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap173fea01-20')
Oct 16 09:47:21 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T09:45:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-939582709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-939582709',id=10,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFL2a0dPx9IUjSNeyDHnw3YNse+Rjl4IPS+dVggjyzrum8Wsz+oFxhbB8Z2kb9InIY1DznDWT858GfhzOSi9VXUYNO9rhqKlHvjMF2x++LbIOg4yPYaGSWNgVCYj/ffd6w==',key_name='tempest-keypair-200879109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b01b25d1cea4707925f30c00ae5b22c',ramdisk_id='',reservation_id='r-tjcqf32v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-883246743',owner_user_name='tempest-TaggedBootDevicesTest_v242-883246743-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:45:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fab6c328617247fcb87f3470224ff649',uuid=347c7f16-6bd0-4a51-b40a-1d9d705acc27,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b723dc46-4fec-4be3-ba77-33792c72330b", "address": "fa:16:3e:5d:22:04", "network": {"id": "578174b2-6a57-4658-b908-8da7864bf01b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1858898971", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb723dc46-4f", "ovs_interfaceid": "b723dc46-4fec-4be3-ba77-33792c72330b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Converting VIF {"id": "b723dc46-4fec-4be3-ba77-33792c72330b", "address": "fa:16:3e:5d:22:04", "network": {"id": "578174b2-6a57-4658-b908-8da7864bf01b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1858898971", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.16", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb723dc46-4f", "ovs_interfaceid": "b723dc46-4fec-4be3-ba77-33792c72330b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5d:22:04,bridge_name='br-int',has_traffic_filtering=True,id=b723dc46-4fec-4be3-ba77-33792c72330b,network=Network(578174b2-6a57-4658-b908-8da7864bf01b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb723dc46-4f') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG os_vif [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:22:04,bridge_name='br-int',has_traffic_filtering=True,id=b723dc46-4fec-4be3-ba77-33792c72330b,network=Network(578174b2-6a57-4658-b908-8da7864bf01b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb723dc46-4f') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb723dc46-4f, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:47:21 user nova-compute[74342]: INFO os_vif [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5d:22:04,bridge_name='br-int',has_traffic_filtering=True,id=b723dc46-4fec-4be3-ba77-33792c72330b,network=Network(578174b2-6a57-4658-b908-8da7864bf01b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapb723dc46-4f')
Oct 16 09:47:21 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T09:45:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-939582709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-939582709',id=10,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFL2a0dPx9IUjSNeyDHnw3YNse+Rjl4IPS+dVggjyzrum8Wsz+oFxhbB8Z2kb9InIY1DznDWT858GfhzOSi9VXUYNO9rhqKlHvjMF2x++LbIOg4yPYaGSWNgVCYj/ffd6w==',key_name='tempest-keypair-200879109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b01b25d1cea4707925f30c00ae5b22c',ramdisk_id='',reservation_id='r-tjcqf32v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-883246743',owner_user_name='tempest-TaggedBootDevicesTest_v242-883246743-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:45:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fab6c328617247fcb87f3470224ff649',uuid=347c7f16-6bd0-4a51-b40a-1d9d705acc27,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f1019bc-8ce5-4b55-972b-25f0d84b47b5", "address": "fa:16:3e:9a:59:ea", "network": {"id": "578174b2-6a57-4658-b908-8da7864bf01b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1858898971", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1019bc-8c", "ovs_interfaceid": "0f1019bc-8ce5-4b55-972b-25f0d84b47b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Converting VIF {"id": "0f1019bc-8ce5-4b55-972b-25f0d84b47b5", "address": "fa:16:3e:9a:59:ea", "network": {"id": "578174b2-6a57-4658-b908-8da7864bf01b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1858898971", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f1019bc-8c", "ovs_interfaceid": "0f1019bc-8ce5-4b55-972b-25f0d84b47b5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:59:ea,bridge_name='br-int',has_traffic_filtering=True,id=0f1019bc-8ce5-4b55-972b-25f0d84b47b5,network=Network(578174b2-6a57-4658-b908-8da7864bf01b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f1019bc-8c') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG os_vif [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:59:ea,bridge_name='br-int',has_traffic_filtering=True,id=0f1019bc-8ce5-4b55-972b-25f0d84b47b5,network=Network(578174b2-6a57-4658-b908-8da7864bf01b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f1019bc-8c') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f1019bc-8c, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:47:21 user nova-compute[74342]: INFO os_vif [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:59:ea,bridge_name='br-int',has_traffic_filtering=True,id=0f1019bc-8ce5-4b55-972b-25f0d84b47b5,network=Network(578174b2-6a57-4658-b908-8da7864bf01b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f1019bc-8c')
Oct 16 09:47:21 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T09:45:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-939582709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-939582709',id=10,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFL2a0dPx9IUjSNeyDHnw3YNse+Rjl4IPS+dVggjyzrum8Wsz+oFxhbB8Z2kb9InIY1DznDWT858GfhzOSi9VXUYNO9rhqKlHvjMF2x++LbIOg4yPYaGSWNgVCYj/ffd6w==',key_name='tempest-keypair-200879109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b01b25d1cea4707925f30c00ae5b22c',ramdisk_id='',reservation_id='r-tjcqf32v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-883246743',owner_user_name='tempest-TaggedBootDevicesTest_v242-883246743-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:45:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fab6c328617247fcb87f3470224ff649',uuid=347c7f16-6bd0-4a51-b40a-1d9d705acc27,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13518a35-eebd-4937-a344-06940941505a", "address": "fa:16:3e:89:52:f3", "network": {"id": "578174b2-6a57-4658-b908-8da7864bf01b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1858898971", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13518a35-ee", "ovs_interfaceid": "13518a35-eebd-4937-a344-06940941505a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Converting VIF {"id": "13518a35-eebd-4937-a344-06940941505a", "address": "fa:16:3e:89:52:f3", "network": {"id": "578174b2-6a57-4658-b908-8da7864bf01b", "bridge": "br-int", "label": "tempest-device-tagging-net1-1858898971", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.48", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap13518a35-ee", "ovs_interfaceid": "13518a35-eebd-4937-a344-06940941505a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:52:f3,bridge_name='br-int',has_traffic_filtering=True,id=13518a35-eebd-4937-a344-06940941505a,network=Network(578174b2-6a57-4658-b908-8da7864bf01b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13518a35-ee') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG os_vif [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:52:f3,bridge_name='br-int',has_traffic_filtering=True,id=13518a35-eebd-4937-a344-06940941505a,network=Network(578174b2-6a57-4658-b908-8da7864bf01b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13518a35-ee') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap13518a35-ee, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:47:21 user nova-compute[74342]: INFO os_vif [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:52:f3,bridge_name='br-int',has_traffic_filtering=True,id=13518a35-eebd-4937-a344-06940941505a,network=Network(578174b2-6a57-4658-b908-8da7864bf01b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13518a35-ee')
Oct 16 09:47:21 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T09:45:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-939582709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-939582709',id=10,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFL2a0dPx9IUjSNeyDHnw3YNse+Rjl4IPS+dVggjyzrum8Wsz+oFxhbB8Z2kb9InIY1DznDWT858GfhzOSi9VXUYNO9rhqKlHvjMF2x++LbIOg4yPYaGSWNgVCYj/ffd6w==',key_name='tempest-keypair-200879109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b01b25d1cea4707925f30c00ae5b22c',ramdisk_id='',reservation_id='r-tjcqf32v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-883246743',owner_user_name='tempest-TaggedBootDevicesTest_v242-883246743-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:45:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fab6c328617247fcb87f3470224ff649',uuid=347c7f16-6bd0-4a51-b40a-1d9d705acc27,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6ed92d36-33db-4d62-abe8-6ddc1961a364", "address": "fa:16:3e:f2:10:1e", "network": {"id": "f17d2296-784e-415b-9d03-fda53086e730", "bridge": "br-int", "label": "tempest-device-tagging-net2-1505077802", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed92d36-33", "ovs_interfaceid": "6ed92d36-33db-4d62-abe8-6ddc1961a364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Converting VIF {"id": "6ed92d36-33db-4d62-abe8-6ddc1961a364", "address": "fa:16:3e:f2:10:1e", "network": {"id": "f17d2296-784e-415b-9d03-fda53086e730", "bridge": "br-int", "label": "tempest-device-tagging-net2-1505077802", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6ed92d36-33", "ovs_interfaceid": "6ed92d36-33db-4d62-abe8-6ddc1961a364", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:10:1e,bridge_name='br-int',has_traffic_filtering=True,id=6ed92d36-33db-4d62-abe8-6ddc1961a364,network=Network(f17d2296-784e-415b-9d03-fda53086e730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed92d36-33') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG os_vif [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:10:1e,bridge_name='br-int',has_traffic_filtering=True,id=6ed92d36-33db-4d62-abe8-6ddc1961a364,network=Network(f17d2296-784e-415b-9d03-fda53086e730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed92d36-33') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6ed92d36-33, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:47:21 user nova-compute[74342]: INFO os_vif [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:10:1e,bridge_name='br-int',has_traffic_filtering=True,id=6ed92d36-33db-4d62-abe8-6ddc1961a364,network=Network(f17d2296-784e-415b-9d03-fda53086e730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6ed92d36-33')
Oct 16 09:47:21 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T09:45:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-939582709',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-939582709',id=10,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFL2a0dPx9IUjSNeyDHnw3YNse+Rjl4IPS+dVggjyzrum8Wsz+oFxhbB8Z2kb9InIY1DznDWT858GfhzOSi9VXUYNO9rhqKlHvjMF2x++LbIOg4yPYaGSWNgVCYj/ffd6w==',key_name='tempest-keypair-200879109',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8b01b25d1cea4707925f30c00ae5b22c',ramdisk_id='',reservation_id='r-tjcqf32v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-883246743',owner_user_name='tempest-TaggedBootDevicesTest_v242-883246743-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:45:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='fab6c328617247fcb87f3470224ff649',uuid=347c7f16-6bd0-4a51-b40a-1d9d705acc27,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "349cab86-e97a-496e-936b-53dbfbfc694e", "address": "fa:16:3e:a5:7a:06", "network": {"id": "f17d2296-784e-415b-9d03-fda53086e730", "bridge": "br-int", "label": "tempest-device-tagging-net2-1505077802", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap349cab86-e9", "ovs_interfaceid": "349cab86-e97a-496e-936b-53dbfbfc694e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Converting VIF {"id": "349cab86-e97a-496e-936b-53dbfbfc694e", "address": "fa:16:3e:a5:7a:06", "network": {"id": "f17d2296-784e-415b-9d03-fda53086e730", "bridge": "br-int", "label": "tempest-device-tagging-net2-1505077802", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "8b01b25d1cea4707925f30c00ae5b22c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap349cab86-e9", "ovs_interfaceid": "349cab86-e97a-496e-936b-53dbfbfc694e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a5:7a:06,bridge_name='br-int',has_traffic_filtering=True,id=349cab86-e97a-496e-936b-53dbfbfc694e,network=Network(f17d2296-784e-415b-9d03-fda53086e730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap349cab86-e9') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG os_vif [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:7a:06,bridge_name='br-int',has_traffic_filtering=True,id=349cab86-e97a-496e-936b-53dbfbfc694e,network=Network(f17d2296-784e-415b-9d03-fda53086e730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap349cab86-e9') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap349cab86-e9, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:47:21 user nova-compute[74342]: INFO os_vif [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a5:7a:06,bridge_name='br-int',has_traffic_filtering=True,id=349cab86-e97a-496e-936b-53dbfbfc694e,network=Network(f17d2296-784e-415b-9d03-fda53086e730),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap349cab86-e9')
Oct 16 09:47:21 user nova-compute[74342]: DEBUG nova.compute.manager [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Unplugged VIFs for instance {{(pid=74342) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG nova.compute.manager [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG nova.network.neutron [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 09:47:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:24 user nova-compute[74342]: DEBUG nova.network.neutron [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:47:24 user nova-compute[74342]: INFO nova.compute.manager [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Took 2.92 seconds to deallocate network for instance.
Oct 16 09:47:24 user nova-compute[74342]: DEBUG nova.compute.manager [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Detaching volume: f090ed4a-db48-4b4a-b057-b343afc8f498 {{(pid=74342) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Oct 16 09:47:24 user nova-compute[74342]: INFO nova.compute.manager [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Detaching volume f090ed4a-db48-4b4a-b057-b343afc8f498
Oct 16 09:47:24 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Skipping driver_detach during remote rebuild. {{(pid=74342) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Oct 16 09:47:25 user nova-compute[74342]: WARNING nova.compute.manager [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Failed to detach volume: f090ed4a-db48-4b4a-b057-b343afc8f498 due to 'NoneType' object has no attribute 'devices'
Oct 16 09:47:25 user nova-compute[74342]: DEBUG nova.compute.manager [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Detaching volume: 6cd07ef1-0354-4cfd-82a8-08c488a5641d {{(pid=74342) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Oct 16 09:47:25 user nova-compute[74342]: INFO nova.compute.manager [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Detaching volume 6cd07ef1-0354-4cfd-82a8-08c488a5641d
Oct 16 09:47:25 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Skipping driver_detach during remote rebuild. {{(pid=74342) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Oct 16 09:47:25 user nova-compute[74342]: WARNING nova.compute.manager [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Failed to detach volume: 6cd07ef1-0354-4cfd-82a8-08c488a5641d due to 'NoneType' object has no attribute 'devices'
Oct 16 09:47:25 user nova-compute[74342]: DEBUG nova.compute.manager [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Detaching volume: 47e3235c-fa0b-4896-ab7c-eea043469405 {{(pid=74342) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Oct 16 09:47:25 user nova-compute[74342]: INFO nova.compute.manager [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Detaching volume 47e3235c-fa0b-4896-ab7c-eea043469405
Oct 16 09:47:26 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] [instance: 347c7f16-6bd0-4a51-b40a-1d9d705acc27] Skipping driver_detach during remote rebuild. {{(pid=74342) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Oct 16 09:47:26 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Deleted allocations for instance 347c7f16-6bd0-4a51-b40a-1d9d705acc27
Oct 16 09:47:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e9ed11bb-5086-4efd-ba8c-db6b967c6084 tempest-TaggedBootDevicesTest_v242-883246743 tempest-TaggedBootDevicesTest_v242-883246743-project-member] Lock "347c7f16-6bd0-4a51-b40a-1d9d705acc27" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 98.188s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.volume.cinder [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Update attachment failed for attachment 678ed51a-8dcc-4812-bb61-0ca9be97696c. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3591cefc-08db-411b-8c0b-c09e0954a50e) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3591cefc-08db-411b-8c0b-c09e0954a50e)
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3591cefc-08db-411b-8c0b-c09e0954a50e)
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Traceback (most recent call last):
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]     driver_block_device.attach_block_devices(
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]     _log_and_attach(device)
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]     bdm.attach(*attach_args, **attach_kwargs)
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]   File "/opt/stack/nova/nova/virt/block_device.py", line 852, in attach
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]     super(DriverVolBlankBlockDevice, self).attach(
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]     ret_val = method(obj, context, *args, **kwargs)
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]     self._do_attach(context, instance, volume, volume_api,
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]     self._volume_attach(context, volume, connector, instance,
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]     connection_info = volume_api.attachment_update(
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]     res = method(self, ctx, *args, **kwargs)
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]     with excutils.save_and_reraise_exception():
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]     self.force_reraise()
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]     raise self.value
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]     context, '3.44', skip_version_check=True).attachments.update(
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]     return method.func(obj, *args, **kwargs)
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]     resp = self._update('/attachments/%s' % id, body)
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]     return self._cs_request(url, 'PUT', **kwargs)
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]     return self.request(url, method, **kwargs)
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f]     raise exceptions.from_response(resp, body)
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3591cefc-08db-411b-8c0b-c09e0954a50e)
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] 
Oct 16 09:47:26 user nova-compute[74342]: DEBUG nova.compute.claims [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Aborting claim: <nova.compute.claims.Claim object at 0x7f2b60685660> {{(pid=74342) abort /opt/stack/nova/nova/compute/claims.py:84}}
Oct 16 09:47:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:26 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:47:26 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:47:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.340s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:26 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Build of instance 16d64ca5-035b-4c15-a6ec-7c0dfe64724f aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3591cefc-08db-411b-8c0b-c09e0954a50e) {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Oct 16 09:47:26 user nova-compute[74342]: DEBUG nova.compute.utils [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Build of instance 16d64ca5-035b-4c15-a6ec-7c0dfe64724f aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=74342) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Oct 16 09:47:26 user nova-compute[74342]: ERROR nova.compute.manager [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Build of instance 16d64ca5-035b-4c15-a6ec-7c0dfe64724f aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3591cefc-08db-411b-8c0b-c09e0954a50e): nova.exception.BuildAbortException: Build of instance 16d64ca5-035b-4c15-a6ec-7c0dfe64724f aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-3591cefc-08db-411b-8c0b-c09e0954a50e)
Oct 16 09:47:26 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Unplugging VIFs for instance {{(pid=74342) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Oct 16 09:47:26 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:46:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2080310587',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-2080310587',id=12,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4fcf2437a2d413ea584d0cc2508bed3',ramdisk_id='',reservation_id='r-kka0rodx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-476995503',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:46:55Z,user_data=None,user_id='f90f091b76254a13957807feaeaef3fc',uuid=16d64ca5-035b-4c15-a6ec-7c0dfe64724f,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0cf84b4d-3498-43f4-a970-758aa193bb1e", "address": "fa:16:3e:2a:64:44", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf84b4d-34", "ovs_interfaceid": "0cf84b4d-3498-43f4-a970-758aa193bb1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:47:26 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Converting VIF {"id": "0cf84b4d-3498-43f4-a970-758aa193bb1e", "address": "fa:16:3e:2a:64:44", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0cf84b4d-34", "ovs_interfaceid": "0cf84b4d-3498-43f4-a970-758aa193bb1e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:47:26 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:64:44,bridge_name='br-int',has_traffic_filtering=True,id=0cf84b4d-3498-43f4-a970-758aa193bb1e,network=Network(a571ad70-6f8b-4b02-86b9-df50290509f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cf84b4d-34') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:47:26 user nova-compute[74342]: DEBUG os_vif [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:64:44,bridge_name='br-int',has_traffic_filtering=True,id=0cf84b4d-3498-43f4-a970-758aa193bb1e,network=Network(a571ad70-6f8b-4b02-86b9-df50290509f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cf84b4d-34') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:47:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0cf84b4d-34, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:47:26 user nova-compute[74342]: INFO os_vif [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:64:44,bridge_name='br-int',has_traffic_filtering=True,id=0cf84b4d-3498-43f4-a970-758aa193bb1e,network=Network(a571ad70-6f8b-4b02-86b9-df50290509f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0cf84b4d-34')
Oct 16 09:47:26 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Unplugged VIFs for instance {{(pid=74342) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Oct 16 09:47:26 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 09:47:26 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 09:47:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:27 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:47:27 user nova-compute[74342]: INFO nova.compute.manager [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Took 0.43 seconds to deallocate network for instance.
Oct 16 09:47:27 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Detaching volume: f9263ebe-08b4-4419-a820-16c361747637 {{(pid=74342) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Oct 16 09:47:27 user nova-compute[74342]: INFO nova.compute.manager [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Detaching volume f9263ebe-08b4-4419-a820-16c361747637
Oct 16 09:47:27 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 16d64ca5-035b-4c15-a6ec-7c0dfe64724f] Skipping driver_detach during remote rebuild. {{(pid=74342) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Oct 16 09:47:27 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Deleted allocations for instance 16d64ca5-035b-4c15-a6ec-7c0dfe64724f
Oct 16 09:47:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c02a2723-469c-465b-9bfd-e64113ca76d9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "16d64ca5-035b-4c15-a6ec-7c0dfe64724f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.352s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:47:35 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 719428d6-025b-4baa-97a2-c8ebdd49f57e is timed out.
Oct 16 09:47:35 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Successfully detached device vdb from instance 719428d6-025b-4baa-97a2-c8ebdd49f57e from the live domain config.
Oct 16 09:47:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ARmpJenS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:47:35 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:47:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee42814-aec2-4601-8aeb-8a73ff7fadad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 09:47:35 user nova-compute[74342]: No targets found.
Oct 16 09:47:35 user nova-compute[74342]: iSNS:
Oct 16 09:47:35 user nova-compute[74342]: No targets found.
Oct 16 09:47:35 user nova-compute[74342]: STATIC:
Oct 16 09:47:35 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d
Oct 16 09:47:35 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:47:35 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:47:35 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39
Oct 16 09:47:35 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:47:35 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:47:35 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e
Oct 16 09:47:35 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:47:35 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:47:35 user nova-compute[74342]: FIRMWARE:
Oct 16 09:47:35 user nova-compute[74342]: No targets found.
Oct 16 09:47:35 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 09:47:35 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 09:47:35 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2795a557-eec0-4034-9c12-406186ce695e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b836264a-0576-4c6a-847c-1fe02a6e1f0b]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e (non-flash)
Oct 16 09:47:35 user nova-compute[74342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d (non-flash)
Oct 16 09:47:35 user nova-compute[74342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 (non-flash)
Oct 16 09:47:35 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e (non-flash)
Oct 16 09:47:35 user nova-compute[74342]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d (non-flash)
Oct 16 09:47:35 user nova-compute[74342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 (non-flash)
Oct 16 09:47:35 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b801ed990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e'): ({'sdd'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Removing single pathed devices sdd {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9219102d-78ae-48b4-8b58-e22668577969]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a44a984-7901-4685-ba24-c33919b5e811]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Flushing IO for device /dev/sdd {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d7c38e-961a-4e34-9ccf-a0010d56a1aa]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[acd896cb-1b00-4d0f-ba57-0b408b610ef6]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] SCSI volumes sdd have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[473e594e-54b9-491d-a5ee-6f2e22184ff4]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[271e6f16-03f0-485e-a80f-b661c116a66e]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e, portal: 172.16.0.220,3260]
Oct 16 09:47:35 user nova-compute[74342]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e, portal: 172.16.0.220,3260] successful.
Oct 16 09:47:35 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2aa56297-5103-428d-b382-19e18719567e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[babf8f5a-65c8-4b22-a5fd-d5433be1822e]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] <== disconnect_volume: return (306ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 09:47:36 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4 is timed out.
Oct 16 09:47:36 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Successfully detached device vdb from instance 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4 from the live domain config.
Oct 16 09:47:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'lgIoXhvP', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:47:36 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77e32ea-3195-4321-84d2-6980089a08f1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 09:47:36 user nova-compute[74342]: No targets found.
Oct 16 09:47:36 user nova-compute[74342]: iSNS:
Oct 16 09:47:36 user nova-compute[74342]: No targets found.
Oct 16 09:47:36 user nova-compute[74342]: STATIC:
Oct 16 09:47:36 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d
Oct 16 09:47:36 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:47:36 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:47:36 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39
Oct 16 09:47:36 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:47:36 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:47:36 user nova-compute[74342]: FIRMWARE:
Oct 16 09:47:36 user nova-compute[74342]: No targets found.
Oct 16 09:47:36 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 09:47:36 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 09:47:36 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e3fa4b-c085-47de-bac9-39ea01f8eb79]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7331849f-9da1-4abc-ade2-2034df2f88b5]: (4, ('tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d (non-flash)
Oct 16 09:47:36 user nova-compute[74342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 (non-flash)
Oct 16 09:47:36 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] iscsi session list stdout=tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d (non-flash)
Oct 16 09:47:36 user nova-compute[74342]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 (non-flash)
Oct 16 09:47:36 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b607ad630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d'): ({'sde'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Removing single pathed devices sde {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[76af9919-f137-4ad3-b1f5-c48eeb8aab63]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef26e25-377d-4d1c-b672-8f5167cd36e7]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Flushing IO for device /dev/sde {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cad09d6-add9-42ce-a302-b3347c9cc7d0]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e60e73c-274c-43b8-a836-6c9be2e3253a]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] SCSI volumes sde have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c71b6b7-d04e-4b10-b7a8-e7d7431386bb]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44d489a-245d-41c6-933f-3121fa2545c1]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d, portal: 172.16.0.220,3260]
Oct 16 09:47:36 user nova-compute[74342]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d, portal: 172.16.0.220,3260] successful.
Oct 16 09:47:36 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f8fa500-ec2f-41f3-b6f6-f92655f15d1d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3713c698-1713-4a78-b35c-7de8f8b3e9c9]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] <== disconnect_volume: return (299ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 09:47:36 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance d3ed0377-ff2b-4a15-9175-a70624aa913d is timed out.
Oct 16 09:47:36 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Successfully detached device sdc from instance d3ed0377-ff2b-4a15-9175-a70624aa913d from the live domain config.
Oct 16 09:47:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dvRwjGpQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:47:36 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb10975-ed89-408b-95dc-c91a1a240643]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 09:47:36 user nova-compute[74342]: No targets found.
Oct 16 09:47:36 user nova-compute[74342]: iSNS:
Oct 16 09:47:36 user nova-compute[74342]: No targets found.
Oct 16 09:47:36 user nova-compute[74342]: STATIC:
Oct 16 09:47:36 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39
Oct 16 09:47:36 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:47:36 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:47:36 user nova-compute[74342]: FIRMWARE:
Oct 16 09:47:36 user nova-compute[74342]: No targets found.
Oct 16 09:47:36 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 09:47:36 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 09:47:36 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74b0a81-e6a9-4973-b08d-84cfc51e356c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f07d5964-a103-4648-8c0e-c478cdeadcf7]: (4, ('tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 (non-flash)
Oct 16 09:47:36 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] iscsi session list stdout=tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 (non-flash)
Oct 16 09:47:36 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b83fd7370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39'): ({'sdc'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Removing single pathed devices sdc {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af32158-8b15-4c20-a7ee-10ec68ec4181]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8c297b-16e4-4faf-8e3c-bccd2c0b7a67]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Flushing IO for device /dev/sdc {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bf37214-49ad-4add-9bcc-851c1e50cae1]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e39c58-40e9-46d4-a3ac-63c050c23ae0]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] SCSI volumes sdc have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98314a0-a6e9-4a21-836f-2d2cda49e843]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 -p 172.16.0.220:3260 --logout" returned: 0 in 0.039s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e245a9-2458-4850-9f52-d330205cda41]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39, portal: 172.16.0.220,3260]
Oct 16 09:47:36 user nova-compute[74342]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39, portal: 172.16.0.220,3260] successful.
Oct 16 09:47:36 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2f4c6dd9-aa93-4f79-a40f-35156152ef39 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e0a41c-15bc-43d4-92f2-6adbd24df0c5]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.259s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] <== disconnect_volume: return (261ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:47:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 09:47:37 user nova-compute[74342]: DEBUG nova.objects.instance [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lazy-loading 'flavor' on Instance uuid 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:47:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b33b04c4-5627-4342-aa54-6b86b941285f tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.225s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:37 user nova-compute[74342]: DEBUG nova.objects.instance [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lazy-loading 'flavor' on Instance uuid d3ed0377-ff2b-4a15-9175-a70624aa913d {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:47:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-22d6c1c1-01f4-4573-98fa-d91efba66f2d tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lock "d3ed0377-ff2b-4a15-9175-a70624aa913d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.050s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Acquiring lock "interface-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-dbff0b7a-6769-4dfc-bfa0-5273815bdc08" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "interface-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-dbff0b7a-6769-4dfc-bfa0-5273815bdc08" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG nova.objects.instance [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lazy-loading 'flavor' on Instance uuid 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T09:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-640949209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-640949209',id=6,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpYhQn0nZA6I7ZVLvCwhw5MRkVm+i8dhF9cA+w+3K6essQXKu4e2BqUgXONrqsgQPLMNC9JJK382LUfvK2FFKrfh3cM12JiZnpdknV1HPaHjSi3tgNn41IJGEsjJsOpHg==',key_name='tempest-keypair-1377321458',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:44:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a64826b7567493ab7deee5994b261e7',ramdisk_id='',reservation_id='r-v3nxv2mx',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1445023395',owner_user_name='tempest-TaggedAttachmentsTest-1445023395-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:44:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='580c2bb824f04735a5a0b0d6f594bde3',uuid=1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbff0b7a-6769-4dfc-bfa0-5273815bdc08", "address": "fa:16:3e:dd:08:71", "network": {"id": "39a0bf3b-4fbd-49ec-b90c-8f14f2ab4045", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-705696688", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3a64826b7567493ab7deee5994b261e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbff0b7a-67", "ovs_interfaceid": "dbff0b7a-6769-4dfc-bfa0-5273815bdc08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Converting VIF {"id": "dbff0b7a-6769-4dfc-bfa0-5273815bdc08", "address": "fa:16:3e:dd:08:71", "network": {"id": "39a0bf3b-4fbd-49ec-b90c-8f14f2ab4045", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-705696688", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3a64826b7567493ab7deee5994b261e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbff0b7a-67", "ovs_interfaceid": "dbff0b7a-6769-4dfc-bfa0-5273815bdc08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:08:71,bridge_name='br-int',has_traffic_filtering=True,id=dbff0b7a-6769-4dfc-bfa0-5273815bdc08,network=Network(39a0bf3b-4fbd-49ec-b90c-8f14f2ab4045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbff0b7a-67') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:dd:08:71"/><model type="virtio"/><mtu size="1442"/><target dev="tapdbff0b7a-67"/></interface> {{(pid=74342) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:dd:08:71"/><model type="virtio"/><mtu size="1442"/><target dev="tapdbff0b7a-67"/></interface> {{(pid=74342) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Attempting to detach device tapdbff0b7a-67 from instance 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4 from the persistent domain config. {{(pid=74342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] detach device xml: <interface type="ethernet">
Oct 16 09:47:38 user nova-compute[74342]:   <mac address="fa:16:3e:dd:08:71"/>
Oct 16 09:47:38 user nova-compute[74342]:   <model type="virtio"/>
Oct 16 09:47:38 user nova-compute[74342]:   <mtu size="1442"/>
Oct 16 09:47:38 user nova-compute[74342]:   <target dev="tapdbff0b7a-67"/>
Oct 16 09:47:38 user nova-compute[74342]: </interface>
Oct 16 09:47:38 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:dd:08:71"/><model type="virtio"/><mtu size="1442"/><target dev="tapdbff0b7a-67"/></interface> {{(pid=74342) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:dd:08:71"/><model type="virtio"/><mtu size="1442"/><target dev="tapdbff0b7a-67"/></interface>not found in domain: <domain type='kvm' id='6'>
Oct 16 09:47:38 user nova-compute[74342]:   <name>instance-00000006</name>
Oct 16 09:47:38 user nova-compute[74342]:   <uuid>1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4</uuid>
Oct 16 09:47:38 user nova-compute[74342]:   <metadata>
Oct 16 09:47:38 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:47:38 user nova-compute[74342]:   <nova:package version="0.0.0"/>
Oct 16 09:47:38 user nova-compute[74342]:   <nova:name>tempest-device-tagging-server-640949209</nova:name>
Oct 16 09:47:38 user nova-compute[74342]:   <nova:creationTime>2023-10-16 09:46:14</nova:creationTime>
Oct 16 09:47:38 user nova-compute[74342]:   <nova:flavor name="m1.tiny">
Oct 16 09:47:38 user nova-compute[74342]:     <nova:memory>512</nova:memory>
Oct 16 09:47:38 user nova-compute[74342]:     <nova:disk>1</nova:disk>
Oct 16 09:47:38 user nova-compute[74342]:     <nova:swap>0</nova:swap>
Oct 16 09:47:38 user nova-compute[74342]:     <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:47:38 user nova-compute[74342]:     <nova:vcpus>1</nova:vcpus>
Oct 16 09:47:38 user nova-compute[74342]:   </nova:flavor>
Oct 16 09:47:38 user nova-compute[74342]:   <nova:owner>
Oct 16 09:47:38 user nova-compute[74342]:     <nova:user uuid="580c2bb824f04735a5a0b0d6f594bde3">tempest-TaggedAttachmentsTest-1445023395-project-member</nova:user>
Oct 16 09:47:38 user nova-compute[74342]:     <nova:project uuid="3a64826b7567493ab7deee5994b261e7">tempest-TaggedAttachmentsTest-1445023395</nova:project>
Oct 16 09:47:38 user nova-compute[74342]:   </nova:owner>
Oct 16 09:47:38 user nova-compute[74342]:   <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:47:38 user nova-compute[74342]:   <nova:ports>
Oct 16 09:47:38 user nova-compute[74342]:     <nova:port uuid="ecb4fcc0-8f58-493c-9804-76bf3603b899">
Oct 16 09:47:38 user nova-compute[74342]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 09:47:38 user nova-compute[74342]:     </nova:port>
Oct 16 09:47:38 user nova-compute[74342]:     <nova:port uuid="dbff0b7a-6769-4dfc-bfa0-5273815bdc08">
Oct 16 09:47:38 user nova-compute[74342]:       <nova:ip type="fixed" address="10.10.10.10" ipVersion="4"/>
Oct 16 09:47:38 user nova-compute[74342]:     </nova:port>
Oct 16 09:47:38 user nova-compute[74342]:   </nova:ports>
Oct 16 09:47:38 user nova-compute[74342]: </nova:instance>
Oct 16 09:47:38 user nova-compute[74342]:   </metadata>
Oct 16 09:47:38 user nova-compute[74342]:   <memory unit='KiB'>524288</memory>
Oct 16 09:47:38 user nova-compute[74342]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 16 09:47:38 user nova-compute[74342]:   <vcpu placement='static'>1</vcpu>
Oct 16 09:47:38 user nova-compute[74342]:   <resource>
Oct 16 09:47:38 user nova-compute[74342]:     <partition>/machine</partition>
Oct 16 09:47:38 user nova-compute[74342]:   </resource>
Oct 16 09:47:38 user nova-compute[74342]:   <sysinfo type='smbios'>
Oct 16 09:47:38 user nova-compute[74342]:     <system>
Oct 16 09:47:38 user nova-compute[74342]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 16 09:47:38 user nova-compute[74342]:       <entry name='product'>OpenStack Nova</entry>
Oct 16 09:47:38 user nova-compute[74342]:       <entry name='version'>0.0.0</entry>
Oct 16 09:47:38 user nova-compute[74342]:       <entry name='serial'>1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4</entry>
Oct 16 09:47:38 user nova-compute[74342]:       <entry name='uuid'>1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4</entry>
Oct 16 09:47:38 user nova-compute[74342]:       <entry name='family'>Virtual Machine</entry>
Oct 16 09:47:38 user nova-compute[74342]:     </system>
Oct 16 09:47:38 user nova-compute[74342]:   </sysinfo>
Oct 16 09:47:38 user nova-compute[74342]:   <os>
Oct 16 09:47:38 user nova-compute[74342]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 16 09:47:38 user nova-compute[74342]:     <boot dev='hd'/>
Oct 16 09:47:38 user nova-compute[74342]:     <smbios mode='sysinfo'/>
Oct 16 09:47:38 user nova-compute[74342]:   </os>
Oct 16 09:47:38 user nova-compute[74342]:   <features>
Oct 16 09:47:38 user nova-compute[74342]:     <acpi/>
Oct 16 09:47:38 user nova-compute[74342]:     <apic/>
Oct 16 09:47:38 user nova-compute[74342]:     <vmcoreinfo state='on'/>
Oct 16 09:47:38 user nova-compute[74342]:   </features>
Oct 16 09:47:38 user nova-compute[74342]:   <cpu mode='custom' match='exact' check='full'>
Oct 16 09:47:38 user nova-compute[74342]:     <model fallback='forbid'>Nehalem</model>
Oct 16 09:47:38 user nova-compute[74342]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 16 09:47:38 user nova-compute[74342]:     <feature policy='require' name='vme'/>
Oct 16 09:47:38 user nova-compute[74342]:     <feature policy='require' name='x2apic'/>
Oct 16 09:47:38 user nova-compute[74342]:     <feature policy='require' name='hypervisor'/>
Oct 16 09:47:38 user nova-compute[74342]:   </cpu>
Oct 16 09:47:38 user nova-compute[74342]:   <clock offset='utc'>
Oct 16 09:47:38 user nova-compute[74342]:     <timer name='pit' tickpolicy='delay'/>
Oct 16 09:47:38 user nova-compute[74342]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 16 09:47:38 user nova-compute[74342]:     <timer name='hpet' present='no'/>
Oct 16 09:47:38 user nova-compute[74342]:   </clock>
Oct 16 09:47:38 user nova-compute[74342]:   <on_poweroff>destroy</on_poweroff>
Oct 16 09:47:38 user nova-compute[74342]:   <on_reboot>restart</on_reboot>
Oct 16 09:47:38 user nova-compute[74342]:   <on_crash>destroy</on_crash>
Oct 16 09:47:38 user nova-compute[74342]:   <devices>
Oct 16 09:47:38 user nova-compute[74342]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 16 09:47:38 user nova-compute[74342]:     <disk type='file' device='disk'>
Oct 16 09:47:38 user nova-compute[74342]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 16 09:47:38 user nova-compute[74342]:       <source file='/opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk' index='2'/>
Oct 16 09:47:38 user nova-compute[74342]:       <backingStore type='file' index='3'>
Oct 16 09:47:38 user nova-compute[74342]:         <format type='raw'/>
Oct 16 09:47:38 user nova-compute[74342]:         <source file='/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd'/>
Oct 16 09:47:38 user nova-compute[74342]:         <backingStore/>
Oct 16 09:47:38 user nova-compute[74342]:       </backingStore>
Oct 16 09:47:38 user nova-compute[74342]:       <target dev='vda' bus='virtio'/>
Oct 16 09:47:38 user nova-compute[74342]:       <alias name='virtio-disk0'/>
Oct 16 09:47:38 user nova-compute[74342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 16 09:47:38 user nova-compute[74342]:     </disk>
Oct 16 09:47:38 user nova-compute[74342]:     <disk type='file' device='cdrom'>
Oct 16 09:47:38 user nova-compute[74342]:       <driver name='qemu' type='raw' cache='none'/>
Oct 16 09:47:38 user nova-compute[74342]:       <source file='/opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk.config' index='1'/>
Oct 16 09:47:38 user nova-compute[74342]:       <backingStore/>
Oct 16 09:47:38 user nova-compute[74342]:       <target dev='hda' bus='ide'/>
Oct 16 09:47:38 user nova-compute[74342]:       <readonly/>
Oct 16 09:47:38 user nova-compute[74342]:       <alias name='ide0-0-0'/>
Oct 16 09:47:38 user nova-compute[74342]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 16 09:47:38 user nova-compute[74342]:     </disk>
Oct 16 09:47:38 user nova-compute[74342]:     <controller type='usb' index='0' model='none'>
Oct 16 09:47:38 user nova-compute[74342]:       <alias name='usb'/>
Oct 16 09:47:38 user nova-compute[74342]:     </controller>
Oct 16 09:47:38 user nova-compute[74342]:     <controller type='pci' index='0' model='pci-root'>
Oct 16 09:47:38 user nova-compute[74342]:       <alias name='pci.0'/>
Oct 16 09:47:38 user nova-compute[74342]:     </controller>
Oct 16 09:47:38 user nova-compute[74342]:     <controller type='ide' index='0'>
Oct 16 09:47:38 user nova-compute[74342]:       <alias name='ide'/>
Oct 16 09:47:38 user nova-compute[74342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 16 09:47:38 user nova-compute[74342]:     </controller>
Oct 16 09:47:38 user nova-compute[74342]:     <interface type='ethernet'>
Oct 16 09:47:38 user nova-compute[74342]:       <mac address='fa:16:3e:27:36:3d'/>
Oct 16 09:47:38 user nova-compute[74342]:       <target dev='tapecb4fcc0-8f'/>
Oct 16 09:47:38 user nova-compute[74342]:       <model type='virtio'/>
Oct 16 09:47:38 user nova-compute[74342]:       <mtu size='1442'/>
Oct 16 09:47:38 user nova-compute[74342]:       <alias name='net0'/>
Oct 16 09:47:38 user nova-compute[74342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 16 09:47:38 user nova-compute[74342]:     </interface>
Oct 16 09:47:38 user nova-compute[74342]:     <interface type='ethernet'>
Oct 16 09:47:38 user nova-compute[74342]:       <mac address='fa:16:3e:dd:08:71'/>
Oct 16 09:47:38 user nova-compute[74342]:       <target dev='tapdbff0b7a-67'/>
Oct 16 09:47:38 user nova-compute[74342]:       <model type='virtio'/>
Oct 16 09:47:38 user nova-compute[74342]:       <mtu size='1442'/>
Oct 16 09:47:38 user nova-compute[74342]:       <alias name='net1'/>
Oct 16 09:47:38 user nova-compute[74342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Oct 16 09:47:38 user nova-compute[74342]:     </interface>
Oct 16 09:47:38 user nova-compute[74342]:     <serial type='pty'>
Oct 16 09:47:38 user nova-compute[74342]:       <source path='/dev/pts/5'/>
Oct 16 09:47:38 user nova-compute[74342]:       <log file='/opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/console.log' append='off'/>
Oct 16 09:47:38 user nova-compute[74342]:       <target type='isa-serial' port='0'>
Oct 16 09:47:38 user nova-compute[74342]:         <model name='isa-serial'/>
Oct 16 09:47:38 user nova-compute[74342]:       </target>
Oct 16 09:47:38 user nova-compute[74342]:       <alias name='serial0'/>
Oct 16 09:47:38 user nova-compute[74342]:     </serial>
Oct 16 09:47:38 user nova-compute[74342]:     <console type='pty' tty='/dev/pts/5'>
Oct 16 09:47:38 user nova-compute[74342]:       <source path='/dev/pts/5'/>
Oct 16 09:47:38 user nova-compute[74342]:       <log file='/opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/console.log' append='off'/>
Oct 16 09:47:38 user nova-compute[74342]:       <target type='serial' port='0'/>
Oct 16 09:47:38 user nova-compute[74342]:       <alias name='serial0'/>
Oct 16 09:47:38 user nova-compute[74342]:     </console>
Oct 16 09:47:38 user nova-compute[74342]:     <input type='mouse' bus='ps2'>
Oct 16 09:47:38 user nova-compute[74342]:       <alias name='input0'/>
Oct 16 09:47:38 user nova-compute[74342]:     </input>
Oct 16 09:47:38 user nova-compute[74342]:     <input type='keyboard' bus='ps2'>
Oct 16 09:47:38 user nova-compute[74342]:       <alias name='input1'/>
Oct 16 09:47:38 user nova-compute[74342]:     </input>
Oct 16 09:47:38 user nova-compute[74342]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Oct 16 09:47:38 user nova-compute[74342]:       <listen type='address' address='0.0.0.0'/>
Oct 16 09:47:38 user nova-compute[74342]:     </graphics>
Oct 16 09:47:38 user nova-compute[74342]:     <audio id='1' type='none'/>
Oct 16 09:47:38 user nova-compute[74342]:     <video>
Oct 16 09:47:38 user nova-compute[74342]:       <model type='virtio' heads='1' primary='yes'/>
Oct 16 09:47:38 user nova-compute[74342]:       <alias name='video0'/>
Oct 16 09:47:38 user nova-compute[74342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 16 09:47:38 user nova-compute[74342]:     </video>
Oct 16 09:47:38 user nova-compute[74342]:     <memballoon model='virtio'>
Oct 16 09:47:38 user nova-compute[74342]:       <stats period='10'/>
Oct 16 09:47:38 user nova-compute[74342]:       <alias name='balloon0'/>
Oct 16 09:47:38 user nova-compute[74342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 16 09:47:38 user nova-compute[74342]:     </memballoon>
Oct 16 09:47:38 user nova-compute[74342]:     <rng model='virtio'>
Oct 16 09:47:38 user nova-compute[74342]:       <backend model='random'>/dev/urandom</backend>
Oct 16 09:47:38 user nova-compute[74342]:       <alias name='rng0'/>
Oct 16 09:47:38 user nova-compute[74342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 16 09:47:38 user nova-compute[74342]:     </rng>
Oct 16 09:47:38 user nova-compute[74342]:   </devices>
Oct 16 09:47:38 user nova-compute[74342]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 16 09:47:38 user nova-compute[74342]:     <label>libvirt-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4</label>
Oct 16 09:47:38 user nova-compute[74342]:     <imagelabel>libvirt-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4</imagelabel>
Oct 16 09:47:38 user nova-compute[74342]:   </seclabel>
Oct 16 09:47:38 user nova-compute[74342]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 16 09:47:38 user nova-compute[74342]:     <label>+64055:+108</label>
Oct 16 09:47:38 user nova-compute[74342]:     <imagelabel>+64055:+108</imagelabel>
Oct 16 09:47:38 user nova-compute[74342]:   </seclabel>
Oct 16 09:47:38 user nova-compute[74342]: </domain>
Oct 16 09:47:38 user nova-compute[74342]:  {{(pid=74342) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 16 09:47:38 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Successfully detached device tapdbff0b7a-67 from instance 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4 from the persistent domain config.
Oct 16 09:47:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] (1/8): Attempting to detach device tapdbff0b7a-67 with device alias net1 from instance 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4 from the live domain config. {{(pid=74342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] detach device xml: <interface type="ethernet">
Oct 16 09:47:38 user nova-compute[74342]:   <mac address="fa:16:3e:dd:08:71"/>
Oct 16 09:47:38 user nova-compute[74342]:   <model type="virtio"/>
Oct 16 09:47:38 user nova-compute[74342]:   <mtu size="1442"/>
Oct 16 09:47:38 user nova-compute[74342]:   <target dev="tapdbff0b7a-67"/>
Oct 16 09:47:38 user nova-compute[74342]: </interface>
Oct 16 09:47:38 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-db7b8818-bc76-47a7-aac0-f3596d8aea7a tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Acquiring lock "d3ed0377-ff2b-4a15-9175-a70624aa913d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-db7b8818-bc76-47a7-aac0-f3596d8aea7a tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lock "d3ed0377-ff2b-4a15-9175-a70624aa913d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-db7b8818-bc76-47a7-aac0-f3596d8aea7a tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Acquiring lock "d3ed0377-ff2b-4a15-9175-a70624aa913d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-db7b8818-bc76-47a7-aac0-f3596d8aea7a tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lock "d3ed0377-ff2b-4a15-9175-a70624aa913d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-db7b8818-bc76-47a7-aac0-f3596d8aea7a tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lock "d3ed0377-ff2b-4a15-9175-a70624aa913d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:38 user nova-compute[74342]: INFO nova.compute.manager [None req-db7b8818-bc76-47a7-aac0-f3596d8aea7a tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Terminating instance
Oct 16 09:47:38 user nova-compute[74342]: DEBUG nova.compute.manager [None req-db7b8818-bc76-47a7-aac0-f3596d8aea7a tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Start waiting for the detach event from libvirt for device tapdbff0b7a-67 with device alias net1 for instance 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4 {{(pid=74342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG nova.compute.manager [req-9fa6b0ca-cec5-42a9-9da4-7aedc3734c2a req-0a4d84f1-0cd1-408e-9360-7dc70dbe979e service nova] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Received event network-vif-unplugged-c7e71629-bc93-41ff-bd86-e1f6be6aec6b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9fa6b0ca-cec5-42a9-9da4-7aedc3734c2a req-0a4d84f1-0cd1-408e-9360-7dc70dbe979e service nova] Acquiring lock "d3ed0377-ff2b-4a15-9175-a70624aa913d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9fa6b0ca-cec5-42a9-9da4-7aedc3734c2a req-0a4d84f1-0cd1-408e-9360-7dc70dbe979e service nova] Lock "d3ed0377-ff2b-4a15-9175-a70624aa913d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9fa6b0ca-cec5-42a9-9da4-7aedc3734c2a req-0a4d84f1-0cd1-408e-9360-7dc70dbe979e service nova] Lock "d3ed0377-ff2b-4a15-9175-a70624aa913d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG nova.compute.manager [req-9fa6b0ca-cec5-42a9-9da4-7aedc3734c2a req-0a4d84f1-0cd1-408e-9360-7dc70dbe979e service nova] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] No waiting events found dispatching network-vif-unplugged-c7e71629-bc93-41ff-bd86-e1f6be6aec6b {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG nova.compute.manager [req-9fa6b0ca-cec5-42a9-9da4-7aedc3734c2a req-0a4d84f1-0cd1-408e-9360-7dc70dbe979e service nova] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Received event network-vif-unplugged-c7e71629-bc93-41ff-bd86-e1f6be6aec6b for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG nova.compute.manager [req-4430d076-a47a-41da-b400-5e9f4fcef900 req-dc19b963-3146-4de1-a89b-5e3cc70a0a90 service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Received event network-vif-unplugged-dbff0b7a-6769-4dfc-bfa0-5273815bdc08 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4430d076-a47a-41da-b400-5e9f4fcef900 req-dc19b963-3146-4de1-a89b-5e3cc70a0a90 service nova] Acquiring lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4430d076-a47a-41da-b400-5e9f4fcef900 req-dc19b963-3146-4de1-a89b-5e3cc70a0a90 service nova] Lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4430d076-a47a-41da-b400-5e9f4fcef900 req-dc19b963-3146-4de1-a89b-5e3cc70a0a90 service nova] Lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:38 user nova-compute[74342]: DEBUG nova.compute.manager [req-4430d076-a47a-41da-b400-5e9f4fcef900 req-dc19b963-3146-4de1-a89b-5e3cc70a0a90 service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] No waiting events found dispatching network-vif-unplugged-dbff0b7a-6769-4dfc-bfa0-5273815bdc08 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:47:38 user nova-compute[74342]: WARNING nova.compute.manager [req-4430d076-a47a-41da-b400-5e9f4fcef900 req-dc19b963-3146-4de1-a89b-5e3cc70a0a90 service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Received unexpected event network-vif-unplugged-dbff0b7a-6769-4dfc-bfa0-5273815bdc08 for instance with vm_state active and task_state None.
Oct 16 09:47:39 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Instance destroyed successfully.
Oct 16 09:47:39 user nova-compute[74342]: DEBUG nova.objects.instance [None req-db7b8818-bc76-47a7-aac0-f3596d8aea7a tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lazy-loading 'resources' on Instance uuid d3ed0377-ff2b-4a15-9175-a70624aa913d {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:47:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-db7b8818-bc76-47a7-aac0-f3596d8aea7a tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T09:44:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1013873379',display_name='tempest-AttachSCSIVolumeTestJSON-server-1013873379',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1013873379',id=5,image_ref='43e89f0e-d30a-4f69-89b3-85a57e8811ea',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH+SbWAmfhky3H7xXZhaqF6ii62jtxmE2K2dk+jdGcHktcGmxJqOIyKoi0Cp9F6hNdygwyK18UHia/jFn+4XUBPviiK4qDrny18LXFui72VSb4SEmJ9RmIqz0cX4o4yVfA==',key_name='tempest-keypair-202096675',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:44:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='698c3910471646ee8bb8632484e3787b',ramdisk_id='',reservation_id='r-wj00pibf',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='43e89f0e-d30a-4f69-89b3-85a57e8811ea',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-546040346',owner_user_name='tempest-AttachSCSIVolumeTestJSON-546040346-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:44:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='364c71ffa3a94817bda4910f6c4f8e0c',uuid=d3ed0377-ff2b-4a15-9175-a70624aa913d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7e71629-bc93-41ff-bd86-e1f6be6aec6b", "address": "fa:16:3e:c2:4d:5a", "network": {"id": "cf087024-9089-47c1-b7ce-dbc5b1d3232c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1070425141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698c3910471646ee8bb8632484e3787b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e71629-bc", "ovs_interfaceid": "c7e71629-bc93-41ff-bd86-e1f6be6aec6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:47:39 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-db7b8818-bc76-47a7-aac0-f3596d8aea7a tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Converting VIF {"id": "c7e71629-bc93-41ff-bd86-e1f6be6aec6b", "address": "fa:16:3e:c2:4d:5a", "network": {"id": "cf087024-9089-47c1-b7ce-dbc5b1d3232c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1070425141-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.252", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "698c3910471646ee8bb8632484e3787b", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7e71629-bc", "ovs_interfaceid": "c7e71629-bc93-41ff-bd86-e1f6be6aec6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:47:39 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-db7b8818-bc76-47a7-aac0-f3596d8aea7a tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:4d:5a,bridge_name='br-int',has_traffic_filtering=True,id=c7e71629-bc93-41ff-bd86-e1f6be6aec6b,network=Network(cf087024-9089-47c1-b7ce-dbc5b1d3232c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7e71629-bc') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:47:39 user nova-compute[74342]: DEBUG os_vif [None req-db7b8818-bc76-47a7-aac0-f3596d8aea7a tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:4d:5a,bridge_name='br-int',has_traffic_filtering=True,id=c7e71629-bc93-41ff-bd86-e1f6be6aec6b,network=Network(cf087024-9089-47c1-b7ce-dbc5b1d3232c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7e71629-bc') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:47:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7e71629-bc, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:47:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3027e55e-216b-4919-afb3-510efcd04120) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:47:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:39 user nova-compute[74342]: INFO os_vif [None req-db7b8818-bc76-47a7-aac0-f3596d8aea7a tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:4d:5a,bridge_name='br-int',has_traffic_filtering=True,id=c7e71629-bc93-41ff-bd86-e1f6be6aec6b,network=Network(cf087024-9089-47c1-b7ce-dbc5b1d3232c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7e71629-bc')
Oct 16 09:47:39 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-db7b8818-bc76-47a7-aac0-f3596d8aea7a tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Deleting instance files /opt/stack/data/nova/instances/d3ed0377-ff2b-4a15-9175-a70624aa913d_del
Oct 16 09:47:39 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-db7b8818-bc76-47a7-aac0-f3596d8aea7a tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Deletion of /opt/stack/data/nova/instances/d3ed0377-ff2b-4a15-9175-a70624aa913d_del complete
Oct 16 09:47:39 user nova-compute[74342]: INFO nova.compute.manager [None req-db7b8818-bc76-47a7-aac0-f3596d8aea7a tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 16 09:47:39 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-db7b8818-bc76-47a7-aac0-f3596d8aea7a tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 09:47:39 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 09:47:39 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 09:47:40 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Lazy-loading 'flavor' on Instance uuid 719428d6-025b-4baa-97a2-c8ebdd49f57e {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:47:40 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:47:40 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Took 1.33 seconds to deallocate network for instance.
Oct 16 09:47:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb6bd1e0-ff01-4b6e-90fb-a1c080f4b59c tempest-VolumesAssistedSnapshotsTest-2035439730 tempest-VolumesAssistedSnapshotsTest-2035439730-project-admin] Lock "719428d6-025b-4baa-97a2-c8ebdd49f57e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.602s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:40 user nova-compute[74342]: DEBUG nova.compute.manager [req-a96868df-69b7-42a6-9ef6-79b451dfcad5 req-d9d9cc6e-cffb-418d-8a87-9dfe24e502dd service nova] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Received event network-vif-deleted-c7e71629-bc93-41ff-bd86-e1f6be6aec6b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:47:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-db7b8818-bc76-47a7-aac0-f3596d8aea7a tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-db7b8818-bc76-47a7-aac0-f3596d8aea7a tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:40 user nova-compute[74342]: DEBUG nova.compute.manager [req-1ddfb48f-7599-429a-88f2-9306c77eec00 req-1d902ab0-1985-4e0f-b242-262adf81f110 service nova] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Received event network-vif-plugged-c7e71629-bc93-41ff-bd86-e1f6be6aec6b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:47:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-1ddfb48f-7599-429a-88f2-9306c77eec00 req-1d902ab0-1985-4e0f-b242-262adf81f110 service nova] Acquiring lock "d3ed0377-ff2b-4a15-9175-a70624aa913d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-1ddfb48f-7599-429a-88f2-9306c77eec00 req-1d902ab0-1985-4e0f-b242-262adf81f110 service nova] Lock "d3ed0377-ff2b-4a15-9175-a70624aa913d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-1ddfb48f-7599-429a-88f2-9306c77eec00 req-1d902ab0-1985-4e0f-b242-262adf81f110 service nova] Lock "d3ed0377-ff2b-4a15-9175-a70624aa913d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:40 user nova-compute[74342]: DEBUG nova.compute.manager [req-1ddfb48f-7599-429a-88f2-9306c77eec00 req-1d902ab0-1985-4e0f-b242-262adf81f110 service nova] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] No waiting events found dispatching network-vif-plugged-c7e71629-bc93-41ff-bd86-e1f6be6aec6b {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:47:40 user nova-compute[74342]: WARNING nova.compute.manager [req-1ddfb48f-7599-429a-88f2-9306c77eec00 req-1d902ab0-1985-4e0f-b242-262adf81f110 service nova] [instance: d3ed0377-ff2b-4a15-9175-a70624aa913d] Received unexpected event network-vif-plugged-c7e71629-bc93-41ff-bd86-e1f6be6aec6b for instance with vm_state deleted and task_state None.
Oct 16 09:47:41 user nova-compute[74342]: DEBUG nova.compute.manager [req-ab6d8a07-a046-4871-a583-3b19209c68af req-d3bc4d05-772d-4ca7-8dc4-cedc4025c01c service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Received event network-vif-plugged-dbff0b7a-6769-4dfc-bfa0-5273815bdc08 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:47:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ab6d8a07-a046-4871-a583-3b19209c68af req-d3bc4d05-772d-4ca7-8dc4-cedc4025c01c service nova] Acquiring lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ab6d8a07-a046-4871-a583-3b19209c68af req-d3bc4d05-772d-4ca7-8dc4-cedc4025c01c service nova] Lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ab6d8a07-a046-4871-a583-3b19209c68af req-d3bc4d05-772d-4ca7-8dc4-cedc4025c01c service nova] Lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:41 user nova-compute[74342]: DEBUG nova.compute.manager [req-ab6d8a07-a046-4871-a583-3b19209c68af req-d3bc4d05-772d-4ca7-8dc4-cedc4025c01c service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] No waiting events found dispatching network-vif-plugged-dbff0b7a-6769-4dfc-bfa0-5273815bdc08 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:47:41 user nova-compute[74342]: WARNING nova.compute.manager [req-ab6d8a07-a046-4871-a583-3b19209c68af req-d3bc4d05-772d-4ca7-8dc4-cedc4025c01c service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Received unexpected event network-vif-plugged-dbff0b7a-6769-4dfc-bfa0-5273815bdc08 for instance with vm_state active and task_state None.
Oct 16 09:47:41 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-db7b8818-bc76-47a7-aac0-f3596d8aea7a tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:47:41 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-db7b8818-bc76-47a7-aac0-f3596d8aea7a tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:47:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-db7b8818-bc76-47a7-aac0-f3596d8aea7a tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.334s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:41 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-db7b8818-bc76-47a7-aac0-f3596d8aea7a tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Deleted allocations for instance d3ed0377-ff2b-4a15-9175-a70624aa913d
Oct 16 09:47:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-db7b8818-bc76-47a7-aac0-f3596d8aea7a tempest-AttachSCSIVolumeTestJSON-546040346 tempest-AttachSCSIVolumeTestJSON-546040346-project-member] Lock "d3ed0377-ff2b-4a15-9175-a70624aa913d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.920s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "5dc86029-dcbf-4886-bdc9-7d4413059c96" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "5dc86029-dcbf-4886-bdc9-7d4413059c96" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:41 user nova-compute[74342]: DEBUG nova.compute.manager [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:47:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:41 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:47:41 user nova-compute[74342]: INFO nova.compute.claims [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Claim successful on node user
Oct 16 09:47:42 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:47:42 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:47:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.465s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:42 user nova-compute[74342]: DEBUG nova.compute.manager [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:47:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:42 user nova-compute[74342]: DEBUG nova.compute.manager [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:47:42 user nova-compute[74342]: DEBUG nova.network.neutron [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:47:42 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:47:42 user nova-compute[74342]: DEBUG nova.compute.manager [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:47:42 user nova-compute[74342]: DEBUG nova.compute.manager [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 09:47:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:47:42 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Creating image(s)
Oct 16 09:47:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "/opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "/opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "/opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:42 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:42 user nova-compute[74342]: DEBUG nova.policy [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e3c728429a0a42789cfc0f1251d6f623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355bac247f9d4ea8b3c2f0d87453f4c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:47:42 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.184s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:42 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.190s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk 1073741824" returned: 0 in 0.049s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.175s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:43 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 09:47:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:43 user nova-compute[74342]: DEBUG nova.network.neutron [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Successfully created port: 951f9dec-9a54-4fca-a7d4-c0044b873dbf {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:47:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:43 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Cannot resize image /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 09:47:43 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 09:47:43 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Ensure instance console log exists: /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:47:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.network.neutron [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Successfully updated port: 951f9dec-9a54-4fca-a7d4-c0044b873dbf {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "refresh_cache-5dc86029-dcbf-4886-bdc9-7d4413059c96" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquired lock "refresh_cache-5dc86029-dcbf-4886-bdc9-7d4413059c96" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.network.neutron [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.compute.manager [req-e5c806d8-e8eb-4ef6-a432-77d4c04723ef req-dd00c879-7398-4325-81be-059ab848ae48 service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Received event network-changed-951f9dec-9a54-4fca-a7d4-c0044b873dbf {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.compute.manager [req-e5c806d8-e8eb-4ef6-a432-77d4c04723ef req-dd00c879-7398-4325-81be-059ab848ae48 service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Refreshing instance network info cache due to event network-changed-951f9dec-9a54-4fca-a7d4-c0044b873dbf. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e5c806d8-e8eb-4ef6-a432-77d4c04723ef req-dd00c879-7398-4325-81be-059ab848ae48 service nova] Acquiring lock "refresh_cache-5dc86029-dcbf-4886-bdc9-7d4413059c96" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.network.neutron [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.network.neutron [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Updating instance_info_cache with network_info: [{"id": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "address": "fa:16:3e:72:e1:f9", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951f9dec-9a", "ovs_interfaceid": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Releasing lock "refresh_cache-5dc86029-dcbf-4886-bdc9-7d4413059c96" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.compute.manager [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Instance network_info: |[{"id": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "address": "fa:16:3e:72:e1:f9", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951f9dec-9a", "ovs_interfaceid": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e5c806d8-e8eb-4ef6-a432-77d4c04723ef req-dd00c879-7398-4325-81be-059ab848ae48 service nova] Acquired lock "refresh_cache-5dc86029-dcbf-4886-bdc9-7d4413059c96" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.network.neutron [req-e5c806d8-e8eb-4ef6-a432-77d4c04723ef req-dd00c879-7398-4325-81be-059ab848ae48 service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Refreshing network info cache for port 951f9dec-9a54-4fca-a7d4-c0044b873dbf {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Start _get_guest_xml network_info=[{"id": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "address": "fa:16:3e:72:e1:f9", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951f9dec-9a", "ovs_interfaceid": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:44 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:47:44 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1925950729',display_name='tempest-tempest.common.compute-instance-1925950729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1925950729',id=13,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENlsyLKWKrYF7OcOeajHHxxGyLS1hP9Z+t1OgPZy4taPt9sKtivrgHdPrFdyhMN0XH93w8AnoJZMLK1ZeOS0cwQwCLjdSdOan0bKTxZLlv4i5AfsZfy9oM6wACrGz48LQ==',key_name='tempest-keypair-501012977',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='355bac247f9d4ea8b3c2f0d87453f4c1',ramdisk_id='',reservation_id='r-o0rm909r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1004911708',owner_user_name='tempest-ServerActionsTestOtherA-1004911708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:47:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3c728429a0a42789cfc0f1251d6f623',uuid=5dc86029-dcbf-4886-bdc9-7d4413059c96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "address": "fa:16:3e:72:e1:f9", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951f9dec-9a", "ovs_interfaceid": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Converting VIF {"id": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "address": "fa:16:3e:72:e1:f9", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951f9dec-9a", "ovs_interfaceid": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:e1:f9,bridge_name='br-int',has_traffic_filtering=True,id=951f9dec-9a54-4fca-a7d4-c0044b873dbf,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap951f9dec-9a') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.objects.instance [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lazy-loading 'pci_devices' on Instance uuid 5dc86029-dcbf-4886-bdc9-7d4413059c96 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:47:44 user nova-compute[74342]:   <uuid>5dc86029-dcbf-4886-bdc9-7d4413059c96</uuid>
Oct 16 09:47:44 user nova-compute[74342]:   <name>instance-0000000d</name>
Oct 16 09:47:44 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:47:44 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:47:44 user nova-compute[74342]:   <metadata>
Oct 16 09:47:44 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:47:44 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:47:44 user nova-compute[74342]:       <nova:name>tempest-tempest.common.compute-instance-1925950729</nova:name>
Oct 16 09:47:44 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:47:44</nova:creationTime>
Oct 16 09:47:44 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:47:44 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:47:44 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:47:44 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:47:44 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:47:44 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:47:44 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:47:44 user nova-compute[74342]:       <nova:owner>
Oct 16 09:47:44 user nova-compute[74342]:         <nova:user uuid="e3c728429a0a42789cfc0f1251d6f623">tempest-ServerActionsTestOtherA-1004911708-project-member</nova:user>
Oct 16 09:47:44 user nova-compute[74342]:         <nova:project uuid="355bac247f9d4ea8b3c2f0d87453f4c1">tempest-ServerActionsTestOtherA-1004911708</nova:project>
Oct 16 09:47:44 user nova-compute[74342]:       </nova:owner>
Oct 16 09:47:44 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:47:44 user nova-compute[74342]:       <nova:ports>
Oct 16 09:47:44 user nova-compute[74342]:         <nova:port uuid="951f9dec-9a54-4fca-a7d4-c0044b873dbf">
Oct 16 09:47:44 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 16 09:47:44 user nova-compute[74342]:         </nova:port>
Oct 16 09:47:44 user nova-compute[74342]:       </nova:ports>
Oct 16 09:47:44 user nova-compute[74342]:     </nova:instance>
Oct 16 09:47:44 user nova-compute[74342]:   </metadata>
Oct 16 09:47:44 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:47:44 user nova-compute[74342]:     <system>
Oct 16 09:47:44 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:47:44 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:47:44 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:47:44 user nova-compute[74342]:       <entry name="serial">5dc86029-dcbf-4886-bdc9-7d4413059c96</entry>
Oct 16 09:47:44 user nova-compute[74342]:       <entry name="uuid">5dc86029-dcbf-4886-bdc9-7d4413059c96</entry>
Oct 16 09:47:44 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:47:44 user nova-compute[74342]:     </system>
Oct 16 09:47:44 user nova-compute[74342]:   </sysinfo>
Oct 16 09:47:44 user nova-compute[74342]:   <os>
Oct 16 09:47:44 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:47:44 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:47:44 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:47:44 user nova-compute[74342]:   </os>
Oct 16 09:47:44 user nova-compute[74342]:   <features>
Oct 16 09:47:44 user nova-compute[74342]:     <acpi/>
Oct 16 09:47:44 user nova-compute[74342]:     <apic/>
Oct 16 09:47:44 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:47:44 user nova-compute[74342]:   </features>
Oct 16 09:47:44 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:47:44 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:47:44 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:47:44 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:47:44 user nova-compute[74342]:   </clock>
Oct 16 09:47:44 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:47:44 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:47:44 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:47:44 user nova-compute[74342]:   </cpu>
Oct 16 09:47:44 user nova-compute[74342]:   <devices>
Oct 16 09:47:44 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 09:47:44 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 09:47:44 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk"/>
Oct 16 09:47:44 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:47:44 user nova-compute[74342]:     </disk>
Oct 16 09:47:44 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:47:44 user nova-compute[74342]:       <mac address="fa:16:3e:72:e1:f9"/>
Oct 16 09:47:44 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:47:44 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:47:44 user nova-compute[74342]:       <target dev="tap951f9dec-9a"/>
Oct 16 09:47:44 user nova-compute[74342]:     </interface>
Oct 16 09:47:44 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:47:44 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/console.log" append="off"/>
Oct 16 09:47:44 user nova-compute[74342]:     </serial>
Oct 16 09:47:44 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:47:44 user nova-compute[74342]:     <video>
Oct 16 09:47:44 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:47:44 user nova-compute[74342]:     </video>
Oct 16 09:47:44 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:47:44 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:47:44 user nova-compute[74342]:     </rng>
Oct 16 09:47:44 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:47:44 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:47:44 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:47:44 user nova-compute[74342]:     </memballoon>
Oct 16 09:47:44 user nova-compute[74342]:   </devices>
Oct 16 09:47:44 user nova-compute[74342]: </domain>
Oct 16 09:47:44 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1925950729',display_name='tempest-tempest.common.compute-instance-1925950729',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1925950729',id=13,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENlsyLKWKrYF7OcOeajHHxxGyLS1hP9Z+t1OgPZy4taPt9sKtivrgHdPrFdyhMN0XH93w8AnoJZMLK1ZeOS0cwQwCLjdSdOan0bKTxZLlv4i5AfsZfy9oM6wACrGz48LQ==',key_name='tempest-keypair-501012977',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='355bac247f9d4ea8b3c2f0d87453f4c1',ramdisk_id='',reservation_id='r-o0rm909r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1004911708',owner_user_name='tempest-ServerActionsTestOtherA-1004911708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:47:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3c728429a0a42789cfc0f1251d6f623',uuid=5dc86029-dcbf-4886-bdc9-7d4413059c96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "address": "fa:16:3e:72:e1:f9", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951f9dec-9a", "ovs_interfaceid": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Converting VIF {"id": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "address": "fa:16:3e:72:e1:f9", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951f9dec-9a", "ovs_interfaceid": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:72:e1:f9,bridge_name='br-int',has_traffic_filtering=True,id=951f9dec-9a54-4fca-a7d4-c0044b873dbf,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap951f9dec-9a') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG os_vif [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:e1:f9,bridge_name='br-int',has_traffic_filtering=True,id=951f9dec-9a54-4fca-a7d4-c0044b873dbf,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap951f9dec-9a') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f62e4683-bc49-5fa8-b1ad-c105657ef48e', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap951f9dec-9a, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap951f9dec-9a, col_values=(('qos', UUID('5eb67583-0af6-47de-ae5c-ab24acff13bb')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap951f9dec-9a, col_values=(('external_ids', {'iface-id': '951f9dec-9a54-4fca-a7d4-c0044b873dbf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:e1:f9', 'vm-uuid': '5dc86029-dcbf-4886-bdc9-7d4413059c96'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:44 user nova-compute[74342]: INFO os_vif [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:72:e1:f9,bridge_name='br-int',has_traffic_filtering=True,id=951f9dec-9a54-4fca-a7d4-c0044b873dbf,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap951f9dec-9a')
Oct 16 09:47:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:47:44 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] No VIF found with MAC fa:16:3e:72:e1:f9, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG nova.network.neutron [req-e5c806d8-e8eb-4ef6-a432-77d4c04723ef req-dd00c879-7398-4325-81be-059ab848ae48 service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Updated VIF entry in instance network info cache for port 951f9dec-9a54-4fca-a7d4-c0044b873dbf. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG nova.network.neutron [req-e5c806d8-e8eb-4ef6-a432-77d4c04723ef req-dd00c879-7398-4325-81be-059ab848ae48 service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Updating instance_info_cache with network_info: [{"id": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "address": "fa:16:3e:72:e1:f9", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951f9dec-9a", "ovs_interfaceid": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Acquiring lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e5c806d8-e8eb-4ef6-a432-77d4c04723ef req-dd00c879-7398-4325-81be-059ab848ae48 service nova] Releasing lock "refresh_cache-5dc86029-dcbf-4886-bdc9-7d4413059c96" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719428d6-025b-4baa-97a2-c8ebdd49f57e/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG nova.objects.instance [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lazy-loading 'flavor' on Instance uuid bdcd2e60-b36c-4d87-94d7-076e7430e1f0 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.157s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719428d6-025b-4baa-97a2-c8ebdd49f57e/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719428d6-025b-4baa-97a2-c8ebdd49f57e/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Acquiring lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:45 user nova-compute[74342]: INFO nova.compute.manager [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Attaching volume 642c6df7-21ee-41cb-b410-2b14cb878dbc to /dev/vdb
Oct 16 09:47:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/719428d6-025b-4baa-97a2-c8ebdd49f57e/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG os_brick.utils [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f31c77b-b4c0-49c1-a115-f594ff955e01]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "edcefbe0-e89f-4496-9032-f9431d9d5c53" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "edcefbe0-e89f-4496-9032-f9431d9d5c53" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6640f45-26ac-481d-8192-2e752799aaec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG nova.compute.manager [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5644bf3-ba13-4650-97c0-6caccc5ec5d1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[89363d27-0274-47e7-ab24-e4ec4f701277]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:47:46 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:47:46 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ddfcaf-c5e9-4574-af44-be051d6d2361]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG os_brick.utils [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Updating existing volume attachment record: 3dc3d320-b63d-4c8e-9f83-b42d56d4a91f {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:47:46 user nova-compute[74342]: INFO nova.compute.claims [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Claim successful on node user
Oct 16 09:47:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG nova.compute.manager [req-aee1b0d0-9f50-4db2-8ebf-f96355dac566 req-a9f201e9-376c-4c8a-b96b-080b053e9d05 service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Received event network-vif-plugged-951f9dec-9a54-4fca-a7d4-c0044b873dbf {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-aee1b0d0-9f50-4db2-8ebf-f96355dac566 req-a9f201e9-376c-4c8a-b96b-080b053e9d05 service nova] Acquiring lock "5dc86029-dcbf-4886-bdc9-7d4413059c96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-aee1b0d0-9f50-4db2-8ebf-f96355dac566 req-a9f201e9-376c-4c8a-b96b-080b053e9d05 service nova] Lock "5dc86029-dcbf-4886-bdc9-7d4413059c96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-aee1b0d0-9f50-4db2-8ebf-f96355dac566 req-a9f201e9-376c-4c8a-b96b-080b053e9d05 service nova] Lock "5dc86029-dcbf-4886-bdc9-7d4413059c96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG nova.compute.manager [req-aee1b0d0-9f50-4db2-8ebf-f96355dac566 req-a9f201e9-376c-4c8a-b96b-080b053e9d05 service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] No waiting events found dispatching network-vif-plugged-951f9dec-9a54-4fca-a7d4-c0044b873dbf {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:47:46 user nova-compute[74342]: WARNING nova.compute.manager [req-aee1b0d0-9f50-4db2-8ebf-f96355dac566 req-a9f201e9-376c-4c8a-b96b-080b053e9d05 service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Received unexpected event network-vif-plugged-951f9dec-9a54-4fca-a7d4-c0044b873dbf for instance with vm_state building and task_state spawning.
Oct 16 09:47:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.686s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG nova.compute.manager [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG nova.compute.manager [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG nova.network.neutron [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:47:46 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:47:46 user nova-compute[74342]: DEBUG nova.compute.manager [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:47 user nova-compute[74342]: DEBUG nova.policy [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f90f091b76254a13957807feaeaef3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fcf2437a2d413ea584d0cc2508bed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:47:47 user nova-compute[74342]: DEBUG nova.compute.manager [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 09:47:47 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:47:47 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Creating image(s)
Oct 16 09:47:47 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "/opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:47 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "/opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:47 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "/opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.network.neutron [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Successfully created port: 5a9f3200-5a15-4afa-b812-7b68e3130d6d {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.compute.manager [req-796736b9-d13b-47a1-932f-79c2e12329cb req-5e064c5d-87fc-4eb5-9795-0060e393b14d service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Received event network-vif-plugged-951f9dec-9a54-4fca-a7d4-c0044b873dbf {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-796736b9-d13b-47a1-932f-79c2e12329cb req-5e064c5d-87fc-4eb5-9795-0060e393b14d service nova] Acquiring lock "5dc86029-dcbf-4886-bdc9-7d4413059c96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-796736b9-d13b-47a1-932f-79c2e12329cb req-5e064c5d-87fc-4eb5-9795-0060e393b14d service nova] Lock "5dc86029-dcbf-4886-bdc9-7d4413059c96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-796736b9-d13b-47a1-932f-79c2e12329cb req-5e064c5d-87fc-4eb5-9795-0060e393b14d service nova] Lock "5dc86029-dcbf-4886-bdc9-7d4413059c96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.compute.manager [req-796736b9-d13b-47a1-932f-79c2e12329cb req-5e064c5d-87fc-4eb5-9795-0060e393b14d service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] No waiting events found dispatching network-vif-plugged-951f9dec-9a54-4fca-a7d4-c0044b873dbf {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:47:49 user nova-compute[74342]: WARNING nova.compute.manager [req-796736b9-d13b-47a1-932f-79c2e12329cb req-5e064c5d-87fc-4eb5-9795-0060e393b14d service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Received unexpected event network-vif-plugged-951f9dec-9a54-4fca-a7d4-c0044b873dbf for instance with vm_state building and task_state spawning.
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.compute.manager [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 2.049s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:49 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Instance spawned successfully.
Oct 16 09:47:49 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:47:49 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8284MB free_disk=25.410308837890625GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.211s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:49 user nova-compute[74342]: INFO nova.compute.manager [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Took 6.75 seconds to spawn the instance on the hypervisor.
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.compute.manager [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk 1073741824" returned: 0 in 0.089s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.304s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance d45abd20-3a58-4657-8f4c-a426d8e39be3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 98367a96-22f0-4edb-ab03-a8eb286b437b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance bdcd2e60-b36c-4d87-94d7-076e7430e1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 719428d6-025b-4baa-97a2-c8ebdd49f57e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 017caffb-5be2-4e78-ab48-a8091c5c00f4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 5dc86029-dcbf-4886-bdc9-7d4413059c96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance edcefbe0-e89f-4496-9032-f9431d9d5c53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 09:47:49 user nova-compute[74342]: INFO nova.compute.manager [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Took 7.76 seconds to build instance.
Oct 16 09:47:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ef92cee6-9e58-495d-8c1d-5188db553ad1 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "5dc86029-dcbf-4886-bdc9-7d4413059c96" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.872s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.237s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Checking if we can resize image /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.network.neutron [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Successfully updated port: 5a9f3200-5a15-4afa-b812-7b68e3130d6d {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "refresh_cache-edcefbe0-e89f-4496-9032-f9431d9d5c53" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquired lock "refresh_cache-edcefbe0-e89f-4496-9032-f9431d9d5c53" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.network.neutron [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.network.neutron [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.747s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Cannot resize image /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Ensure instance console log exists: /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.network.neutron [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Updating instance_info_cache with network_info: [{"id": "5a9f3200-5a15-4afa-b812-7b68e3130d6d", "address": "fa:16:3e:df:2e:36", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a9f3200-5a", "ovs_interfaceid": "5a9f3200-5a15-4afa-b812-7b68e3130d6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Releasing lock "refresh_cache-edcefbe0-e89f-4496-9032-f9431d9d5c53" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.compute.manager [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Instance network_info: |[{"id": "5a9f3200-5a15-4afa-b812-7b68e3130d6d", "address": "fa:16:3e:df:2e:36", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a9f3200-5a", "ovs_interfaceid": "5a9f3200-5a15-4afa-b812-7b68e3130d6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Start _get_guest_xml network_info=[{"id": "5a9f3200-5a15-4afa-b812-7b68e3130d6d", "address": "fa:16:3e:df:2e:36", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a9f3200-5a", "ovs_interfaceid": "5a9f3200-5a15-4afa-b812-7b68e3130d6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:47:50 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:47:50 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:47:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-139790548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-139790548',id=14,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4fcf2437a2d413ea584d0cc2508bed3',ramdisk_id='',reservation_id='r-8nb2dk74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-476995503',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:47:47Z,user_data=None,user_id='f90f091b76254a13957807feaeaef3fc',uuid=edcefbe0-e89f-4496-9032-f9431d9d5c53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a9f3200-5a15-4afa-b812-7b68e3130d6d", "address": "fa:16:3e:df:2e:36", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a9f3200-5a", "ovs_interfaceid": "5a9f3200-5a15-4afa-b812-7b68e3130d6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Converting VIF {"id": "5a9f3200-5a15-4afa-b812-7b68e3130d6d", "address": "fa:16:3e:df:2e:36", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a9f3200-5a", "ovs_interfaceid": "5a9f3200-5a15-4afa-b812-7b68e3130d6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:2e:36,bridge_name='br-int',has_traffic_filtering=True,id=5a9f3200-5a15-4afa-b812-7b68e3130d6d,network=Network(a571ad70-6f8b-4b02-86b9-df50290509f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a9f3200-5a') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.objects.instance [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lazy-loading 'pci_devices' on Instance uuid edcefbe0-e89f-4496-9032-f9431d9d5c53 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:47:50 user nova-compute[74342]:   <uuid>edcefbe0-e89f-4496-9032-f9431d9d5c53</uuid>
Oct 16 09:47:50 user nova-compute[74342]:   <name>instance-0000000e</name>
Oct 16 09:47:50 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:47:50 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:47:50 user nova-compute[74342]:   <metadata>
Oct 16 09:47:50 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:47:50 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:47:50 user nova-compute[74342]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-139790548</nova:name>
Oct 16 09:47:50 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:47:50</nova:creationTime>
Oct 16 09:47:50 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:47:50 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:47:50 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:47:50 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:47:50 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:47:50 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:47:50 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:47:50 user nova-compute[74342]:       <nova:owner>
Oct 16 09:47:50 user nova-compute[74342]:         <nova:user uuid="f90f091b76254a13957807feaeaef3fc">tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member</nova:user>
Oct 16 09:47:50 user nova-compute[74342]:         <nova:project uuid="a4fcf2437a2d413ea584d0cc2508bed3">tempest-ServerBootFromVolumeStableRescueTest-476995503</nova:project>
Oct 16 09:47:50 user nova-compute[74342]:       </nova:owner>
Oct 16 09:47:50 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:47:50 user nova-compute[74342]:       <nova:ports>
Oct 16 09:47:50 user nova-compute[74342]:         <nova:port uuid="5a9f3200-5a15-4afa-b812-7b68e3130d6d">
Oct 16 09:47:50 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 16 09:47:50 user nova-compute[74342]:         </nova:port>
Oct 16 09:47:50 user nova-compute[74342]:       </nova:ports>
Oct 16 09:47:50 user nova-compute[74342]:     </nova:instance>
Oct 16 09:47:50 user nova-compute[74342]:   </metadata>
Oct 16 09:47:50 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:47:50 user nova-compute[74342]:     <system>
Oct 16 09:47:50 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:47:50 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:47:50 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:47:50 user nova-compute[74342]:       <entry name="serial">edcefbe0-e89f-4496-9032-f9431d9d5c53</entry>
Oct 16 09:47:50 user nova-compute[74342]:       <entry name="uuid">edcefbe0-e89f-4496-9032-f9431d9d5c53</entry>
Oct 16 09:47:50 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:47:50 user nova-compute[74342]:     </system>
Oct 16 09:47:50 user nova-compute[74342]:   </sysinfo>
Oct 16 09:47:50 user nova-compute[74342]:   <os>
Oct 16 09:47:50 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:47:50 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:47:50 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:47:50 user nova-compute[74342]:   </os>
Oct 16 09:47:50 user nova-compute[74342]:   <features>
Oct 16 09:47:50 user nova-compute[74342]:     <acpi/>
Oct 16 09:47:50 user nova-compute[74342]:     <apic/>
Oct 16 09:47:50 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:47:50 user nova-compute[74342]:   </features>
Oct 16 09:47:50 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:47:50 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:47:50 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:47:50 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:47:50 user nova-compute[74342]:   </clock>
Oct 16 09:47:50 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:47:50 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:47:50 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:47:50 user nova-compute[74342]:   </cpu>
Oct 16 09:47:50 user nova-compute[74342]:   <devices>
Oct 16 09:47:50 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 09:47:50 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 09:47:50 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk"/>
Oct 16 09:47:50 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:47:50 user nova-compute[74342]:     </disk>
Oct 16 09:47:50 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:47:50 user nova-compute[74342]:       <mac address="fa:16:3e:df:2e:36"/>
Oct 16 09:47:50 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:47:50 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:47:50 user nova-compute[74342]:       <target dev="tap5a9f3200-5a"/>
Oct 16 09:47:50 user nova-compute[74342]:     </interface>
Oct 16 09:47:50 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:47:50 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/console.log" append="off"/>
Oct 16 09:47:50 user nova-compute[74342]:     </serial>
Oct 16 09:47:50 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:47:50 user nova-compute[74342]:     <video>
Oct 16 09:47:50 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:47:50 user nova-compute[74342]:     </video>
Oct 16 09:47:50 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:47:50 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:47:50 user nova-compute[74342]:     </rng>
Oct 16 09:47:50 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:47:50 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:47:50 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:47:50 user nova-compute[74342]:     </memballoon>
Oct 16 09:47:50 user nova-compute[74342]:   </devices>
Oct 16 09:47:50 user nova-compute[74342]: </domain>
Oct 16 09:47:50 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:47:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-139790548',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-139790548',id=14,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4fcf2437a2d413ea584d0cc2508bed3',ramdisk_id='',reservation_id='r-8nb2dk74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-476995503',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:47:47Z,user_data=None,user_id='f90f091b76254a13957807feaeaef3fc',uuid=edcefbe0-e89f-4496-9032-f9431d9d5c53,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5a9f3200-5a15-4afa-b812-7b68e3130d6d", "address": "fa:16:3e:df:2e:36", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a9f3200-5a", "ovs_interfaceid": "5a9f3200-5a15-4afa-b812-7b68e3130d6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Converting VIF {"id": "5a9f3200-5a15-4afa-b812-7b68e3130d6d", "address": "fa:16:3e:df:2e:36", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a9f3200-5a", "ovs_interfaceid": "5a9f3200-5a15-4afa-b812-7b68e3130d6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:2e:36,bridge_name='br-int',has_traffic_filtering=True,id=5a9f3200-5a15-4afa-b812-7b68e3130d6d,network=Network(a571ad70-6f8b-4b02-86b9-df50290509f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a9f3200-5a') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG os_vif [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:2e:36,bridge_name='br-int',has_traffic_filtering=True,id=5a9f3200-5a15-4afa-b812-7b68e3130d6d,network=Network(a571ad70-6f8b-4b02-86b9-df50290509f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a9f3200-5a') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b5b6817b-887e-56a7-ac61-3e5c9196ab5c', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5a9f3200-5a, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5a9f3200-5a, col_values=(('qos', UUID('d5c8d7f5-537b-4d59-ac77-fa0911a50bfc')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5a9f3200-5a, col_values=(('external_ids', {'iface-id': '5a9f3200-5a15-4afa-b812-7b68e3130d6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:2e:36', 'vm-uuid': 'edcefbe0-e89f-4496-9032-f9431d9d5c53'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:50 user nova-compute[74342]: INFO os_vif [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:2e:36,bridge_name='br-int',has_traffic_filtering=True,id=5a9f3200-5a15-4afa-b812-7b68e3130d6d,network=Network(a571ad70-6f8b-4b02-86b9-df50290509f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a9f3200-5a')
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] No VIF found with MAC fa:16:3e:df:2e:36, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.compute.manager [req-52553127-a9fc-43e2-97f8-0cb0c4ad6712 req-d16b8c7b-d5ac-4d02-b13c-c64a26b86a06 service nova] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Received event network-changed-5a9f3200-5a15-4afa-b812-7b68e3130d6d {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.compute.manager [req-52553127-a9fc-43e2-97f8-0cb0c4ad6712 req-d16b8c7b-d5ac-4d02-b13c-c64a26b86a06 service nova] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Refreshing instance network info cache due to event network-changed-5a9f3200-5a15-4afa-b812-7b68e3130d6d. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-52553127-a9fc-43e2-97f8-0cb0c4ad6712 req-d16b8c7b-d5ac-4d02-b13c-c64a26b86a06 service nova] Acquiring lock "refresh_cache-edcefbe0-e89f-4496-9032-f9431d9d5c53" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-52553127-a9fc-43e2-97f8-0cb0c4ad6712 req-d16b8c7b-d5ac-4d02-b13c-c64a26b86a06 service nova] Acquired lock "refresh_cache-edcefbe0-e89f-4496-9032-f9431d9d5c53" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.network.neutron [req-52553127-a9fc-43e2-97f8-0cb0c4ad6712 req-d16b8c7b-d5ac-4d02-b13c-c64a26b86a06 service nova] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Refreshing network info cache for port 5a9f3200-5a15-4afa-b812-7b68e3130d6d {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.network.neutron [req-52553127-a9fc-43e2-97f8-0cb0c4ad6712 req-d16b8c7b-d5ac-4d02-b13c-c64a26b86a06 service nova] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Updated VIF entry in instance network info cache for port 5a9f3200-5a15-4afa-b812-7b68e3130d6d. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG nova.network.neutron [req-52553127-a9fc-43e2-97f8-0cb0c4ad6712 req-d16b8c7b-d5ac-4d02-b13c-c64a26b86a06 service nova] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Updating instance_info_cache with network_info: [{"id": "5a9f3200-5a15-4afa-b812-7b68e3130d6d", "address": "fa:16:3e:df:2e:36", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a9f3200-5a", "ovs_interfaceid": "5a9f3200-5a15-4afa-b812-7b68e3130d6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:47:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-52553127-a9fc-43e2-97f8-0cb0c4ad6712 req-d16b8c7b-d5ac-4d02-b13c-c64a26b86a06 service nova] Releasing lock "refresh_cache-edcefbe0-e89f-4496-9032-f9431d9d5c53" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:47:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:52 user nova-compute[74342]: DEBUG nova.compute.manager [req-07f60593-c0e8-4b9d-b89b-f7e012cd7abb req-b20336bb-c813-4f92-843a-df7172ddc7d0 service nova] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Received event network-vif-plugged-5a9f3200-5a15-4afa-b812-7b68e3130d6d {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:47:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-07f60593-c0e8-4b9d-b89b-f7e012cd7abb req-b20336bb-c813-4f92-843a-df7172ddc7d0 service nova] Acquiring lock "edcefbe0-e89f-4496-9032-f9431d9d5c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-07f60593-c0e8-4b9d-b89b-f7e012cd7abb req-b20336bb-c813-4f92-843a-df7172ddc7d0 service nova] Lock "edcefbe0-e89f-4496-9032-f9431d9d5c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-07f60593-c0e8-4b9d-b89b-f7e012cd7abb req-b20336bb-c813-4f92-843a-df7172ddc7d0 service nova] Lock "edcefbe0-e89f-4496-9032-f9431d9d5c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:52 user nova-compute[74342]: DEBUG nova.compute.manager [req-07f60593-c0e8-4b9d-b89b-f7e012cd7abb req-b20336bb-c813-4f92-843a-df7172ddc7d0 service nova] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] No waiting events found dispatching network-vif-plugged-5a9f3200-5a15-4afa-b812-7b68e3130d6d {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:47:52 user nova-compute[74342]: WARNING nova.compute.manager [req-07f60593-c0e8-4b9d-b89b-f7e012cd7abb req-b20336bb-c813-4f92-843a-df7172ddc7d0 service nova] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Received unexpected event network-vif-plugged-5a9f3200-5a15-4afa-b812-7b68e3130d6d for instance with vm_state building and task_state spawning.
Oct 16 09:47:52 user nova-compute[74342]: DEBUG nova.compute.manager [req-07f60593-c0e8-4b9d-b89b-f7e012cd7abb req-b20336bb-c813-4f92-843a-df7172ddc7d0 service nova] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Received event network-vif-plugged-5a9f3200-5a15-4afa-b812-7b68e3130d6d {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:47:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-07f60593-c0e8-4b9d-b89b-f7e012cd7abb req-b20336bb-c813-4f92-843a-df7172ddc7d0 service nova] Acquiring lock "edcefbe0-e89f-4496-9032-f9431d9d5c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:47:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-07f60593-c0e8-4b9d-b89b-f7e012cd7abb req-b20336bb-c813-4f92-843a-df7172ddc7d0 service nova] Lock "edcefbe0-e89f-4496-9032-f9431d9d5c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:47:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-07f60593-c0e8-4b9d-b89b-f7e012cd7abb req-b20336bb-c813-4f92-843a-df7172ddc7d0 service nova] Lock "edcefbe0-e89f-4496-9032-f9431d9d5c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:52 user nova-compute[74342]: DEBUG nova.compute.manager [req-07f60593-c0e8-4b9d-b89b-f7e012cd7abb req-b20336bb-c813-4f92-843a-df7172ddc7d0 service nova] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] No waiting events found dispatching network-vif-plugged-5a9f3200-5a15-4afa-b812-7b68e3130d6d {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:47:52 user nova-compute[74342]: WARNING nova.compute.manager [req-07f60593-c0e8-4b9d-b89b-f7e012cd7abb req-b20336bb-c813-4f92-843a-df7172ddc7d0 service nova] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Received unexpected event network-vif-plugged-5a9f3200-5a15-4afa-b812-7b68e3130d6d for instance with vm_state building and task_state spawning.
Oct 16 09:47:53 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:47:53 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:47:53 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:47:53 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 09:47:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-bdcd2e60-b36c-4d87-94d7-076e7430e1f0" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:47:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-bdcd2e60-b36c-4d87-94d7-076e7430e1f0" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:47:54 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 09:47:54 user nova-compute[74342]: DEBUG nova.compute.manager [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:47:54 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:47:54 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Instance spawned successfully.
Oct 16 09:47:54 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:47:54 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:47:54 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:47:54 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:47:54 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:47:54 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:47:54 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:47:54 user nova-compute[74342]: INFO nova.compute.manager [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Took 7.41 seconds to spawn the instance on the hypervisor.
Oct 16 09:47:54 user nova-compute[74342]: DEBUG nova.compute.manager [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:47:54 user nova-compute[74342]: INFO nova.compute.manager [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Took 8.57 seconds to build instance.
Oct 16 09:47:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-54ad3db3-7266-46b7-8647-639ce0418b6d tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "edcefbe0-e89f-4496-9032-f9431d9d5c53" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.700s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:47:54 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Updating instance_info_cache with network_info: [{"id": "6880e1ef-5122-458c-a9b8-a8202cdee055", "address": "fa:16:3e:22:60:5b", "network": {"id": "b9e6ad97-cbbe-40e7-b487-5fc89166bc6a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-718322219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6679e55d6a194b399b6b2d27a8cbb147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6880e1ef-51", "ovs_interfaceid": "6880e1ef-5122-458c-a9b8-a8202cdee055", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:47:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-bdcd2e60-b36c-4d87-94d7-076e7430e1f0" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:47:54 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 09:47:54 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:47:54 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:47:54 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:47:54 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:47:54 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:47:54 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 09:47:55 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:58 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Waiting for libvirt event about the detach of device tapdbff0b7a-67 with device alias net1 from instance 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4 is timed out.
Oct 16 09:47:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:dd:08:71"/><model type="virtio"/><mtu size="1442"/><target dev="tapdbff0b7a-67"/></interface> {{(pid=74342) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 16 09:47:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:dd:08:71"/><model type="virtio"/><mtu size="1442"/><target dev="tapdbff0b7a-67"/></interface>not found in domain: <domain type='kvm' id='6'>
Oct 16 09:47:58 user nova-compute[74342]:   <name>instance-00000006</name>
Oct 16 09:47:58 user nova-compute[74342]:   <uuid>1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4</uuid>
Oct 16 09:47:58 user nova-compute[74342]:   <metadata>
Oct 16 09:47:58 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:47:58 user nova-compute[74342]:   <nova:package version="0.0.0"/>
Oct 16 09:47:58 user nova-compute[74342]:   <nova:name>tempest-device-tagging-server-640949209</nova:name>
Oct 16 09:47:58 user nova-compute[74342]:   <nova:creationTime>2023-10-16 09:46:14</nova:creationTime>
Oct 16 09:47:58 user nova-compute[74342]:   <nova:flavor name="m1.tiny">
Oct 16 09:47:58 user nova-compute[74342]:     <nova:memory>512</nova:memory>
Oct 16 09:47:58 user nova-compute[74342]:     <nova:disk>1</nova:disk>
Oct 16 09:47:58 user nova-compute[74342]:     <nova:swap>0</nova:swap>
Oct 16 09:47:58 user nova-compute[74342]:     <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:47:58 user nova-compute[74342]:     <nova:vcpus>1</nova:vcpus>
Oct 16 09:47:58 user nova-compute[74342]:   </nova:flavor>
Oct 16 09:47:58 user nova-compute[74342]:   <nova:owner>
Oct 16 09:47:58 user nova-compute[74342]:     <nova:user uuid="580c2bb824f04735a5a0b0d6f594bde3">tempest-TaggedAttachmentsTest-1445023395-project-member</nova:user>
Oct 16 09:47:58 user nova-compute[74342]:     <nova:project uuid="3a64826b7567493ab7deee5994b261e7">tempest-TaggedAttachmentsTest-1445023395</nova:project>
Oct 16 09:47:58 user nova-compute[74342]:   </nova:owner>
Oct 16 09:47:58 user nova-compute[74342]:   <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:47:58 user nova-compute[74342]:   <nova:ports>
Oct 16 09:47:58 user nova-compute[74342]:     <nova:port uuid="ecb4fcc0-8f58-493c-9804-76bf3603b899">
Oct 16 09:47:58 user nova-compute[74342]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 09:47:58 user nova-compute[74342]:     </nova:port>
Oct 16 09:47:58 user nova-compute[74342]:     <nova:port uuid="dbff0b7a-6769-4dfc-bfa0-5273815bdc08">
Oct 16 09:47:58 user nova-compute[74342]:       <nova:ip type="fixed" address="10.10.10.10" ipVersion="4"/>
Oct 16 09:47:58 user nova-compute[74342]:     </nova:port>
Oct 16 09:47:58 user nova-compute[74342]:   </nova:ports>
Oct 16 09:47:58 user nova-compute[74342]: </nova:instance>
Oct 16 09:47:58 user nova-compute[74342]:   </metadata>
Oct 16 09:47:58 user nova-compute[74342]:   <memory unit='KiB'>524288</memory>
Oct 16 09:47:58 user nova-compute[74342]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 16 09:47:58 user nova-compute[74342]:   <vcpu placement='static'>1</vcpu>
Oct 16 09:47:58 user nova-compute[74342]:   <resource>
Oct 16 09:47:58 user nova-compute[74342]:     <partition>/machine</partition>
Oct 16 09:47:58 user nova-compute[74342]:   </resource>
Oct 16 09:47:58 user nova-compute[74342]:   <sysinfo type='smbios'>
Oct 16 09:47:58 user nova-compute[74342]:     <system>
Oct 16 09:47:58 user nova-compute[74342]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 16 09:47:58 user nova-compute[74342]:       <entry name='product'>OpenStack Nova</entry>
Oct 16 09:47:58 user nova-compute[74342]:       <entry name='version'>0.0.0</entry>
Oct 16 09:47:58 user nova-compute[74342]:       <entry name='serial'>1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4</entry>
Oct 16 09:47:58 user nova-compute[74342]:       <entry name='uuid'>1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4</entry>
Oct 16 09:47:58 user nova-compute[74342]:       <entry name='family'>Virtual Machine</entry>
Oct 16 09:47:58 user nova-compute[74342]:     </system>
Oct 16 09:47:58 user nova-compute[74342]:   </sysinfo>
Oct 16 09:47:58 user nova-compute[74342]:   <os>
Oct 16 09:47:58 user nova-compute[74342]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 16 09:47:58 user nova-compute[74342]:     <boot dev='hd'/>
Oct 16 09:47:58 user nova-compute[74342]:     <smbios mode='sysinfo'/>
Oct 16 09:47:58 user nova-compute[74342]:   </os>
Oct 16 09:47:58 user nova-compute[74342]:   <features>
Oct 16 09:47:58 user nova-compute[74342]:     <acpi/>
Oct 16 09:47:58 user nova-compute[74342]:     <apic/>
Oct 16 09:47:58 user nova-compute[74342]:     <vmcoreinfo state='on'/>
Oct 16 09:47:58 user nova-compute[74342]:   </features>
Oct 16 09:47:58 user nova-compute[74342]:   <cpu mode='custom' match='exact' check='full'>
Oct 16 09:47:58 user nova-compute[74342]:     <model fallback='forbid'>Nehalem</model>
Oct 16 09:47:58 user nova-compute[74342]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 16 09:47:58 user nova-compute[74342]:     <feature policy='require' name='vme'/>
Oct 16 09:47:58 user nova-compute[74342]:     <feature policy='require' name='x2apic'/>
Oct 16 09:47:58 user nova-compute[74342]:     <feature policy='require' name='hypervisor'/>
Oct 16 09:47:58 user nova-compute[74342]:   </cpu>
Oct 16 09:47:58 user nova-compute[74342]:   <clock offset='utc'>
Oct 16 09:47:58 user nova-compute[74342]:     <timer name='pit' tickpolicy='delay'/>
Oct 16 09:47:58 user nova-compute[74342]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 16 09:47:58 user nova-compute[74342]:     <timer name='hpet' present='no'/>
Oct 16 09:47:58 user nova-compute[74342]:   </clock>
Oct 16 09:47:58 user nova-compute[74342]:   <on_poweroff>destroy</on_poweroff>
Oct 16 09:47:58 user nova-compute[74342]:   <on_reboot>restart</on_reboot>
Oct 16 09:47:58 user nova-compute[74342]:   <on_crash>destroy</on_crash>
Oct 16 09:47:58 user nova-compute[74342]:   <devices>
Oct 16 09:47:58 user nova-compute[74342]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 16 09:47:58 user nova-compute[74342]:     <disk type='file' device='disk'>
Oct 16 09:47:58 user nova-compute[74342]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 16 09:47:58 user nova-compute[74342]:       <source file='/opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk' index='2'/>
Oct 16 09:47:58 user nova-compute[74342]:       <backingStore type='file' index='3'>
Oct 16 09:47:58 user nova-compute[74342]:         <format type='raw'/>
Oct 16 09:47:58 user nova-compute[74342]:         <source file='/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd'/>
Oct 16 09:47:58 user nova-compute[74342]:         <backingStore/>
Oct 16 09:47:58 user nova-compute[74342]:       </backingStore>
Oct 16 09:47:58 user nova-compute[74342]:       <target dev='vda' bus='virtio'/>
Oct 16 09:47:58 user nova-compute[74342]:       <alias name='virtio-disk0'/>
Oct 16 09:47:58 user nova-compute[74342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 16 09:47:58 user nova-compute[74342]:     </disk>
Oct 16 09:47:58 user nova-compute[74342]:     <disk type='file' device='cdrom'>
Oct 16 09:47:58 user nova-compute[74342]:       <driver name='qemu' type='raw' cache='none'/>
Oct 16 09:47:58 user nova-compute[74342]:       <source file='/opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk.config' index='1'/>
Oct 16 09:47:58 user nova-compute[74342]:       <backingStore/>
Oct 16 09:47:58 user nova-compute[74342]:       <target dev='hda' bus='ide'/>
Oct 16 09:47:58 user nova-compute[74342]:       <readonly/>
Oct 16 09:47:58 user nova-compute[74342]:       <alias name='ide0-0-0'/>
Oct 16 09:47:58 user nova-compute[74342]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 16 09:47:58 user nova-compute[74342]:     </disk>
Oct 16 09:47:58 user nova-compute[74342]:     <controller type='usb' index='0' model='none'>
Oct 16 09:47:58 user nova-compute[74342]:       <alias name='usb'/>
Oct 16 09:47:58 user nova-compute[74342]:     </controller>
Oct 16 09:47:58 user nova-compute[74342]:     <controller type='pci' index='0' model='pci-root'>
Oct 16 09:47:58 user nova-compute[74342]:       <alias name='pci.0'/>
Oct 16 09:47:58 user nova-compute[74342]:     </controller>
Oct 16 09:47:58 user nova-compute[74342]:     <controller type='ide' index='0'>
Oct 16 09:47:58 user nova-compute[74342]:       <alias name='ide'/>
Oct 16 09:47:58 user nova-compute[74342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 16 09:47:58 user nova-compute[74342]:     </controller>
Oct 16 09:47:58 user nova-compute[74342]:     <interface type='ethernet'>
Oct 16 09:47:58 user nova-compute[74342]:       <mac address='fa:16:3e:27:36:3d'/>
Oct 16 09:47:58 user nova-compute[74342]:       <target dev='tapecb4fcc0-8f'/>
Oct 16 09:47:58 user nova-compute[74342]:       <model type='virtio'/>
Oct 16 09:47:58 user nova-compute[74342]:       <mtu size='1442'/>
Oct 16 09:47:58 user nova-compute[74342]:       <alias name='net0'/>
Oct 16 09:47:58 user nova-compute[74342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 16 09:47:58 user nova-compute[74342]:     </interface>
Oct 16 09:47:58 user nova-compute[74342]:     <serial type='pty'>
Oct 16 09:47:58 user nova-compute[74342]:       <source path='/dev/pts/5'/>
Oct 16 09:47:58 user nova-compute[74342]:       <log file='/opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/console.log' append='off'/>
Oct 16 09:47:58 user nova-compute[74342]:       <target type='isa-serial' port='0'>
Oct 16 09:47:58 user nova-compute[74342]:         <model name='isa-serial'/>
Oct 16 09:47:58 user nova-compute[74342]:       </target>
Oct 16 09:47:58 user nova-compute[74342]:       <alias name='serial0'/>
Oct 16 09:47:58 user nova-compute[74342]:     </serial>
Oct 16 09:47:58 user nova-compute[74342]:     <console type='pty' tty='/dev/pts/5'>
Oct 16 09:47:58 user nova-compute[74342]:       <source path='/dev/pts/5'/>
Oct 16 09:47:58 user nova-compute[74342]:       <log file='/opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/console.log' append='off'/>
Oct 16 09:47:58 user nova-compute[74342]:       <target type='serial' port='0'/>
Oct 16 09:47:58 user nova-compute[74342]:       <alias name='serial0'/>
Oct 16 09:47:58 user nova-compute[74342]:     </console>
Oct 16 09:47:58 user nova-compute[74342]:     <input type='mouse' bus='ps2'>
Oct 16 09:47:58 user nova-compute[74342]:       <alias name='input0'/>
Oct 16 09:47:58 user nova-compute[74342]:     </input>
Oct 16 09:47:58 user nova-compute[74342]:     <input type='keyboard' bus='ps2'>
Oct 16 09:47:58 user nova-compute[74342]:       <alias name='input1'/>
Oct 16 09:47:58 user nova-compute[74342]:     </input>
Oct 16 09:47:58 user nova-compute[74342]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Oct 16 09:47:58 user nova-compute[74342]:       <listen type='address' address='0.0.0.0'/>
Oct 16 09:47:58 user nova-compute[74342]:     </graphics>
Oct 16 09:47:58 user nova-compute[74342]:     <audio id='1' type='none'/>
Oct 16 09:47:58 user nova-compute[74342]:     <video>
Oct 16 09:47:58 user nova-compute[74342]:       <model type='virtio' heads='1' primary='yes'/>
Oct 16 09:47:58 user nova-compute[74342]:       <alias name='video0'/>
Oct 16 09:47:58 user nova-compute[74342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 16 09:47:58 user nova-compute[74342]:     </video>
Oct 16 09:47:58 user nova-compute[74342]:     <memballoon model='virtio'>
Oct 16 09:47:58 user nova-compute[74342]:       <stats period='10'/>
Oct 16 09:47:58 user nova-compute[74342]:       <alias name='balloon0'/>
Oct 16 09:47:58 user nova-compute[74342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 16 09:47:58 user nova-compute[74342]:     </memballoon>
Oct 16 09:47:58 user nova-compute[74342]:     <rng model='virtio'>
Oct 16 09:47:58 user nova-compute[74342]:       <backend model='random'>/dev/urandom</backend>
Oct 16 09:47:58 user nova-compute[74342]:       <alias name='rng0'/>
Oct 16 09:47:58 user nova-compute[74342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 16 09:47:58 user nova-compute[74342]:     </rng>
Oct 16 09:47:58 user nova-compute[74342]:   </devices>
Oct 16 09:47:58 user nova-compute[74342]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 16 09:47:58 user nova-compute[74342]:     <label>libvirt-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4</label>
Oct 16 09:47:58 user nova-compute[74342]:     <imagelabel>libvirt-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4</imagelabel>
Oct 16 09:47:58 user nova-compute[74342]:   </seclabel>
Oct 16 09:47:58 user nova-compute[74342]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 16 09:47:58 user nova-compute[74342]:     <label>+64055:+108</label>
Oct 16 09:47:58 user nova-compute[74342]:     <imagelabel>+64055:+108</imagelabel>
Oct 16 09:47:58 user nova-compute[74342]:   </seclabel>
Oct 16 09:47:58 user nova-compute[74342]: </domain>
Oct 16 09:47:58 user nova-compute[74342]:  {{(pid=74342) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 16 09:47:58 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Successfully detached device tapdbff0b7a-67 from instance 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4 from the live domain config.
Oct 16 09:47:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T09:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-640949209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-640949209',id=6,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpYhQn0nZA6I7ZVLvCwhw5MRkVm+i8dhF9cA+w+3K6essQXKu4e2BqUgXONrqsgQPLMNC9JJK382LUfvK2FFKrfh3cM12JiZnpdknV1HPaHjSi3tgNn41IJGEsjJsOpHg==',key_name='tempest-keypair-1377321458',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:44:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a64826b7567493ab7deee5994b261e7',ramdisk_id='',reservation_id='r-v3nxv2mx',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1445023395',owner_user_name='tempest-TaggedAttachmentsTest-1445023395-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:44:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='580c2bb824f04735a5a0b0d6f594bde3',uuid=1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbff0b7a-6769-4dfc-bfa0-5273815bdc08", "address": "fa:16:3e:dd:08:71", "network": {"id": "39a0bf3b-4fbd-49ec-b90c-8f14f2ab4045", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-705696688", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3a64826b7567493ab7deee5994b261e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbff0b7a-67", "ovs_interfaceid": "dbff0b7a-6769-4dfc-bfa0-5273815bdc08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:47:58 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Converting VIF {"id": "dbff0b7a-6769-4dfc-bfa0-5273815bdc08", "address": "fa:16:3e:dd:08:71", "network": {"id": "39a0bf3b-4fbd-49ec-b90c-8f14f2ab4045", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-705696688", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3a64826b7567493ab7deee5994b261e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbff0b7a-67", "ovs_interfaceid": "dbff0b7a-6769-4dfc-bfa0-5273815bdc08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:47:58 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:08:71,bridge_name='br-int',has_traffic_filtering=True,id=dbff0b7a-6769-4dfc-bfa0-5273815bdc08,network=Network(39a0bf3b-4fbd-49ec-b90c-8f14f2ab4045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbff0b7a-67') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:47:58 user nova-compute[74342]: DEBUG os_vif [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:08:71,bridge_name='br-int',has_traffic_filtering=True,id=dbff0b7a-6769-4dfc-bfa0-5273815bdc08,network=Network(39a0bf3b-4fbd-49ec-b90c-8f14f2ab4045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbff0b7a-67') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:47:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbff0b7a-67, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=00895a21-b701-4e32-a5eb-6c9254ae4e5b) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:47:58 user nova-compute[74342]: INFO os_vif [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:08:71,bridge_name='br-int',has_traffic_filtering=True,id=dbff0b7a-6769-4dfc-bfa0-5273815bdc08,network=Network(39a0bf3b-4fbd-49ec-b90c-8f14f2ab4045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbff0b7a-67')
Oct 16 09:47:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:47:58 user nova-compute[74342]:   <nova:package version="0.0.0"/>
Oct 16 09:47:58 user nova-compute[74342]:   <nova:name>tempest-device-tagging-server-640949209</nova:name>
Oct 16 09:47:58 user nova-compute[74342]:   <nova:creationTime>2023-10-16 09:47:58</nova:creationTime>
Oct 16 09:47:58 user nova-compute[74342]:   <nova:flavor name="m1.tiny">
Oct 16 09:47:58 user nova-compute[74342]:     <nova:memory>512</nova:memory>
Oct 16 09:47:58 user nova-compute[74342]:     <nova:disk>1</nova:disk>
Oct 16 09:47:58 user nova-compute[74342]:     <nova:swap>0</nova:swap>
Oct 16 09:47:58 user nova-compute[74342]:     <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:47:58 user nova-compute[74342]:     <nova:vcpus>1</nova:vcpus>
Oct 16 09:47:58 user nova-compute[74342]:   </nova:flavor>
Oct 16 09:47:58 user nova-compute[74342]:   <nova:owner>
Oct 16 09:47:58 user nova-compute[74342]:     <nova:user uuid="580c2bb824f04735a5a0b0d6f594bde3">tempest-TaggedAttachmentsTest-1445023395-project-member</nova:user>
Oct 16 09:47:58 user nova-compute[74342]:     <nova:project uuid="3a64826b7567493ab7deee5994b261e7">tempest-TaggedAttachmentsTest-1445023395</nova:project>
Oct 16 09:47:58 user nova-compute[74342]:   </nova:owner>
Oct 16 09:47:58 user nova-compute[74342]:   <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:47:58 user nova-compute[74342]:   <nova:ports>
Oct 16 09:47:58 user nova-compute[74342]:     <nova:port uuid="ecb4fcc0-8f58-493c-9804-76bf3603b899">
Oct 16 09:47:58 user nova-compute[74342]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 09:47:58 user nova-compute[74342]:     </nova:port>
Oct 16 09:47:58 user nova-compute[74342]:   </nova:ports>
Oct 16 09:47:58 user nova-compute[74342]: </nova:instance>
Oct 16 09:47:58 user nova-compute[74342]:  {{(pid=74342) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 16 09:47:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:59 user nova-compute[74342]: DEBUG nova.compute.manager [req-a6bb7137-5c70-47e4-ba68-8c0fd2b28672 req-477e1928-05c3-424b-abff-4aff393589e2 service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Received event network-vif-deleted-dbff0b7a-6769-4dfc-bfa0-5273815bdc08 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:47:59 user nova-compute[74342]: INFO nova.compute.manager [req-a6bb7137-5c70-47e4-ba68-8c0fd2b28672 req-477e1928-05c3-424b-abff-4aff393589e2 service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Neutron deleted interface dbff0b7a-6769-4dfc-bfa0-5273815bdc08; detaching it from the instance and deleting it from the info cache
Oct 16 09:47:59 user nova-compute[74342]: DEBUG nova.network.neutron [req-a6bb7137-5c70-47e4-ba68-8c0fd2b28672 req-477e1928-05c3-424b-abff-4aff393589e2 service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Updating instance_info_cache with network_info: [{"id": "ecb4fcc0-8f58-493c-9804-76bf3603b899", "address": "fa:16:3e:27:36:3d", "network": {"id": "7cc9829f-36e8-4fd9-9d62-78f3f0019d1f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-252337481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a64826b7567493ab7deee5994b261e7", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecb4fcc0-8f", "ovs_interfaceid": "ecb4fcc0-8f58-493c-9804-76bf3603b899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:47:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Acquiring lock "refresh_cache-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:47:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Acquired lock "refresh_cache-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:47:59 user nova-compute[74342]: DEBUG nova.network.neutron [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:47:59 user nova-compute[74342]: DEBUG nova.objects.instance [req-a6bb7137-5c70-47e4-ba68-8c0fd2b28672 req-477e1928-05c3-424b-abff-4aff393589e2 service nova] Lazy-loading 'system_metadata' on Instance uuid 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:47:59 user nova-compute[74342]: DEBUG nova.objects.instance [req-a6bb7137-5c70-47e4-ba68-8c0fd2b28672 req-477e1928-05c3-424b-abff-4aff393589e2 service nova] Lazy-loading 'flavor' on Instance uuid 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:47:59 user nova-compute[74342]: DEBUG nova.objects.base [req-a6bb7137-5c70-47e4-ba68-8c0fd2b28672 req-477e1928-05c3-424b-abff-4aff393589e2 service nova] Object Instance<1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4> lazy-loaded attributes: system_metadata,flavor {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 09:47:59 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [req-a6bb7137-5c70-47e4-ba68-8c0fd2b28672 req-477e1928-05c3-424b-abff-4aff393589e2 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T09:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-640949209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-640949209',id=6,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpYhQn0nZA6I7ZVLvCwhw5MRkVm+i8dhF9cA+w+3K6essQXKu4e2BqUgXONrqsgQPLMNC9JJK382LUfvK2FFKrfh3cM12JiZnpdknV1HPaHjSi3tgNn41IJGEsjJsOpHg==',key_name='tempest-keypair-1377321458',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:44:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a64826b7567493ab7deee5994b261e7',ramdisk_id='',reservation_id='r-v3nxv2mx',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1445023395',owner_user_name='tempest-TaggedAttachmentsTest-1445023395-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:44:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='580c2bb824f04735a5a0b0d6f594bde3',uuid=1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbff0b7a-6769-4dfc-bfa0-5273815bdc08", "address": "fa:16:3e:dd:08:71", "network": {"id": "39a0bf3b-4fbd-49ec-b90c-8f14f2ab4045", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-705696688", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3a64826b7567493ab7deee5994b261e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbff0b7a-67", "ovs_interfaceid": "dbff0b7a-6769-4dfc-bfa0-5273815bdc08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:47:59 user nova-compute[74342]: DEBUG nova.network.os_vif_util [req-a6bb7137-5c70-47e4-ba68-8c0fd2b28672 req-477e1928-05c3-424b-abff-4aff393589e2 service nova] Converting VIF {"id": "dbff0b7a-6769-4dfc-bfa0-5273815bdc08", "address": "fa:16:3e:dd:08:71", "network": {"id": "39a0bf3b-4fbd-49ec-b90c-8f14f2ab4045", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-705696688", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3a64826b7567493ab7deee5994b261e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbff0b7a-67", "ovs_interfaceid": "dbff0b7a-6769-4dfc-bfa0-5273815bdc08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:47:59 user nova-compute[74342]: DEBUG nova.network.os_vif_util [req-a6bb7137-5c70-47e4-ba68-8c0fd2b28672 req-477e1928-05c3-424b-abff-4aff393589e2 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:08:71,bridge_name='br-int',has_traffic_filtering=True,id=dbff0b7a-6769-4dfc-bfa0-5273815bdc08,network=Network(39a0bf3b-4fbd-49ec-b90c-8f14f2ab4045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbff0b7a-67') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:47:59 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [req-a6bb7137-5c70-47e4-ba68-8c0fd2b28672 req-477e1928-05c3-424b-abff-4aff393589e2 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:dd:08:71"/><model type="virtio"/><mtu size="1442"/><target dev="tapdbff0b7a-67"/></interface> {{(pid=74342) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 16 09:47:59 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [req-a6bb7137-5c70-47e4-ba68-8c0fd2b28672 req-477e1928-05c3-424b-abff-4aff393589e2 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:dd:08:71"/><model type="virtio"/><mtu size="1442"/><target dev="tapdbff0b7a-67"/></interface>not found in domain: <domain type='kvm' id='6'>
Oct 16 09:47:59 user nova-compute[74342]:   <name>instance-00000006</name>
Oct 16 09:47:59 user nova-compute[74342]:   <uuid>1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4</uuid>
Oct 16 09:47:59 user nova-compute[74342]:   <metadata>
Oct 16 09:47:59 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:47:59 user nova-compute[74342]:   <nova:package version="0.0.0"/>
Oct 16 09:47:59 user nova-compute[74342]:   <nova:name>tempest-device-tagging-server-640949209</nova:name>
Oct 16 09:47:59 user nova-compute[74342]:   <nova:creationTime>2023-10-16 09:47:58</nova:creationTime>
Oct 16 09:47:59 user nova-compute[74342]:   <nova:flavor name="m1.tiny">
Oct 16 09:47:59 user nova-compute[74342]:     <nova:memory>512</nova:memory>
Oct 16 09:47:59 user nova-compute[74342]:     <nova:disk>1</nova:disk>
Oct 16 09:47:59 user nova-compute[74342]:     <nova:swap>0</nova:swap>
Oct 16 09:47:59 user nova-compute[74342]:     <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:47:59 user nova-compute[74342]:     <nova:vcpus>1</nova:vcpus>
Oct 16 09:47:59 user nova-compute[74342]:   </nova:flavor>
Oct 16 09:47:59 user nova-compute[74342]:   <nova:owner>
Oct 16 09:47:59 user nova-compute[74342]:     <nova:user uuid="580c2bb824f04735a5a0b0d6f594bde3">tempest-TaggedAttachmentsTest-1445023395-project-member</nova:user>
Oct 16 09:47:59 user nova-compute[74342]:     <nova:project uuid="3a64826b7567493ab7deee5994b261e7">tempest-TaggedAttachmentsTest-1445023395</nova:project>
Oct 16 09:47:59 user nova-compute[74342]:   </nova:owner>
Oct 16 09:47:59 user nova-compute[74342]:   <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:47:59 user nova-compute[74342]:   <nova:ports>
Oct 16 09:47:59 user nova-compute[74342]:     <nova:port uuid="ecb4fcc0-8f58-493c-9804-76bf3603b899">
Oct 16 09:47:59 user nova-compute[74342]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 09:47:59 user nova-compute[74342]:     </nova:port>
Oct 16 09:47:59 user nova-compute[74342]:   </nova:ports>
Oct 16 09:47:59 user nova-compute[74342]: </nova:instance>
Oct 16 09:47:59 user nova-compute[74342]:   </metadata>
Oct 16 09:47:59 user nova-compute[74342]:   <memory unit='KiB'>524288</memory>
Oct 16 09:47:59 user nova-compute[74342]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 16 09:47:59 user nova-compute[74342]:   <vcpu placement='static'>1</vcpu>
Oct 16 09:47:59 user nova-compute[74342]:   <resource>
Oct 16 09:47:59 user nova-compute[74342]:     <partition>/machine</partition>
Oct 16 09:47:59 user nova-compute[74342]:   </resource>
Oct 16 09:47:59 user nova-compute[74342]:   <sysinfo type='smbios'>
Oct 16 09:47:59 user nova-compute[74342]:     <system>
Oct 16 09:47:59 user nova-compute[74342]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 16 09:47:59 user nova-compute[74342]:       <entry name='product'>OpenStack Nova</entry>
Oct 16 09:47:59 user nova-compute[74342]:       <entry name='version'>0.0.0</entry>
Oct 16 09:47:59 user nova-compute[74342]:       <entry name='serial'>1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4</entry>
Oct 16 09:47:59 user nova-compute[74342]:       <entry name='uuid'>1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4</entry>
Oct 16 09:47:59 user nova-compute[74342]:       <entry name='family'>Virtual Machine</entry>
Oct 16 09:47:59 user nova-compute[74342]:     </system>
Oct 16 09:47:59 user nova-compute[74342]:   </sysinfo>
Oct 16 09:47:59 user nova-compute[74342]:   <os>
Oct 16 09:47:59 user nova-compute[74342]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 16 09:47:59 user nova-compute[74342]:     <boot dev='hd'/>
Oct 16 09:47:59 user nova-compute[74342]:     <smbios mode='sysinfo'/>
Oct 16 09:47:59 user nova-compute[74342]:   </os>
Oct 16 09:47:59 user nova-compute[74342]:   <features>
Oct 16 09:47:59 user nova-compute[74342]:     <acpi/>
Oct 16 09:47:59 user nova-compute[74342]:     <apic/>
Oct 16 09:47:59 user nova-compute[74342]:     <vmcoreinfo state='on'/>
Oct 16 09:47:59 user nova-compute[74342]:   </features>
Oct 16 09:47:59 user nova-compute[74342]:   <cpu mode='custom' match='exact' check='full'>
Oct 16 09:47:59 user nova-compute[74342]:     <model fallback='forbid'>Nehalem</model>
Oct 16 09:47:59 user nova-compute[74342]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 16 09:47:59 user nova-compute[74342]:     <feature policy='require' name='vme'/>
Oct 16 09:47:59 user nova-compute[74342]:     <feature policy='require' name='x2apic'/>
Oct 16 09:47:59 user nova-compute[74342]:     <feature policy='require' name='hypervisor'/>
Oct 16 09:47:59 user nova-compute[74342]:   </cpu>
Oct 16 09:47:59 user nova-compute[74342]:   <clock offset='utc'>
Oct 16 09:47:59 user nova-compute[74342]:     <timer name='pit' tickpolicy='delay'/>
Oct 16 09:47:59 user nova-compute[74342]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 16 09:47:59 user nova-compute[74342]:     <timer name='hpet' present='no'/>
Oct 16 09:47:59 user nova-compute[74342]:   </clock>
Oct 16 09:47:59 user nova-compute[74342]:   <on_poweroff>destroy</on_poweroff>
Oct 16 09:47:59 user nova-compute[74342]:   <on_reboot>restart</on_reboot>
Oct 16 09:47:59 user nova-compute[74342]:   <on_crash>destroy</on_crash>
Oct 16 09:47:59 user nova-compute[74342]:   <devices>
Oct 16 09:47:59 user nova-compute[74342]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 16 09:47:59 user nova-compute[74342]:     <disk type='file' device='disk'>
Oct 16 09:47:59 user nova-compute[74342]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 16 09:47:59 user nova-compute[74342]:       <source file='/opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk' index='2'/>
Oct 16 09:47:59 user nova-compute[74342]:       <backingStore type='file' index='3'>
Oct 16 09:47:59 user nova-compute[74342]:         <format type='raw'/>
Oct 16 09:47:59 user nova-compute[74342]:         <source file='/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd'/>
Oct 16 09:47:59 user nova-compute[74342]:         <backingStore/>
Oct 16 09:47:59 user nova-compute[74342]:       </backingStore>
Oct 16 09:47:59 user nova-compute[74342]:       <target dev='vda' bus='virtio'/>
Oct 16 09:47:59 user nova-compute[74342]:       <alias name='virtio-disk0'/>
Oct 16 09:47:59 user nova-compute[74342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 16 09:47:59 user nova-compute[74342]:     </disk>
Oct 16 09:47:59 user nova-compute[74342]:     <disk type='file' device='cdrom'>
Oct 16 09:47:59 user nova-compute[74342]:       <driver name='qemu' type='raw' cache='none'/>
Oct 16 09:47:59 user nova-compute[74342]:       <source file='/opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk.config' index='1'/>
Oct 16 09:47:59 user nova-compute[74342]:       <backingStore/>
Oct 16 09:47:59 user nova-compute[74342]:       <target dev='hda' bus='ide'/>
Oct 16 09:47:59 user nova-compute[74342]:       <readonly/>
Oct 16 09:47:59 user nova-compute[74342]:       <alias name='ide0-0-0'/>
Oct 16 09:47:59 user nova-compute[74342]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 16 09:47:59 user nova-compute[74342]:     </disk>
Oct 16 09:47:59 user nova-compute[74342]:     <controller type='usb' index='0' model='none'>
Oct 16 09:47:59 user nova-compute[74342]:       <alias name='usb'/>
Oct 16 09:47:59 user nova-compute[74342]:     </controller>
Oct 16 09:47:59 user nova-compute[74342]:     <controller type='pci' index='0' model='pci-root'>
Oct 16 09:47:59 user nova-compute[74342]:       <alias name='pci.0'/>
Oct 16 09:47:59 user nova-compute[74342]:     </controller>
Oct 16 09:47:59 user nova-compute[74342]:     <controller type='ide' index='0'>
Oct 16 09:47:59 user nova-compute[74342]:       <alias name='ide'/>
Oct 16 09:47:59 user nova-compute[74342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 16 09:47:59 user nova-compute[74342]:     </controller>
Oct 16 09:47:59 user nova-compute[74342]:     <interface type='ethernet'>
Oct 16 09:47:59 user nova-compute[74342]:       <mac address='fa:16:3e:27:36:3d'/>
Oct 16 09:47:59 user nova-compute[74342]:       <target dev='tapecb4fcc0-8f'/>
Oct 16 09:47:59 user nova-compute[74342]:       <model type='virtio'/>
Oct 16 09:47:59 user nova-compute[74342]:       <mtu size='1442'/>
Oct 16 09:47:59 user nova-compute[74342]:       <alias name='net0'/>
Oct 16 09:47:59 user nova-compute[74342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 16 09:47:59 user nova-compute[74342]:     </interface>
Oct 16 09:47:59 user nova-compute[74342]:     <serial type='pty'>
Oct 16 09:47:59 user nova-compute[74342]:       <source path='/dev/pts/5'/>
Oct 16 09:47:59 user nova-compute[74342]:       <log file='/opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/console.log' append='off'/>
Oct 16 09:47:59 user nova-compute[74342]:       <target type='isa-serial' port='0'>
Oct 16 09:47:59 user nova-compute[74342]:         <model name='isa-serial'/>
Oct 16 09:47:59 user nova-compute[74342]:       </target>
Oct 16 09:47:59 user nova-compute[74342]:       <alias name='serial0'/>
Oct 16 09:47:59 user nova-compute[74342]:     </serial>
Oct 16 09:47:59 user nova-compute[74342]:     <console type='pty' tty='/dev/pts/5'>
Oct 16 09:47:59 user nova-compute[74342]:       <source path='/dev/pts/5'/>
Oct 16 09:47:59 user nova-compute[74342]:       <log file='/opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/console.log' append='off'/>
Oct 16 09:47:59 user nova-compute[74342]:       <target type='serial' port='0'/>
Oct 16 09:47:59 user nova-compute[74342]:       <alias name='serial0'/>
Oct 16 09:47:59 user nova-compute[74342]:     </console>
Oct 16 09:47:59 user nova-compute[74342]:     <input type='mouse' bus='ps2'>
Oct 16 09:47:59 user nova-compute[74342]:       <alias name='input0'/>
Oct 16 09:47:59 user nova-compute[74342]:     </input>
Oct 16 09:47:59 user nova-compute[74342]:     <input type='keyboard' bus='ps2'>
Oct 16 09:47:59 user nova-compute[74342]:       <alias name='input1'/>
Oct 16 09:47:59 user nova-compute[74342]:     </input>
Oct 16 09:47:59 user nova-compute[74342]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Oct 16 09:47:59 user nova-compute[74342]:       <listen type='address' address='0.0.0.0'/>
Oct 16 09:47:59 user nova-compute[74342]:     </graphics>
Oct 16 09:47:59 user nova-compute[74342]:     <audio id='1' type='none'/>
Oct 16 09:47:59 user nova-compute[74342]:     <video>
Oct 16 09:47:59 user nova-compute[74342]:       <model type='virtio' heads='1' primary='yes'/>
Oct 16 09:47:59 user nova-compute[74342]:       <alias name='video0'/>
Oct 16 09:47:59 user nova-compute[74342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 16 09:47:59 user nova-compute[74342]:     </video>
Oct 16 09:47:59 user nova-compute[74342]:     <memballoon model='virtio'>
Oct 16 09:47:59 user nova-compute[74342]:       <stats period='10'/>
Oct 16 09:47:59 user nova-compute[74342]:       <alias name='balloon0'/>
Oct 16 09:47:59 user nova-compute[74342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 16 09:47:59 user nova-compute[74342]:     </memballoon>
Oct 16 09:47:59 user nova-compute[74342]:     <rng model='virtio'>
Oct 16 09:47:59 user nova-compute[74342]:       <backend model='random'>/dev/urandom</backend>
Oct 16 09:47:59 user nova-compute[74342]:       <alias name='rng0'/>
Oct 16 09:47:59 user nova-compute[74342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 16 09:47:59 user nova-compute[74342]:     </rng>
Oct 16 09:47:59 user nova-compute[74342]:   </devices>
Oct 16 09:47:59 user nova-compute[74342]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 16 09:47:59 user nova-compute[74342]:     <label>libvirt-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4</label>
Oct 16 09:47:59 user nova-compute[74342]:     <imagelabel>libvirt-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4</imagelabel>
Oct 16 09:47:59 user nova-compute[74342]:   </seclabel>
Oct 16 09:47:59 user nova-compute[74342]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 16 09:47:59 user nova-compute[74342]:     <label>+64055:+108</label>
Oct 16 09:47:59 user nova-compute[74342]:     <imagelabel>+64055:+108</imagelabel>
Oct 16 09:47:59 user nova-compute[74342]:   </seclabel>
Oct 16 09:47:59 user nova-compute[74342]: </domain>
Oct 16 09:47:59 user nova-compute[74342]:  {{(pid=74342) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 16 09:47:59 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [req-a6bb7137-5c70-47e4-ba68-8c0fd2b28672 req-477e1928-05c3-424b-abff-4aff393589e2 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:dd:08:71"/><model type="virtio"/><mtu size="1442"/><target dev="tapdbff0b7a-67"/></interface> {{(pid=74342) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Oct 16 09:47:59 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [req-a6bb7137-5c70-47e4-ba68-8c0fd2b28672 req-477e1928-05c3-424b-abff-4aff393589e2 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:dd:08:71"/><model type="virtio"/><mtu size="1442"/><target dev="tapdbff0b7a-67"/></interface>not found in domain: <domain type='kvm' id='6'>
Oct 16 09:47:59 user nova-compute[74342]:   <name>instance-00000006</name>
Oct 16 09:47:59 user nova-compute[74342]:   <uuid>1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4</uuid>
Oct 16 09:47:59 user nova-compute[74342]:   <metadata>
Oct 16 09:47:59 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:47:59 user nova-compute[74342]:   <nova:package version="0.0.0"/>
Oct 16 09:47:59 user nova-compute[74342]:   <nova:name>tempest-device-tagging-server-640949209</nova:name>
Oct 16 09:47:59 user nova-compute[74342]:   <nova:creationTime>2023-10-16 09:47:58</nova:creationTime>
Oct 16 09:47:59 user nova-compute[74342]:   <nova:flavor name="m1.tiny">
Oct 16 09:47:59 user nova-compute[74342]:     <nova:memory>512</nova:memory>
Oct 16 09:47:59 user nova-compute[74342]:     <nova:disk>1</nova:disk>
Oct 16 09:47:59 user nova-compute[74342]:     <nova:swap>0</nova:swap>
Oct 16 09:47:59 user nova-compute[74342]:     <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:47:59 user nova-compute[74342]:     <nova:vcpus>1</nova:vcpus>
Oct 16 09:47:59 user nova-compute[74342]:   </nova:flavor>
Oct 16 09:47:59 user nova-compute[74342]:   <nova:owner>
Oct 16 09:47:59 user nova-compute[74342]:     <nova:user uuid="580c2bb824f04735a5a0b0d6f594bde3">tempest-TaggedAttachmentsTest-1445023395-project-member</nova:user>
Oct 16 09:47:59 user nova-compute[74342]:     <nova:project uuid="3a64826b7567493ab7deee5994b261e7">tempest-TaggedAttachmentsTest-1445023395</nova:project>
Oct 16 09:47:59 user nova-compute[74342]:   </nova:owner>
Oct 16 09:47:59 user nova-compute[74342]:   <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:47:59 user nova-compute[74342]:   <nova:ports>
Oct 16 09:47:59 user nova-compute[74342]:     <nova:port uuid="ecb4fcc0-8f58-493c-9804-76bf3603b899">
Oct 16 09:47:59 user nova-compute[74342]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 09:47:59 user nova-compute[74342]:     </nova:port>
Oct 16 09:47:59 user nova-compute[74342]:   </nova:ports>
Oct 16 09:47:59 user nova-compute[74342]: </nova:instance>
Oct 16 09:47:59 user nova-compute[74342]:   </metadata>
Oct 16 09:47:59 user nova-compute[74342]:   <memory unit='KiB'>524288</memory>
Oct 16 09:47:59 user nova-compute[74342]:   <currentMemory unit='KiB'>524288</currentMemory>
Oct 16 09:47:59 user nova-compute[74342]:   <vcpu placement='static'>1</vcpu>
Oct 16 09:47:59 user nova-compute[74342]:   <resource>
Oct 16 09:47:59 user nova-compute[74342]:     <partition>/machine</partition>
Oct 16 09:47:59 user nova-compute[74342]:   </resource>
Oct 16 09:47:59 user nova-compute[74342]:   <sysinfo type='smbios'>
Oct 16 09:47:59 user nova-compute[74342]:     <system>
Oct 16 09:47:59 user nova-compute[74342]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Oct 16 09:47:59 user nova-compute[74342]:       <entry name='product'>OpenStack Nova</entry>
Oct 16 09:47:59 user nova-compute[74342]:       <entry name='version'>0.0.0</entry>
Oct 16 09:47:59 user nova-compute[74342]:       <entry name='serial'>1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4</entry>
Oct 16 09:47:59 user nova-compute[74342]:       <entry name='uuid'>1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4</entry>
Oct 16 09:47:59 user nova-compute[74342]:       <entry name='family'>Virtual Machine</entry>
Oct 16 09:47:59 user nova-compute[74342]:     </system>
Oct 16 09:47:59 user nova-compute[74342]:   </sysinfo>
Oct 16 09:47:59 user nova-compute[74342]:   <os>
Oct 16 09:47:59 user nova-compute[74342]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Oct 16 09:47:59 user nova-compute[74342]:     <boot dev='hd'/>
Oct 16 09:47:59 user nova-compute[74342]:     <smbios mode='sysinfo'/>
Oct 16 09:47:59 user nova-compute[74342]:   </os>
Oct 16 09:47:59 user nova-compute[74342]:   <features>
Oct 16 09:47:59 user nova-compute[74342]:     <acpi/>
Oct 16 09:47:59 user nova-compute[74342]:     <apic/>
Oct 16 09:47:59 user nova-compute[74342]:     <vmcoreinfo state='on'/>
Oct 16 09:47:59 user nova-compute[74342]:   </features>
Oct 16 09:47:59 user nova-compute[74342]:   <cpu mode='custom' match='exact' check='full'>
Oct 16 09:47:59 user nova-compute[74342]:     <model fallback='forbid'>Nehalem</model>
Oct 16 09:47:59 user nova-compute[74342]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Oct 16 09:47:59 user nova-compute[74342]:     <feature policy='require' name='vme'/>
Oct 16 09:47:59 user nova-compute[74342]:     <feature policy='require' name='x2apic'/>
Oct 16 09:47:59 user nova-compute[74342]:     <feature policy='require' name='hypervisor'/>
Oct 16 09:47:59 user nova-compute[74342]:   </cpu>
Oct 16 09:47:59 user nova-compute[74342]:   <clock offset='utc'>
Oct 16 09:47:59 user nova-compute[74342]:     <timer name='pit' tickpolicy='delay'/>
Oct 16 09:47:59 user nova-compute[74342]:     <timer name='rtc' tickpolicy='catchup'/>
Oct 16 09:47:59 user nova-compute[74342]:     <timer name='hpet' present='no'/>
Oct 16 09:47:59 user nova-compute[74342]:   </clock>
Oct 16 09:47:59 user nova-compute[74342]:   <on_poweroff>destroy</on_poweroff>
Oct 16 09:47:59 user nova-compute[74342]:   <on_reboot>restart</on_reboot>
Oct 16 09:47:59 user nova-compute[74342]:   <on_crash>destroy</on_crash>
Oct 16 09:47:59 user nova-compute[74342]:   <devices>
Oct 16 09:47:59 user nova-compute[74342]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Oct 16 09:47:59 user nova-compute[74342]:     <disk type='file' device='disk'>
Oct 16 09:47:59 user nova-compute[74342]:       <driver name='qemu' type='qcow2' cache='none'/>
Oct 16 09:47:59 user nova-compute[74342]:       <source file='/opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk' index='2'/>
Oct 16 09:47:59 user nova-compute[74342]:       <backingStore type='file' index='3'>
Oct 16 09:47:59 user nova-compute[74342]:         <format type='raw'/>
Oct 16 09:47:59 user nova-compute[74342]:         <source file='/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd'/>
Oct 16 09:47:59 user nova-compute[74342]:         <backingStore/>
Oct 16 09:47:59 user nova-compute[74342]:       </backingStore>
Oct 16 09:47:59 user nova-compute[74342]:       <target dev='vda' bus='virtio'/>
Oct 16 09:47:59 user nova-compute[74342]:       <alias name='virtio-disk0'/>
Oct 16 09:47:59 user nova-compute[74342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Oct 16 09:47:59 user nova-compute[74342]:     </disk>
Oct 16 09:47:59 user nova-compute[74342]:     <disk type='file' device='cdrom'>
Oct 16 09:47:59 user nova-compute[74342]:       <driver name='qemu' type='raw' cache='none'/>
Oct 16 09:47:59 user nova-compute[74342]:       <source file='/opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/disk.config' index='1'/>
Oct 16 09:47:59 user nova-compute[74342]:       <backingStore/>
Oct 16 09:47:59 user nova-compute[74342]:       <target dev='hda' bus='ide'/>
Oct 16 09:47:59 user nova-compute[74342]:       <readonly/>
Oct 16 09:47:59 user nova-compute[74342]:       <alias name='ide0-0-0'/>
Oct 16 09:47:59 user nova-compute[74342]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Oct 16 09:47:59 user nova-compute[74342]:     </disk>
Oct 16 09:47:59 user nova-compute[74342]:     <controller type='usb' index='0' model='none'>
Oct 16 09:47:59 user nova-compute[74342]:       <alias name='usb'/>
Oct 16 09:47:59 user nova-compute[74342]:     </controller>
Oct 16 09:47:59 user nova-compute[74342]:     <controller type='pci' index='0' model='pci-root'>
Oct 16 09:47:59 user nova-compute[74342]:       <alias name='pci.0'/>
Oct 16 09:47:59 user nova-compute[74342]:     </controller>
Oct 16 09:47:59 user nova-compute[74342]:     <controller type='ide' index='0'>
Oct 16 09:47:59 user nova-compute[74342]:       <alias name='ide'/>
Oct 16 09:47:59 user nova-compute[74342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Oct 16 09:47:59 user nova-compute[74342]:     </controller>
Oct 16 09:47:59 user nova-compute[74342]:     <interface type='ethernet'>
Oct 16 09:47:59 user nova-compute[74342]:       <mac address='fa:16:3e:27:36:3d'/>
Oct 16 09:47:59 user nova-compute[74342]:       <target dev='tapecb4fcc0-8f'/>
Oct 16 09:47:59 user nova-compute[74342]:       <model type='virtio'/>
Oct 16 09:47:59 user nova-compute[74342]:       <mtu size='1442'/>
Oct 16 09:47:59 user nova-compute[74342]:       <alias name='net0'/>
Oct 16 09:47:59 user nova-compute[74342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Oct 16 09:47:59 user nova-compute[74342]:     </interface>
Oct 16 09:47:59 user nova-compute[74342]:     <serial type='pty'>
Oct 16 09:47:59 user nova-compute[74342]:       <source path='/dev/pts/5'/>
Oct 16 09:47:59 user nova-compute[74342]:       <log file='/opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/console.log' append='off'/>
Oct 16 09:47:59 user nova-compute[74342]:       <target type='isa-serial' port='0'>
Oct 16 09:47:59 user nova-compute[74342]:         <model name='isa-serial'/>
Oct 16 09:47:59 user nova-compute[74342]:       </target>
Oct 16 09:47:59 user nova-compute[74342]:       <alias name='serial0'/>
Oct 16 09:47:59 user nova-compute[74342]:     </serial>
Oct 16 09:47:59 user nova-compute[74342]:     <console type='pty' tty='/dev/pts/5'>
Oct 16 09:47:59 user nova-compute[74342]:       <source path='/dev/pts/5'/>
Oct 16 09:47:59 user nova-compute[74342]:       <log file='/opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4/console.log' append='off'/>
Oct 16 09:47:59 user nova-compute[74342]:       <target type='serial' port='0'/>
Oct 16 09:47:59 user nova-compute[74342]:       <alias name='serial0'/>
Oct 16 09:47:59 user nova-compute[74342]:     </console>
Oct 16 09:47:59 user nova-compute[74342]:     <input type='mouse' bus='ps2'>
Oct 16 09:47:59 user nova-compute[74342]:       <alias name='input0'/>
Oct 16 09:47:59 user nova-compute[74342]:     </input>
Oct 16 09:47:59 user nova-compute[74342]:     <input type='keyboard' bus='ps2'>
Oct 16 09:47:59 user nova-compute[74342]:       <alias name='input1'/>
Oct 16 09:47:59 user nova-compute[74342]:     </input>
Oct 16 09:47:59 user nova-compute[74342]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Oct 16 09:47:59 user nova-compute[74342]:       <listen type='address' address='0.0.0.0'/>
Oct 16 09:47:59 user nova-compute[74342]:     </graphics>
Oct 16 09:47:59 user nova-compute[74342]:     <audio id='1' type='none'/>
Oct 16 09:47:59 user nova-compute[74342]:     <video>
Oct 16 09:47:59 user nova-compute[74342]:       <model type='virtio' heads='1' primary='yes'/>
Oct 16 09:47:59 user nova-compute[74342]:       <alias name='video0'/>
Oct 16 09:47:59 user nova-compute[74342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Oct 16 09:47:59 user nova-compute[74342]:     </video>
Oct 16 09:47:59 user nova-compute[74342]:     <memballoon model='virtio'>
Oct 16 09:47:59 user nova-compute[74342]:       <stats period='10'/>
Oct 16 09:47:59 user nova-compute[74342]:       <alias name='balloon0'/>
Oct 16 09:47:59 user nova-compute[74342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Oct 16 09:47:59 user nova-compute[74342]:     </memballoon>
Oct 16 09:47:59 user nova-compute[74342]:     <rng model='virtio'>
Oct 16 09:47:59 user nova-compute[74342]:       <backend model='random'>/dev/urandom</backend>
Oct 16 09:47:59 user nova-compute[74342]:       <alias name='rng0'/>
Oct 16 09:47:59 user nova-compute[74342]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Oct 16 09:47:59 user nova-compute[74342]:     </rng>
Oct 16 09:47:59 user nova-compute[74342]:   </devices>
Oct 16 09:47:59 user nova-compute[74342]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Oct 16 09:47:59 user nova-compute[74342]:     <label>libvirt-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4</label>
Oct 16 09:47:59 user nova-compute[74342]:     <imagelabel>libvirt-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4</imagelabel>
Oct 16 09:47:59 user nova-compute[74342]:   </seclabel>
Oct 16 09:47:59 user nova-compute[74342]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Oct 16 09:47:59 user nova-compute[74342]:     <label>+64055:+108</label>
Oct 16 09:47:59 user nova-compute[74342]:     <imagelabel>+64055:+108</imagelabel>
Oct 16 09:47:59 user nova-compute[74342]:   </seclabel>
Oct 16 09:47:59 user nova-compute[74342]: </domain>
Oct 16 09:47:59 user nova-compute[74342]:  {{(pid=74342) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Oct 16 09:47:59 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [req-a6bb7137-5c70-47e4-ba68-8c0fd2b28672 req-477e1928-05c3-424b-abff-4aff393589e2 service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Detaching interface fa:16:3e:dd:08:71 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tapdbff0b7a-67' not found.
Oct 16 09:47:59 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [req-a6bb7137-5c70-47e4-ba68-8c0fd2b28672 req-477e1928-05c3-424b-abff-4aff393589e2 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T09:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-640949209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-640949209',id=6,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpYhQn0nZA6I7ZVLvCwhw5MRkVm+i8dhF9cA+w+3K6essQXKu4e2BqUgXONrqsgQPLMNC9JJK382LUfvK2FFKrfh3cM12JiZnpdknV1HPaHjSi3tgNn41IJGEsjJsOpHg==',key_name='tempest-keypair-1377321458',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:44:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a64826b7567493ab7deee5994b261e7',ramdisk_id='',reservation_id='r-v3nxv2mx',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1445023395',owner_user_name='tempest-TaggedAttachmentsTest-1445023395-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:44:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='580c2bb824f04735a5a0b0d6f594bde3',uuid=1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dbff0b7a-6769-4dfc-bfa0-5273815bdc08", "address": "fa:16:3e:dd:08:71", "network": {"id": "39a0bf3b-4fbd-49ec-b90c-8f14f2ab4045", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-705696688", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3a64826b7567493ab7deee5994b261e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbff0b7a-67", "ovs_interfaceid": "dbff0b7a-6769-4dfc-bfa0-5273815bdc08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:47:59 user nova-compute[74342]: DEBUG nova.network.os_vif_util [req-a6bb7137-5c70-47e4-ba68-8c0fd2b28672 req-477e1928-05c3-424b-abff-4aff393589e2 service nova] Converting VIF {"id": "dbff0b7a-6769-4dfc-bfa0-5273815bdc08", "address": "fa:16:3e:dd:08:71", "network": {"id": "39a0bf3b-4fbd-49ec-b90c-8f14f2ab4045", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-705696688", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "3a64826b7567493ab7deee5994b261e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdbff0b7a-67", "ovs_interfaceid": "dbff0b7a-6769-4dfc-bfa0-5273815bdc08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:47:59 user nova-compute[74342]: DEBUG nova.network.os_vif_util [req-a6bb7137-5c70-47e4-ba68-8c0fd2b28672 req-477e1928-05c3-424b-abff-4aff393589e2 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:08:71,bridge_name='br-int',has_traffic_filtering=True,id=dbff0b7a-6769-4dfc-bfa0-5273815bdc08,network=Network(39a0bf3b-4fbd-49ec-b90c-8f14f2ab4045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbff0b7a-67') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:47:59 user nova-compute[74342]: DEBUG os_vif [req-a6bb7137-5c70-47e4-ba68-8c0fd2b28672 req-477e1928-05c3-424b-abff-4aff393589e2 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:08:71,bridge_name='br-int',has_traffic_filtering=True,id=dbff0b7a-6769-4dfc-bfa0-5273815bdc08,network=Network(39a0bf3b-4fbd-49ec-b90c-8f14f2ab4045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbff0b7a-67') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:47:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:47:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdbff0b7a-67, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:47:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:47:59 user nova-compute[74342]: INFO os_vif [req-a6bb7137-5c70-47e4-ba68-8c0fd2b28672 req-477e1928-05c3-424b-abff-4aff393589e2 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:08:71,bridge_name='br-int',has_traffic_filtering=True,id=dbff0b7a-6769-4dfc-bfa0-5273815bdc08,network=Network(39a0bf3b-4fbd-49ec-b90c-8f14f2ab4045),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdbff0b7a-67')
Oct 16 09:47:59 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [req-a6bb7137-5c70-47e4-ba68-8c0fd2b28672 req-477e1928-05c3-424b-abff-4aff393589e2 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:47:59 user nova-compute[74342]:   <nova:package version="0.0.0"/>
Oct 16 09:47:59 user nova-compute[74342]:   <nova:name>tempest-device-tagging-server-640949209</nova:name>
Oct 16 09:47:59 user nova-compute[74342]:   <nova:creationTime>2023-10-16 09:47:59</nova:creationTime>
Oct 16 09:47:59 user nova-compute[74342]:   <nova:flavor name="m1.tiny">
Oct 16 09:47:59 user nova-compute[74342]:     <nova:memory>512</nova:memory>
Oct 16 09:47:59 user nova-compute[74342]:     <nova:disk>1</nova:disk>
Oct 16 09:47:59 user nova-compute[74342]:     <nova:swap>0</nova:swap>
Oct 16 09:47:59 user nova-compute[74342]:     <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:47:59 user nova-compute[74342]:     <nova:vcpus>1</nova:vcpus>
Oct 16 09:47:59 user nova-compute[74342]:   </nova:flavor>
Oct 16 09:47:59 user nova-compute[74342]:   <nova:owner>
Oct 16 09:47:59 user nova-compute[74342]:     <nova:user uuid="580c2bb824f04735a5a0b0d6f594bde3">tempest-TaggedAttachmentsTest-1445023395-project-member</nova:user>
Oct 16 09:47:59 user nova-compute[74342]:     <nova:project uuid="3a64826b7567493ab7deee5994b261e7">tempest-TaggedAttachmentsTest-1445023395</nova:project>
Oct 16 09:47:59 user nova-compute[74342]:   </nova:owner>
Oct 16 09:47:59 user nova-compute[74342]:   <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:47:59 user nova-compute[74342]:   <nova:ports>
Oct 16 09:47:59 user nova-compute[74342]:     <nova:port uuid="ecb4fcc0-8f58-493c-9804-76bf3603b899">
Oct 16 09:47:59 user nova-compute[74342]:       <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 09:47:59 user nova-compute[74342]:     </nova:port>
Oct 16 09:47:59 user nova-compute[74342]:   </nova:ports>
Oct 16 09:47:59 user nova-compute[74342]: </nova:instance>
Oct 16 09:47:59 user nova-compute[74342]:  {{(pid=74342) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Oct 16 09:48:00 user nova-compute[74342]: DEBUG nova.network.neutron [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Updating instance_info_cache with network_info: [{"id": "ecb4fcc0-8f58-493c-9804-76bf3603b899", "address": "fa:16:3e:27:36:3d", "network": {"id": "7cc9829f-36e8-4fd9-9d62-78f3f0019d1f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-252337481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a64826b7567493ab7deee5994b261e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecb4fcc0-8f", "ovs_interfaceid": "ecb4fcc0-8f58-493c-9804-76bf3603b899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:48:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Releasing lock "refresh_cache-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:48:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0231aec4-524e-4610-b843-b151ae4748ef tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "interface-1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-dbff0b7a-6769-4dfc-bfa0-5273815bdc08" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 22.089s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:48:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'evTrnmNX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:48:04 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:48:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:48:04 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:48:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:48:04 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3020f9ba-24c0-44aa-a4bd-8c96793da674]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 09:48:04 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9562d504-bb6a-460a-996e-1a6cb8178d1d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc] added
Oct 16 09:48:04 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[78c6e43c-c766-422b-b754-4c1df6dcc806]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.031s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1dd8c2-96bd-4eef-ac5d-8ceaf00a02c1]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v evTrnmNX {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v evTrnmNX" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee13e58-2487-4dcc-bd36-ecdfb8a8bb22]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'evTrnmNX'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e823e863-1cb3-441e-9ce3-f7500e051078]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d4ac32-8ea3-4947-857b-ddb660493f7a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 09:48:04 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 09:48:04 user nova-compute[74342]:  {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:48:04 user nova-compute[74342]: WARNING os_brick.initiator.connectors.iscsi [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 09:48:04 user nova-compute[74342]: 
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a440ed28-70c5-4d36-940c-9d0fbf71081c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc, portal: 172.16.0.220,3260]
Oct 16 09:48:04 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc, portal: 172.16.0.220,3260] successful.
Oct 16 09:48:04 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73f5d22-4d15-4fb4-b5ba-e570b2b32d5f]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b292794-72f8-4b88-bc57-9b9441c7e74e]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc (non-flash)
Oct 16 09:48:04 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc (non-flash)
Oct 16 09:48:04 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] HCTL ('33', '-', '-', 0) found on session 7 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[17288488-e125-4a22-b5d1-4f0bf8b88c42]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Searching for a device in session 7 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:48:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'evTrnmNX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 09:48:05 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.310s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:48:05 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] <== connect_volume: return (1311ms) {'type': 'block', 'scsi_wwn': '23362393234616563', 'path': '/dev/sdb'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:48:05 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362393234616563', 'path': '/dev/sdb'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 09:48:05 user nova-compute[74342]: DEBUG nova.objects.instance [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lazy-loading 'flavor' on Instance uuid bdcd2e60-b36c-4d87-94d7-076e7430e1f0 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:48:05 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 09:48:05 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:48:05 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 09:48:05 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:48:05 user nova-compute[74342]:   <serial>642c6df7-21ee-41cb-b410-2b14cb878dbc</serial>
Oct 16 09:48:05 user nova-compute[74342]: </disk>
Oct 16 09:48:05 user nova-compute[74342]:  {{(pid=74342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 09:48:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:48:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:48:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] No VIF found with MAC fa:16:3e:22:60:5b, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:48:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2bf9521e-bbad-4c7d-aa5c-ef00abb83720 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.428s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:48:06 user nova-compute[74342]: INFO nova.compute.manager [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Rescuing
Oct 16 09:48:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Acquiring lock "refresh_cache-bdcd2e60-b36c-4d87-94d7-076e7430e1f0" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:48:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Acquired lock "refresh_cache-bdcd2e60-b36c-4d87-94d7-076e7430e1f0" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:48:06 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:48:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:07 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Updating instance_info_cache with network_info: [{"id": "6880e1ef-5122-458c-a9b8-a8202cdee055", "address": "fa:16:3e:22:60:5b", "network": {"id": "b9e6ad97-cbbe-40e7-b487-5fc89166bc6a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-718322219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6679e55d6a194b399b6b2d27a8cbb147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6880e1ef-51", "ovs_interfaceid": "6880e1ef-5122-458c-a9b8-a8202cdee055", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:48:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Releasing lock "refresh_cache-bdcd2e60-b36c-4d87-94d7-076e7430e1f0" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:48:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:08 user nova-compute[74342]: DEBUG nova.compute.manager [req-7cf7c461-bba5-45a9-b49a-04dad611a30a req-7fd2eac0-d861-474d-8493-a9af2edbc75e service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Received event network-vif-unplugged-6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:48:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-7cf7c461-bba5-45a9-b49a-04dad611a30a req-7fd2eac0-d861-474d-8493-a9af2edbc75e service nova] Acquiring lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:48:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-7cf7c461-bba5-45a9-b49a-04dad611a30a req-7fd2eac0-d861-474d-8493-a9af2edbc75e service nova] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:48:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-7cf7c461-bba5-45a9-b49a-04dad611a30a req-7fd2eac0-d861-474d-8493-a9af2edbc75e service nova] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:48:08 user nova-compute[74342]: DEBUG nova.compute.manager [req-7cf7c461-bba5-45a9-b49a-04dad611a30a req-7fd2eac0-d861-474d-8493-a9af2edbc75e service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] No waiting events found dispatching network-vif-unplugged-6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:48:08 user nova-compute[74342]: WARNING nova.compute.manager [req-7cf7c461-bba5-45a9-b49a-04dad611a30a req-7fd2eac0-d861-474d-8493-a9af2edbc75e service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Received unexpected event network-vif-unplugged-6880e1ef-5122-458c-a9b8-a8202cdee055 for instance with vm_state active and task_state rescuing.
Oct 16 09:48:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:08 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Instance destroyed successfully.
Oct 16 09:48:08 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Attempting a stable device rescue
Oct 16 09:48:08 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=74342) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 16 09:48:08 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Instance directory exists: not creating {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 16 09:48:08 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Creating image(s)
Oct 16 09:48:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Acquiring lock "/opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:48:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "/opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:48:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "/opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:48:08 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lazy-loading 'trusted_certs' on Instance uuid bdcd2e60-b36c-4d87-94d7-076e7430e1f0 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:48:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Acquiring lock "b3ba3fb0c354b693bd039d6a525f61449cc13bef" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:48:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "b3ba3fb0c354b693bd039d6a525f61449cc13bef" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:48:09 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3ba3fb0c354b693bd039d6a525f61449cc13bef.part --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3ba3fb0c354b693bd039d6a525f61449cc13bef.part --force-share --output=json" returned: 0 in 0.220s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.virt.images [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] 4c3028df-ff3b-4fef-8fd6-972eeca13108 was qcow2, converting to raw {{(pid=74342) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.privsep.utils [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b3ba3fb0c354b693bd039d6a525f61449cc13bef.part /opt/stack/data/nova/instances/_base/b3ba3fb0c354b693bd039d6a525f61449cc13bef.converted {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.compute.manager [req-ef0efe6c-4082-462e-abfb-25d887f2a16b req-cdfcd8e9-6f12-4cde-87de-f074dd16cd52 service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Received event network-vif-plugged-6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ef0efe6c-4082-462e-abfb-25d887f2a16b req-cdfcd8e9-6f12-4cde-87de-f074dd16cd52 service nova] Acquiring lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ef0efe6c-4082-462e-abfb-25d887f2a16b req-cdfcd8e9-6f12-4cde-87de-f074dd16cd52 service nova] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ef0efe6c-4082-462e-abfb-25d887f2a16b req-cdfcd8e9-6f12-4cde-87de-f074dd16cd52 service nova] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.compute.manager [req-ef0efe6c-4082-462e-abfb-25d887f2a16b req-cdfcd8e9-6f12-4cde-87de-f074dd16cd52 service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] No waiting events found dispatching network-vif-plugged-6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:48:10 user nova-compute[74342]: WARNING nova.compute.manager [req-ef0efe6c-4082-462e-abfb-25d887f2a16b req-cdfcd8e9-6f12-4cde-87de-f074dd16cd52 service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Received unexpected event network-vif-plugged-6880e1ef-5122-458c-a9b8-a8202cdee055 for instance with vm_state active and task_state rescuing.
Oct 16 09:48:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b3ba3fb0c354b693bd039d6a525f61449cc13bef.part /opt/stack/data/nova/instances/_base/b3ba3fb0c354b693bd039d6a525f61449cc13bef.converted" returned: 0 in 0.267s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3ba3fb0c354b693bd039d6a525f61449cc13bef.converted --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3ba3fb0c354b693bd039d6a525f61449cc13bef.converted --force-share --output=json" returned: 0 in 0.207s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "b3ba3fb0c354b693bd039d6a525f61449cc13bef" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.876s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Acquiring lock "b3ba3fb0c354b693bd039d6a525f61449cc13bef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "b3ba3fb0c354b693bd039d6a525f61449cc13bef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3ba3fb0c354b693bd039d6a525f61449cc13bef --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b3ba3fb0c354b693bd039d6a525f61449cc13bef --force-share --output=json" returned: 0 in 0.182s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b3ba3fb0c354b693bd039d6a525f61449cc13bef,backing_fmt=raw /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk.rescue {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b3ba3fb0c354b693bd039d6a525f61449cc13bef,backing_fmt=raw /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk.rescue" returned: 0 in 0.057s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "b3ba3fb0c354b693bd039d6a525f61449cc13bef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lazy-loading 'migration_context' on Instance uuid bdcd2e60-b36c-4d87-94d7-076e7430e1f0 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.objects.base [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Object Instance<bdcd2e60-b36c-4d87-94d7-076e7430e1f0> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Start _get_guest_xml network_info=[{"id": "6880e1ef-5122-458c-a9b8-a8202cdee055", "address": "fa:16:3e:22:60:5b", "network": {"id": "b9e6ad97-cbbe-40e7-b487-5fc89166bc6a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-718322219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-718322219-network", "vif_mac": "fa:16:3e:22:60:5b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6679e55d6a194b399b6b2d27a8cbb147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6880e1ef-51", "ovs_interfaceid": "6880e1ef-5122-458c-a9b8-a8202cdee055", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '4c3028df-ff3b-4fef-8fd6-972eeca13108', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '3dc3d320-b63d-4c8e-9f83-b42d56d4a91f', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'evTrnmNX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'bdcd2e60-b36c-4d87-94d7-076e7430e1f0', 'attached_at': '', 'detached_at': '', 'volume_id': '642c6df7-21ee-41cb-b410-2b14cb878dbc', 'serial': '642c6df7-21ee-41cb-b410-2b14cb878dbc'}, 'volume_type': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lazy-loading 'resources' on Instance uuid bdcd2e60-b36c-4d87-94d7-076e7430e1f0 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.objects.base [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Object Instance<bdcd2e60-b36c-4d87-94d7-076e7430e1f0> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lazy-loading 'numa_topology' on Instance uuid bdcd2e60-b36c-4d87-94d7-076e7430e1f0 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.objects.base [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Object Instance<bdcd2e60-b36c-4d87-94d7-076e7430e1f0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 09:48:10 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:48:10 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lazy-loading 'vcpu_model' on Instance uuid bdcd2e60-b36c-4d87-94d7-076e7430e1f0 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.objects.base [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Object Instance<bdcd2e60-b36c-4d87-94d7-076e7430e1f0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'evTrnmNX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:48:10 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:48:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:48:10 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:48:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:48:10 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 09:48:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a34540d-eb04-4012-a6d7-29fd55fd487f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = evTrnmNX\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 16 09:48:10 user nova-compute[74342]: node.name = iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc
Oct 16 09:48:10 user nova-compute[74342]: node.tpgt = -1
Oct 16 09:48:10 user nova-compute[74342]: node.startup = automatic
Oct 16 09:48:10 user nova-compute[74342]: node.leading_login = No
Oct 16 09:48:10 user nova-compute[74342]: iface.iscsi_ifacename = default
Oct 16 09:48:10 user nova-compute[74342]: iface.net_ifacename = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.ipaddress = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.prefix_len = 0
Oct 16 09:48:10 user nova-compute[74342]: iface.hwaddress = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.transport_name = tcp
Oct 16 09:48:10 user nova-compute[74342]: iface.initiatorname = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.state = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.vlan_id = 0
Oct 16 09:48:10 user nova-compute[74342]: iface.vlan_priority = 0
Oct 16 09:48:10 user nova-compute[74342]: iface.vlan_state = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.iface_num = 0
Oct 16 09:48:10 user nova-compute[74342]: iface.mtu = 0
Oct 16 09:48:10 user nova-compute[74342]: iface.port = 0
Oct 16 09:48:10 user nova-compute[74342]: iface.bootproto = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.subnet_mask = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.gateway = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.dhcp_alt_client_id_state = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.dhcp_alt_client_id = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.dhcp_dns = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.dhcp_learn_iqn = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.dhcp_req_vendor_id_state = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.dhcp_vendor_id_state = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.dhcp_vendor_id = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.dhcp_slp_da = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.fragmentation = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.gratuitous_arp = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.incoming_forwarding = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.tos_state = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.tos = 0
Oct 16 09:48:10 user nova-compute[74342]: iface.ttl = 0
Oct 16 09:48:10 user nova-compute[74342]: iface.delayed_ack = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.tcp_nagle = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.tcp_wsf_state = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.tcp_wsf = 0
Oct 16 09:48:10 user nova-compute[74342]: iface.tcp_timer_scale = 0
Oct 16 09:48:10 user nova-compute[74342]: iface.tcp_timestamp = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.redirect = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.def_task_mgmt_timeout = 0
Oct 16 09:48:10 user nova-compute[74342]: iface.header_digest = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.data_digest = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.immediate_data = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.initial_r2t = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.data_seq_inorder = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.data_pdu_inorder = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.erl = 0
Oct 16 09:48:10 user nova-compute[74342]: iface.max_receive_data_len = 0
Oct 16 09:48:10 user nova-compute[74342]: iface.first_burst_len = 0
Oct 16 09:48:10 user nova-compute[74342]: iface.max_outstanding_r2t = 0
Oct 16 09:48:10 user nova-compute[74342]: iface.max_burst_len = 0
Oct 16 09:48:10 user nova-compute[74342]: iface.chap_auth = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.bidi_chap = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.strict_login_compliance = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.discovery_auth = <empty>
Oct 16 09:48:10 user nova-compute[74342]: iface.discovery_logout = <empty>
Oct 16 09:48:10 user nova-compute[74342]: node.discovery_address = <empty>
Oct 16 09:48:10 user nova-compute[74342]: node.discovery_port = 0
Oct 16 09:48:10 user nova-compute[74342]: node.discovery_type = static
Oct 16 09:48:10 user nova-compute[74342]: node.session.initial_cmdsn = 0
Oct 16 09:48:10 user nova-compute[74342]: node.session.initial_login_retry_max = 8
Oct 16 09:48:10 user nova-compute[74342]: node.session.xmit_thread_priority = -20
Oct 16 09:48:10 user nova-compute[74342]: node.session.cmds_max = 128
Oct 16 09:48:10 user nova-compute[74342]: node.session.queue_depth = 32
Oct 16 09:48:10 user nova-compute[74342]: node.session.nr_sessions = 1
Oct 16 09:48:10 user nova-compute[74342]: node.session.auth.authmethod = CHAP
Oct 16 09:48:10 user nova-compute[74342]: node.session.auth.username = evTrnmNX
Oct 16 09:48:10 user nova-compute[74342]: node.session.auth.password = ***
Oct 16 09:48:10 user nova-compute[74342]: node.session.auth.username_in = <empty>
Oct 16 09:48:10 user nova-compute[74342]: node.session.auth.password_in = <empty>
Oct 16 09:48:10 user nova-compute[74342]: node.session.auth.chap_algs = MD5
Oct 16 09:48:10 user nova-compute[74342]: node.session.timeo.replacement_timeout = 120
Oct 16 09:48:10 user nova-compute[74342]: node.session.err_timeo.abort_timeout = 15
Oct 16 09:48:10 user nova-compute[74342]: node.session.err_timeo.lu_reset_timeout = 30
Oct 16 09:48:10 user nova-compute[74342]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 16 09:48:10 user nova-compute[74342]: node.session.err_timeo.host_reset_timeout = 60
Oct 16 09:48:10 user nova-compute[74342]: node.session.iscsi.FastAbort = Yes
Oct 16 09:48:10 user nova-compute[74342]: node.session.iscsi.InitialR2T = No
Oct 16 09:48:10 user nova-compute[74342]: node.session.iscsi.ImmediateData = Yes
Oct 16 09:48:10 user nova-compute[74342]: node.session.iscsi.FirstBurstLength = 262144
Oct 16 09:48:10 user nova-compute[74342]: node.session.iscsi.MaxBurstLength = 16776192
Oct 16 09:48:10 user nova-compute[74342]: node.session.iscsi.DefaultTime2Retain = 0
Oct 16 09:48:10 user nova-compute[74342]: node.session.iscsi.DefaultTime2Wait = 2
Oct 16 09:48:10 user nova-compute[74342]: node.session.iscsi.MaxConnections = 1
Oct 16 09:48:10 user nova-compute[74342]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 16 09:48:10 user nova-compute[74342]: node.session.iscsi.ERL = 0
Oct 16 09:48:10 user nova-compute[74342]: node.session.scan = manual
Oct 16 09:48:10 user nova-compute[74342]: node.session.reopen_max = 0
Oct 16 09:48:10 user nova-compute[74342]: node.conn[0].address = 172.16.0.220
Oct 16 09:48:10 user nova-compute[74342]: node.conn[0].port = 3260
Oct 16 09:48:10 user nova-compute[74342]: node.conn[0].startup = manual
Oct 16 09:48:10 user nova-compute[74342]: node.conn[0].tcp.window_size = 524288
Oct 16 09:48:10 user nova-compute[74342]: node.conn[0].tcp.type_of_service = 0
Oct 16 09:48:10 user nova-compute[74342]: node.conn[0].timeo.logout_timeout = 15
Oct 16 09:48:10 user nova-compute[74342]: node.conn[0].timeo.login_timeout = 15
Oct 16 09:48:10 user nova-compute[74342]: node.conn[0].timeo.auth_timeout = 45
Oct 16 09:48:10 user nova-compute[74342]: node.conn[0].timeo.noop_out_interval = 5
Oct 16 09:48:10 user nova-compute[74342]: node.conn[0].timeo.noop_out_timeout = 5
Oct 16 09:48:10 user nova-compute[74342]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 16 09:48:10 user nova-compute[74342]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 16 09:48:10 user nova-compute[74342]: node.conn[0].iscsi.HeaderDigest = None
Oct 16 09:48:10 user nova-compute[74342]: node.conn[0].iscsi.DataDigest = None
Oct 16 09:48:10 user nova-compute[74342]: node.conn[0].iscsi.IFMarker = No
Oct 16 09:48:10 user nova-compute[74342]: node.conn[0].iscsi.OFMarker = No
Oct 16 09:48:10 user nova-compute[74342]: # END RECORD
Oct 16 09:48:10 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:48:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[198727cf-363c-4e46-8398-13ed04905418]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e80e70c2-c535-40a5-a7b7-8c3a0e23c533]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v evTrnmNX {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v evTrnmNX" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[93ca9ad5-17c5-42e0-bbff-f341458375a0]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'evTrnmNX'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2ace37-eb5a-4b13-9ede-2bb2364bbffe]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5f2276d-b8f3-4f8f-a844-48c7c187e4c9]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc (non-flash)
Oct 16 09:48:11 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc (non-flash)
Oct 16 09:48:11 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.150s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] HCTL ('33', '0', '0', 0) found on session 7 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.013s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[260bb07d-2d2e-4de0-bef2-4702f88b185b]: (4, ('0 0 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Searching for a device in session 7 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'evTrnmNX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.176s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] <== connect_volume: return (177ms) {'type': 'block', 'scsi_wwn': '23362393234616563', 'path': '/dev/sdb'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23362393234616563', 'path': '/dev/sdb'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:44:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1284670649',display_name='tempest-ServerStableDeviceRescueTest-server-1284670649',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1284670649',id=4,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrXoD5Hrtp0ROS6ovoeBvzjEfPpR4UjjC7ZqIID+HojYD/xMrg9FWvTD4l6ndTedTgydSxzmceB9u2uBK/WxkE0f/ZCFoLaDqAKtcEYleUSzfATZXWIic1PChOdLmXIwA==',key_name='tempest-keypair-1191894411',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:44:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6679e55d6a194b399b6b2d27a8cbb147',ramdisk_id='',reservation_id='r-2zs156t5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-864442118',owner_user_name='tempest-ServerStableDeviceRescueTest-864442118-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:46:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb81780de8824c3bb51b416c5f73f2b5',uuid=bdcd2e60-b36c-4d87-94d7-076e7430e1f0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6880e1ef-5122-458c-a9b8-a8202cdee055", "address": "fa:16:3e:22:60:5b", "network": {"id": "b9e6ad97-cbbe-40e7-b487-5fc89166bc6a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-718322219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-718322219-network", "vif_mac": "fa:16:3e:22:60:5b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6679e55d6a194b399b6b2d27a8cbb147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6880e1ef-51", "ovs_interfaceid": "6880e1ef-5122-458c-a9b8-a8202cdee055", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Converting VIF {"id": "6880e1ef-5122-458c-a9b8-a8202cdee055", "address": "fa:16:3e:22:60:5b", "network": {"id": "b9e6ad97-cbbe-40e7-b487-5fc89166bc6a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-718322219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-718322219-network", "vif_mac": "fa:16:3e:22:60:5b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6679e55d6a194b399b6b2d27a8cbb147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6880e1ef-51", "ovs_interfaceid": "6880e1ef-5122-458c-a9b8-a8202cdee055", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:60:5b,bridge_name='br-int',has_traffic_filtering=True,id=6880e1ef-5122-458c-a9b8-a8202cdee055,network=Network(b9e6ad97-cbbe-40e7-b487-5fc89166bc6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6880e1ef-51') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lazy-loading 'pci_devices' on Instance uuid bdcd2e60-b36c-4d87-94d7-076e7430e1f0 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG nova.objects.base [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Object Instance<bdcd2e60-b36c-4d87-94d7-076e7430e1f0> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:48:11 user nova-compute[74342]:   <uuid>bdcd2e60-b36c-4d87-94d7-076e7430e1f0</uuid>
Oct 16 09:48:11 user nova-compute[74342]:   <name>instance-00000004</name>
Oct 16 09:48:11 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:48:11 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:48:11 user nova-compute[74342]:   <metadata>
Oct 16 09:48:11 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:48:11 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:48:11 user nova-compute[74342]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-1284670649</nova:name>
Oct 16 09:48:11 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:48:10</nova:creationTime>
Oct 16 09:48:11 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:48:11 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:48:11 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:48:11 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:48:11 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:48:11 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:48:11 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:48:11 user nova-compute[74342]:       <nova:owner>
Oct 16 09:48:11 user nova-compute[74342]:         <nova:user uuid="cb81780de8824c3bb51b416c5f73f2b5">tempest-ServerStableDeviceRescueTest-864442118-project-member</nova:user>
Oct 16 09:48:11 user nova-compute[74342]:         <nova:project uuid="6679e55d6a194b399b6b2d27a8cbb147">tempest-ServerStableDeviceRescueTest-864442118</nova:project>
Oct 16 09:48:11 user nova-compute[74342]:       </nova:owner>
Oct 16 09:48:11 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:48:11 user nova-compute[74342]:       <nova:ports>
Oct 16 09:48:11 user nova-compute[74342]:         <nova:port uuid="6880e1ef-5122-458c-a9b8-a8202cdee055">
Oct 16 09:48:11 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 16 09:48:11 user nova-compute[74342]:         </nova:port>
Oct 16 09:48:11 user nova-compute[74342]:       </nova:ports>
Oct 16 09:48:11 user nova-compute[74342]:     </nova:instance>
Oct 16 09:48:11 user nova-compute[74342]:   </metadata>
Oct 16 09:48:11 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:48:11 user nova-compute[74342]:     <system>
Oct 16 09:48:11 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:48:11 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:48:11 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:48:11 user nova-compute[74342]:       <entry name="serial">bdcd2e60-b36c-4d87-94d7-076e7430e1f0</entry>
Oct 16 09:48:11 user nova-compute[74342]:       <entry name="uuid">bdcd2e60-b36c-4d87-94d7-076e7430e1f0</entry>
Oct 16 09:48:11 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:48:11 user nova-compute[74342]:     </system>
Oct 16 09:48:11 user nova-compute[74342]:   </sysinfo>
Oct 16 09:48:11 user nova-compute[74342]:   <os>
Oct 16 09:48:11 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:48:11 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:48:11 user nova-compute[74342]:   </os>
Oct 16 09:48:11 user nova-compute[74342]:   <features>
Oct 16 09:48:11 user nova-compute[74342]:     <acpi/>
Oct 16 09:48:11 user nova-compute[74342]:     <apic/>
Oct 16 09:48:11 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:48:11 user nova-compute[74342]:   </features>
Oct 16 09:48:11 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:48:11 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:48:11 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:48:11 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:48:11 user nova-compute[74342]:   </clock>
Oct 16 09:48:11 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:48:11 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:48:11 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:48:11 user nova-compute[74342]:   </cpu>
Oct 16 09:48:11 user nova-compute[74342]:   <devices>
Oct 16 09:48:11 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 09:48:11 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 09:48:11 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk"/>
Oct 16 09:48:11 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:48:11 user nova-compute[74342]:     </disk>
Oct 16 09:48:11 user nova-compute[74342]:     <disk type="block" device="disk">
Oct 16 09:48:11 user nova-compute[74342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:48:11 user nova-compute[74342]:       <source dev="/dev/sdb"/>
Oct 16 09:48:11 user nova-compute[74342]:       <target dev="vdb" bus="virtio"/>
Oct 16 09:48:11 user nova-compute[74342]:       <serial>642c6df7-21ee-41cb-b410-2b14cb878dbc</serial>
Oct 16 09:48:11 user nova-compute[74342]:     </disk>
Oct 16 09:48:11 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 09:48:11 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 09:48:11 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk.rescue"/>
Oct 16 09:48:11 user nova-compute[74342]:       <target dev="vdc" bus="virtio"/>
Oct 16 09:48:11 user nova-compute[74342]:       <boot order="1"/>
Oct 16 09:48:11 user nova-compute[74342]:     </disk>
Oct 16 09:48:11 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:48:11 user nova-compute[74342]:       <mac address="fa:16:3e:22:60:5b"/>
Oct 16 09:48:11 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:48:11 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:48:11 user nova-compute[74342]:       <target dev="tap6880e1ef-51"/>
Oct 16 09:48:11 user nova-compute[74342]:     </interface>
Oct 16 09:48:11 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:48:11 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/console.log" append="off"/>
Oct 16 09:48:11 user nova-compute[74342]:     </serial>
Oct 16 09:48:11 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:48:11 user nova-compute[74342]:     <video>
Oct 16 09:48:11 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:48:11 user nova-compute[74342]:     </video>
Oct 16 09:48:11 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:48:11 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:48:11 user nova-compute[74342]:     </rng>
Oct 16 09:48:11 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:48:11 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:48:11 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:48:11 user nova-compute[74342]:     </memballoon>
Oct 16 09:48:11 user nova-compute[74342]:   </devices>
Oct 16 09:48:11 user nova-compute[74342]: </domain>
Oct 16 09:48:11 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:48:11 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Instance destroyed successfully.
Oct 16 09:48:11 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:48:11 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] No VIF found with MAC fa:16:3e:22:60:5b, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:48:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:13 user nova-compute[74342]: DEBUG nova.compute.manager [req-61ddd553-400c-4423-a6af-bd7f7344022e req-d17f43f9-3a63-4ecd-9dc0-215d618a83fc service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Received event network-vif-plugged-6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:48:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-61ddd553-400c-4423-a6af-bd7f7344022e req-d17f43f9-3a63-4ecd-9dc0-215d618a83fc service nova] Acquiring lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:48:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-61ddd553-400c-4423-a6af-bd7f7344022e req-d17f43f9-3a63-4ecd-9dc0-215d618a83fc service nova] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:48:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-61ddd553-400c-4423-a6af-bd7f7344022e req-d17f43f9-3a63-4ecd-9dc0-215d618a83fc service nova] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:48:13 user nova-compute[74342]: DEBUG nova.compute.manager [req-61ddd553-400c-4423-a6af-bd7f7344022e req-d17f43f9-3a63-4ecd-9dc0-215d618a83fc service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] No waiting events found dispatching network-vif-plugged-6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:48:13 user nova-compute[74342]: WARNING nova.compute.manager [req-61ddd553-400c-4423-a6af-bd7f7344022e req-d17f43f9-3a63-4ecd-9dc0-215d618a83fc service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Received unexpected event network-vif-plugged-6880e1ef-5122-458c-a9b8-a8202cdee055 for instance with vm_state active and task_state rescuing.
Oct 16 09:48:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-6465350b-1ad5-4f49-8a70-c9ffd61397d1 req-fdba07c9-41fc-46bf-b6c5-8e1df27eb803 service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Received event network-vif-plugged-6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:48:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-6465350b-1ad5-4f49-8a70-c9ffd61397d1 req-fdba07c9-41fc-46bf-b6c5-8e1df27eb803 service nova] Acquiring lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:48:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-6465350b-1ad5-4f49-8a70-c9ffd61397d1 req-fdba07c9-41fc-46bf-b6c5-8e1df27eb803 service nova] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:48:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-6465350b-1ad5-4f49-8a70-c9ffd61397d1 req-fdba07c9-41fc-46bf-b6c5-8e1df27eb803 service nova] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:48:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-6465350b-1ad5-4f49-8a70-c9ffd61397d1 req-fdba07c9-41fc-46bf-b6c5-8e1df27eb803 service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] No waiting events found dispatching network-vif-plugged-6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:48:15 user nova-compute[74342]: WARNING nova.compute.manager [req-6465350b-1ad5-4f49-8a70-c9ffd61397d1 req-fdba07c9-41fc-46bf-b6c5-8e1df27eb803 service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Received unexpected event network-vif-plugged-6880e1ef-5122-458c-a9b8-a8202cdee055 for instance with vm_state active and task_state rescuing.
Oct 16 09:48:15 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb94de6c-a150-478b-bf64-db575f07dc3f tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:48:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0d3619e1-b6d8-4d56-ac00-6c090253760b tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Acquiring lock "719428d6-025b-4baa-97a2-c8ebdd49f57e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:48:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0d3619e1-b6d8-4d56-ac00-6c090253760b tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Lock "719428d6-025b-4baa-97a2-c8ebdd49f57e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:48:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0d3619e1-b6d8-4d56-ac00-6c090253760b tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Acquiring lock "719428d6-025b-4baa-97a2-c8ebdd49f57e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:48:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0d3619e1-b6d8-4d56-ac00-6c090253760b tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Lock "719428d6-025b-4baa-97a2-c8ebdd49f57e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:48:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0d3619e1-b6d8-4d56-ac00-6c090253760b tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Lock "719428d6-025b-4baa-97a2-c8ebdd49f57e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:48:16 user nova-compute[74342]: INFO nova.compute.manager [None req-0d3619e1-b6d8-4d56-ac00-6c090253760b tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Terminating instance
Oct 16 09:48:16 user nova-compute[74342]: DEBUG nova.compute.manager [None req-0d3619e1-b6d8-4d56-ac00-6c090253760b tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 09:48:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:16 user nova-compute[74342]: DEBUG nova.compute.manager [req-e805f519-9e20-4319-ab33-164eeca59133 req-3fb95390-3bf9-4ce4-9cb2-e048d9341655 service nova] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Received event network-vif-unplugged-32030b48-4c52-4cf9-ba4f-0dc3b580fbdc {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:48:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e805f519-9e20-4319-ab33-164eeca59133 req-3fb95390-3bf9-4ce4-9cb2-e048d9341655 service nova] Acquiring lock "719428d6-025b-4baa-97a2-c8ebdd49f57e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:48:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e805f519-9e20-4319-ab33-164eeca59133 req-3fb95390-3bf9-4ce4-9cb2-e048d9341655 service nova] Lock "719428d6-025b-4baa-97a2-c8ebdd49f57e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:48:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e805f519-9e20-4319-ab33-164eeca59133 req-3fb95390-3bf9-4ce4-9cb2-e048d9341655 service nova] Lock "719428d6-025b-4baa-97a2-c8ebdd49f57e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:48:16 user nova-compute[74342]: DEBUG nova.compute.manager [req-e805f519-9e20-4319-ab33-164eeca59133 req-3fb95390-3bf9-4ce4-9cb2-e048d9341655 service nova] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] No waiting events found dispatching network-vif-unplugged-32030b48-4c52-4cf9-ba4f-0dc3b580fbdc {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:48:16 user nova-compute[74342]: DEBUG nova.compute.manager [req-e805f519-9e20-4319-ab33-164eeca59133 req-3fb95390-3bf9-4ce4-9cb2-e048d9341655 service nova] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Received event network-vif-unplugged-32030b48-4c52-4cf9-ba4f-0dc3b580fbdc for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 09:48:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:17 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Instance destroyed successfully.
Oct 16 09:48:17 user nova-compute[74342]: DEBUG nova.objects.instance [None req-0d3619e1-b6d8-4d56-ac00-6c090253760b tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Lazy-loading 'resources' on Instance uuid 719428d6-025b-4baa-97a2-c8ebdd49f57e {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:48:17 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-0d3619e1-b6d8-4d56-ac00-6c090253760b tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:44:30Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1384801338',display_name='tempest-VolumesAssistedSnapshotsTest-server-1384801338',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1384801338',id=7,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH4CGvi/ddHz1YRJfr4qmfF54Kal6XrHg944hKoDcXLwX+t2qj4dkscqVcXhMhzHAj0y1Pb5Zr7fmmTo0el3yXp6ef0r6Uvf0ymyXcpYn9GXaYZsu0+kvFpwJ1mK+Fe6aA==',key_name='tempest-keypair-1224038078',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:44:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9d38497173ac495483e9f5c564415da4',ramdisk_id='',reservation_id='r-zq8wq25e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-654150561',owner_user_name='tempest-VolumesAssistedSnapshotsTest-654150561-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:44:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='067571b5a90d474da700215c04cdfe3c',uuid=719428d6-025b-4baa-97a2-c8ebdd49f57e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "32030b48-4c52-4cf9-ba4f-0dc3b580fbdc", "address": "fa:16:3e:90:75:c6", "network": {"id": "58954713-04d6-4123-bfc0-74f8babdad45", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1482868561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d38497173ac495483e9f5c564415da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32030b48-4c", "ovs_interfaceid": "32030b48-4c52-4cf9-ba4f-0dc3b580fbdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:48:17 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-0d3619e1-b6d8-4d56-ac00-6c090253760b tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Converting VIF {"id": "32030b48-4c52-4cf9-ba4f-0dc3b580fbdc", "address": "fa:16:3e:90:75:c6", "network": {"id": "58954713-04d6-4123-bfc0-74f8babdad45", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1482868561-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.175", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9d38497173ac495483e9f5c564415da4", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap32030b48-4c", "ovs_interfaceid": "32030b48-4c52-4cf9-ba4f-0dc3b580fbdc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:48:17 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-0d3619e1-b6d8-4d56-ac00-6c090253760b tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:90:75:c6,bridge_name='br-int',has_traffic_filtering=True,id=32030b48-4c52-4cf9-ba4f-0dc3b580fbdc,network=Network(58954713-04d6-4123-bfc0-74f8babdad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32030b48-4c') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:48:17 user nova-compute[74342]: DEBUG os_vif [None req-0d3619e1-b6d8-4d56-ac00-6c090253760b tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:75:c6,bridge_name='br-int',has_traffic_filtering=True,id=32030b48-4c52-4cf9-ba4f-0dc3b580fbdc,network=Network(58954713-04d6-4123-bfc0-74f8babdad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32030b48-4c') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:48:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap32030b48-4c, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:48:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:48:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=463fae87-7a25-4066-80a1-42efe1601b9b) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:48:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:48:17 user nova-compute[74342]: INFO os_vif [None req-0d3619e1-b6d8-4d56-ac00-6c090253760b tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:90:75:c6,bridge_name='br-int',has_traffic_filtering=True,id=32030b48-4c52-4cf9-ba4f-0dc3b580fbdc,network=Network(58954713-04d6-4123-bfc0-74f8babdad45),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32030b48-4c')
Oct 16 09:48:17 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-0d3619e1-b6d8-4d56-ac00-6c090253760b tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Deleting instance files /opt/stack/data/nova/instances/719428d6-025b-4baa-97a2-c8ebdd49f57e_del
Oct 16 09:48:17 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-0d3619e1-b6d8-4d56-ac00-6c090253760b tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Deletion of /opt/stack/data/nova/instances/719428d6-025b-4baa-97a2-c8ebdd49f57e_del complete
Oct 16 09:48:17 user nova-compute[74342]: INFO nova.compute.manager [None req-0d3619e1-b6d8-4d56-ac00-6c090253760b tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Took 0.94 seconds to destroy the instance on the hypervisor.
Oct 16 09:48:17 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-0d3619e1-b6d8-4d56-ac00-6c090253760b tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 09:48:17 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 09:48:17 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 09:48:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:18 user nova-compute[74342]: WARNING nova.compute.manager [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Timeout waiting for ['volume-reimaged-fe2aa7c1-4340-4adb-915f-3be7ae4a985d'] for instance with vm_state active and task_state rebuilding. Event states are: volume-reimaged-fe2aa7c1-4340-4adb-915f-3be7ae4a985d: timed out after 60.00 seconds: eventlet.timeout.Timeout: 60 seconds
Oct 16 09:48:18 user nova-compute[74342]: /opt/stack/data/venv/lib/python3.10/site-packages/oslo_serialization/jsonutils.py:180: UserWarning: Cannot convert <Timeout at 0x7f2b6077eaa0 seconds=60> to primitive, will raise ValueError instead of warning in version 3.0
Oct 16 09:48:18 user nova-compute[74342]:   warnings.warn("Cannot convert %r to primitive, will raise ValueError "
Oct 16 09:48:18 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:48:18 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Took 1.30 seconds to deallocate network for instance.
Oct 16 09:48:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:48:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:48:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0d3619e1-b6d8-4d56-ac00-6c090253760b tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:48:18 user nova-compute[74342]: DEBUG nova.compute.manager [req-09c4aa00-5918-4aaf-8a4c-ea8c63690e99 req-05af48e7-f354-428f-a422-3b0672f07f5d service nova] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Received event network-vif-plugged-32030b48-4c52-4cf9-ba4f-0dc3b580fbdc {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:48:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-09c4aa00-5918-4aaf-8a4c-ea8c63690e99 req-05af48e7-f354-428f-a422-3b0672f07f5d service nova] Acquiring lock "719428d6-025b-4baa-97a2-c8ebdd49f57e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:48:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-09c4aa00-5918-4aaf-8a4c-ea8c63690e99 req-05af48e7-f354-428f-a422-3b0672f07f5d service nova] Lock "719428d6-025b-4baa-97a2-c8ebdd49f57e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:48:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-09c4aa00-5918-4aaf-8a4c-ea8c63690e99 req-05af48e7-f354-428f-a422-3b0672f07f5d service nova] Lock "719428d6-025b-4baa-97a2-c8ebdd49f57e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:48:18 user nova-compute[74342]: DEBUG nova.compute.manager [req-09c4aa00-5918-4aaf-8a4c-ea8c63690e99 req-05af48e7-f354-428f-a422-3b0672f07f5d service nova] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] No waiting events found dispatching network-vif-plugged-32030b48-4c52-4cf9-ba4f-0dc3b580fbdc {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:48:18 user nova-compute[74342]: WARNING nova.compute.manager [req-09c4aa00-5918-4aaf-8a4c-ea8c63690e99 req-05af48e7-f354-428f-a422-3b0672f07f5d service nova] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Received unexpected event network-vif-plugged-32030b48-4c52-4cf9-ba4f-0dc3b580fbdc for instance with vm_state deleted and task_state None.
Oct 16 09:48:18 user nova-compute[74342]: DEBUG nova.compute.manager [req-09c4aa00-5918-4aaf-8a4c-ea8c63690e99 req-05af48e7-f354-428f-a422-3b0672f07f5d service nova] [instance: 719428d6-025b-4baa-97a2-c8ebdd49f57e] Received event network-vif-deleted-32030b48-4c52-4cf9-ba4f-0dc3b580fbdc {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:48:19 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:48:19 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:48:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.467s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:48:19 user nova-compute[74342]: INFO nova.compute.manager [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Successfully reverted task state from rebuilding on failure for instance.
Oct 16 09:48:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0d3619e1-b6d8-4d56-ac00-6c090253760b tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.457s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server [None req-d04ebe62-d40b-4d96-abeb-8e432ec5900b tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Exception during message handling: ValueError: Circular reference detected
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3857, in rebuild_instance
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance_with_claim(
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3943, in _do_rebuild_instance_with_claim
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self._do_rebuild_instance(
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4135, in _do_rebuild_instance
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self._rebuild_default_impl(**kwargs)
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3713, in _rebuild_default_impl
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self._rebuild_volume_backed_instance(
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 3633, in _rebuild_volume_backed_instance
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     with self.virtapi.wait_for_instance_event(instance, events,
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     next(self.gen)
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 559, in wait_for_instance_event
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self._wait_for_instance_events(
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 471, in _wait_for_instance_events
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     actual_event = event.wait()
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 436, in wait
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     instance_event = self.event.wait()
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/event.py", line 125, in wait
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     result = hub.switch()
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/hubs/hub.py", line 313, in switch
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return self.greenlet.switch()
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server eventlet.timeout.Timeout: 60 seconds
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server 
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server 
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1437, in decorated_function
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     with EventReporter(context, event_name, host, instance_uuid,
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1400, in __exit__
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     objects.InstanceActionEvent.event_finish_with_failure(
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/objects/base.py", line 393, in wrapper
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return fn.__get__(None, obj)(*args, **kwargs)
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_versionedobjects/base.py", line 175, in wrapper
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     result = cls.indirection_api.object_class_action_versions(
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/conductor/rpcapi.py", line 240, in object_class_action_versions
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return cctxt.call(context, 'object_class_action_versions',
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/client.py", line 190, in call
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     result = self.transport._send(
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/transport.py", line 123, in _send
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return self._driver.send(target, ctxt, message,
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return self._send(target, ctxt, message, wait_for_reply, timeout,
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 644, in _send
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     msg = rpc_common.serialize_msg(msg)
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/_drivers/common.py", line 292, in serialize_msg
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     _MESSAGE_KEY: jsonutils.dumps(raw_msg)}
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_serialization/jsonutils.py", line 202, in dumps
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return json.dumps(obj, default=default, **kwargs)
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/__init__.py", line 238, in dumps
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     **kw).encode(obj)
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/encoder.py", line 199, in encode
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     chunks = self.iterencode(o, _one_shot=True)
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3.10/json/encoder.py", line 257, in iterencode
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return _iterencode(o, 0)
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server ValueError: Circular reference detected
Oct 16 09:48:19 user nova-compute[74342]: ERROR oslo_messaging.rpc.server 
Oct 16 09:48:19 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-0d3619e1-b6d8-4d56-ac00-6c090253760b tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:48:19 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-0d3619e1-b6d8-4d56-ac00-6c090253760b tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:48:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0d3619e1-b6d8-4d56-ac00-6c090253760b tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.444s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:48:19 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-0d3619e1-b6d8-4d56-ac00-6c090253760b tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Deleted allocations for instance 719428d6-025b-4baa-97a2-c8ebdd49f57e
Oct 16 09:48:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0d3619e1-b6d8-4d56-ac00-6c090253760b tempest-VolumesAssistedSnapshotsTest-654150561 tempest-VolumesAssistedSnapshotsTest-654150561-project-member] Lock "719428d6-025b-4baa-97a2-c8ebdd49f57e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.400s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:48:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-887b26da-bb3b-4bac-aa3e-36dcb296569a tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Acquiring lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:48:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-887b26da-bb3b-4bac-aa3e-36dcb296569a tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:48:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-887b26da-bb3b-4bac-aa3e-36dcb296569a tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Acquiring lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:48:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-887b26da-bb3b-4bac-aa3e-36dcb296569a tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:48:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-887b26da-bb3b-4bac-aa3e-36dcb296569a tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:48:29 user nova-compute[74342]: INFO nova.compute.manager [None req-887b26da-bb3b-4bac-aa3e-36dcb296569a tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Terminating instance
Oct 16 09:48:29 user nova-compute[74342]: DEBUG nova.compute.manager [None req-887b26da-bb3b-4bac-aa3e-36dcb296569a tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 09:48:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:29 user nova-compute[74342]: DEBUG nova.compute.manager [req-bceaf628-77f4-4999-9445-cc43d3dcd6a2 req-27e67bb4-3509-490d-a392-4671783f7578 service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Received event network-vif-unplugged-ecb4fcc0-8f58-493c-9804-76bf3603b899 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:48:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-bceaf628-77f4-4999-9445-cc43d3dcd6a2 req-27e67bb4-3509-490d-a392-4671783f7578 service nova] Acquiring lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:48:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-bceaf628-77f4-4999-9445-cc43d3dcd6a2 req-27e67bb4-3509-490d-a392-4671783f7578 service nova] Lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:48:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-bceaf628-77f4-4999-9445-cc43d3dcd6a2 req-27e67bb4-3509-490d-a392-4671783f7578 service nova] Lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:48:29 user nova-compute[74342]: DEBUG nova.compute.manager [req-bceaf628-77f4-4999-9445-cc43d3dcd6a2 req-27e67bb4-3509-490d-a392-4671783f7578 service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] No waiting events found dispatching network-vif-unplugged-ecb4fcc0-8f58-493c-9804-76bf3603b899 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:48:29 user nova-compute[74342]: DEBUG nova.compute.manager [req-bceaf628-77f4-4999-9445-cc43d3dcd6a2 req-27e67bb4-3509-490d-a392-4671783f7578 service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Received event network-vif-unplugged-ecb4fcc0-8f58-493c-9804-76bf3603b899 for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 09:48:29 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Instance destroyed successfully.
Oct 16 09:48:29 user nova-compute[74342]: DEBUG nova.objects.instance [None req-887b26da-bb3b-4bac-aa3e-36dcb296569a tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lazy-loading 'resources' on Instance uuid 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:48:29 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-887b26da-bb3b-4bac-aa3e-36dcb296569a tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-10-16T09:44:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-640949209',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-640949209',id=6,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpYhQn0nZA6I7ZVLvCwhw5MRkVm+i8dhF9cA+w+3K6essQXKu4e2BqUgXONrqsgQPLMNC9JJK382LUfvK2FFKrfh3cM12JiZnpdknV1HPaHjSi3tgNn41IJGEsjJsOpHg==',key_name='tempest-keypair-1377321458',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:44:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a64826b7567493ab7deee5994b261e7',ramdisk_id='',reservation_id='r-v3nxv2mx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1445023395',owner_user_name='tempest-TaggedAttachmentsTest-1445023395-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:44:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='580c2bb824f04735a5a0b0d6f594bde3',uuid=1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecb4fcc0-8f58-493c-9804-76bf3603b899", "address": "fa:16:3e:27:36:3d", "network": {"id": "7cc9829f-36e8-4fd9-9d62-78f3f0019d1f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-252337481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a64826b7567493ab7deee5994b261e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecb4fcc0-8f", "ovs_interfaceid": "ecb4fcc0-8f58-493c-9804-76bf3603b899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:48:29 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-887b26da-bb3b-4bac-aa3e-36dcb296569a tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Converting VIF {"id": "ecb4fcc0-8f58-493c-9804-76bf3603b899", "address": "fa:16:3e:27:36:3d", "network": {"id": "7cc9829f-36e8-4fd9-9d62-78f3f0019d1f", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-252337481-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a64826b7567493ab7deee5994b261e7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecb4fcc0-8f", "ovs_interfaceid": "ecb4fcc0-8f58-493c-9804-76bf3603b899", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:48:29 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-887b26da-bb3b-4bac-aa3e-36dcb296569a tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:27:36:3d,bridge_name='br-int',has_traffic_filtering=True,id=ecb4fcc0-8f58-493c-9804-76bf3603b899,network=Network(7cc9829f-36e8-4fd9-9d62-78f3f0019d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecb4fcc0-8f') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:48:29 user nova-compute[74342]: DEBUG os_vif [None req-887b26da-bb3b-4bac-aa3e-36dcb296569a tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:36:3d,bridge_name='br-int',has_traffic_filtering=True,id=ecb4fcc0-8f58-493c-9804-76bf3603b899,network=Network(7cc9829f-36e8-4fd9-9d62-78f3f0019d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecb4fcc0-8f') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:48:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapecb4fcc0-8f, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:48:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:48:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a9ca5ac3-4822-43c8-b8c3-ec9cd0f9e14a) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:48:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:29 user nova-compute[74342]: INFO os_vif [None req-887b26da-bb3b-4bac-aa3e-36dcb296569a tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:27:36:3d,bridge_name='br-int',has_traffic_filtering=True,id=ecb4fcc0-8f58-493c-9804-76bf3603b899,network=Network(7cc9829f-36e8-4fd9-9d62-78f3f0019d1f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecb4fcc0-8f')
Oct 16 09:48:29 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-887b26da-bb3b-4bac-aa3e-36dcb296569a tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Deleting instance files /opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4_del
Oct 16 09:48:29 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-887b26da-bb3b-4bac-aa3e-36dcb296569a tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Deletion of /opt/stack/data/nova/instances/1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4_del complete
Oct 16 09:48:29 user nova-compute[74342]: INFO nova.compute.manager [None req-887b26da-bb3b-4bac-aa3e-36dcb296569a tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 16 09:48:29 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-887b26da-bb3b-4bac-aa3e-36dcb296569a tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 09:48:29 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 09:48:29 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 09:48:30 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:48:30 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Took 0.73 seconds to deallocate network for instance.
Oct 16 09:48:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-887b26da-bb3b-4bac-aa3e-36dcb296569a tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:48:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-887b26da-bb3b-4bac-aa3e-36dcb296569a tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:48:31 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-887b26da-bb3b-4bac-aa3e-36dcb296569a tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:48:31 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-887b26da-bb3b-4bac-aa3e-36dcb296569a tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:48:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-887b26da-bb3b-4bac-aa3e-36dcb296569a tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:48:31 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-887b26da-bb3b-4bac-aa3e-36dcb296569a tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Deleted allocations for instance 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4
Oct 16 09:48:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-887b26da-bb3b-4bac-aa3e-36dcb296569a tempest-TaggedAttachmentsTest-1445023395 tempest-TaggedAttachmentsTest-1445023395-project-member] Lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.220s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:48:31 user nova-compute[74342]: DEBUG nova.compute.manager [req-ea554515-d1e4-4b4d-a70a-d9e33d85f8ee req-ccd9ea77-c830-449d-92b3-e3ae97686607 service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Received event network-vif-plugged-ecb4fcc0-8f58-493c-9804-76bf3603b899 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:48:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ea554515-d1e4-4b4d-a70a-d9e33d85f8ee req-ccd9ea77-c830-449d-92b3-e3ae97686607 service nova] Acquiring lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:48:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ea554515-d1e4-4b4d-a70a-d9e33d85f8ee req-ccd9ea77-c830-449d-92b3-e3ae97686607 service nova] Lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:48:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ea554515-d1e4-4b4d-a70a-d9e33d85f8ee req-ccd9ea77-c830-449d-92b3-e3ae97686607 service nova] Lock "1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:48:31 user nova-compute[74342]: DEBUG nova.compute.manager [req-ea554515-d1e4-4b4d-a70a-d9e33d85f8ee req-ccd9ea77-c830-449d-92b3-e3ae97686607 service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] No waiting events found dispatching network-vif-plugged-ecb4fcc0-8f58-493c-9804-76bf3603b899 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:48:31 user nova-compute[74342]: WARNING nova.compute.manager [req-ea554515-d1e4-4b4d-a70a-d9e33d85f8ee req-ccd9ea77-c830-449d-92b3-e3ae97686607 service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Received unexpected event network-vif-plugged-ecb4fcc0-8f58-493c-9804-76bf3603b899 for instance with vm_state deleted and task_state None.
Oct 16 09:48:31 user nova-compute[74342]: DEBUG nova.compute.manager [req-ea554515-d1e4-4b4d-a70a-d9e33d85f8ee req-ccd9ea77-c830-449d-92b3-e3ae97686607 service nova] [instance: 1d923b9a-cfea-4ae8-9f87-c2c2f6f155d4] Received event network-vif-deleted-ecb4fcc0-8f58-493c-9804-76bf3603b899 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:48:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:44 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:48:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:48:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:48:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:48:44 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 09:48:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:48:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk.rescue --force-share --output=json" returned: 0 in 0.206s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:48 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:48:48 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:48:48 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8051MB free_disk=25.340251922607422GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 09:48:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:48:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:48:48 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance d45abd20-3a58-4657-8f4c-a426d8e39be3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:48:48 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 98367a96-22f0-4edb-ab03-a8eb286b437b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:48:48 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance bdcd2e60-b36c-4d87-94d7-076e7430e1f0 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:48:48 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:48:48 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 017caffb-5be2-4e78-ab48-a8091c5c00f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:48:48 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 5dc86029-dcbf-4886-bdc9-7d4413059c96 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:48:48 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance edcefbe0-e89f-4496-9032-f9431d9d5c53 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:48:48 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 09:48:48 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 09:48:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:48 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:48:48 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:48:48 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 09:48:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.488s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:48:49 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:48:49 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:48:49 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:48:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Acquiring lock "c5e44d3b-ed41-4920-825f-e1d283caecfd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:48:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "c5e44d3b-ed41-4920-825f-e1d283caecfd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:48:49 user nova-compute[74342]: DEBUG nova.compute.manager [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:48:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:48:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:48:49 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:48:49 user nova-compute[74342]: INFO nova.compute.claims [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Claim successful on node user
Oct 16 09:48:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:50 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:48:50 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:48:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.384s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:48:50 user nova-compute[74342]: DEBUG nova.compute.manager [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:48:50 user nova-compute[74342]: DEBUG nova.compute.manager [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:48:50 user nova-compute[74342]: DEBUG nova.network.neutron [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:48:50 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:48:50 user nova-compute[74342]: DEBUG nova.compute.manager [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:48:50 user nova-compute[74342]: DEBUG nova.policy [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'afbe4a406e6a43309a197e2a209c7554', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '81481518f90a4d99abd102ab65d54caa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:48:50 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:48:50 user nova-compute[74342]: DEBUG nova.compute.manager [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 09:48:50 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:48:50 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Creating image(s)
Oct 16 09:48:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:48:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "/opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:48:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "/opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:48:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.178s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:48:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:48:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.194s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk 1073741824" returned: 0 in 0.059s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:48:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.195s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:51 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 09:48:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:48:51 user nova-compute[74342]: DEBUG nova.network.neutron [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Successfully created port: 6c307712-877a-44b9-9a89-ffad24cadbc4 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:48:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:48:51 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Cannot resize image /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 09:48:51 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 09:48:51 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Ensure instance console log exists: /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:48:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:48:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:48:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:48:51 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:48:51 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 09:48:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:51 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Didn't find any instances for network info cache update. {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 09:48:51 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:48:51 user nova-compute[74342]: DEBUG nova.network.neutron [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Successfully updated port: 6c307712-877a-44b9-9a89-ffad24cadbc4 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:48:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Acquiring lock "refresh_cache-c5e44d3b-ed41-4920-825f-e1d283caecfd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:48:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Acquired lock "refresh_cache-c5e44d3b-ed41-4920-825f-e1d283caecfd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:48:51 user nova-compute[74342]: DEBUG nova.network.neutron [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.compute.manager [req-565de9a7-cd54-491b-90f9-a67ec69ba6d3 req-5bd199a9-8290-4559-9fab-4a83e615d22f service nova] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Received event network-changed-6c307712-877a-44b9-9a89-ffad24cadbc4 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.compute.manager [req-565de9a7-cd54-491b-90f9-a67ec69ba6d3 req-5bd199a9-8290-4559-9fab-4a83e615d22f service nova] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Refreshing instance network info cache due to event network-changed-6c307712-877a-44b9-9a89-ffad24cadbc4. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-565de9a7-cd54-491b-90f9-a67ec69ba6d3 req-5bd199a9-8290-4559-9fab-4a83e615d22f service nova] Acquiring lock "refresh_cache-c5e44d3b-ed41-4920-825f-e1d283caecfd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.network.neutron [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.network.neutron [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Updating instance_info_cache with network_info: [{"id": "6c307712-877a-44b9-9a89-ffad24cadbc4", "address": "fa:16:3e:21:83:11", "network": {"id": "7bf142ea-2d65-4e3e-95f4-691e535078c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409249207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81481518f90a4d99abd102ab65d54caa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c307712-87", "ovs_interfaceid": "6c307712-877a-44b9-9a89-ffad24cadbc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Releasing lock "refresh_cache-c5e44d3b-ed41-4920-825f-e1d283caecfd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.compute.manager [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Instance network_info: |[{"id": "6c307712-877a-44b9-9a89-ffad24cadbc4", "address": "fa:16:3e:21:83:11", "network": {"id": "7bf142ea-2d65-4e3e-95f4-691e535078c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409249207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81481518f90a4d99abd102ab65d54caa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c307712-87", "ovs_interfaceid": "6c307712-877a-44b9-9a89-ffad24cadbc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-565de9a7-cd54-491b-90f9-a67ec69ba6d3 req-5bd199a9-8290-4559-9fab-4a83e615d22f service nova] Acquired lock "refresh_cache-c5e44d3b-ed41-4920-825f-e1d283caecfd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.network.neutron [req-565de9a7-cd54-491b-90f9-a67ec69ba6d3 req-5bd199a9-8290-4559-9fab-4a83e615d22f service nova] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Refreshing network info cache for port 6c307712-877a-44b9-9a89-ffad24cadbc4 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Start _get_guest_xml network_info=[{"id": "6c307712-877a-44b9-9a89-ffad24cadbc4", "address": "fa:16:3e:21:83:11", "network": {"id": "7bf142ea-2d65-4e3e-95f4-691e535078c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409249207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81481518f90a4d99abd102ab65d54caa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c307712-87", "ovs_interfaceid": "6c307712-877a-44b9-9a89-ffad24cadbc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:48:52 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:48:52 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:48:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-13118212',display_name='tempest-ServerActionsTestOtherB-server-13118212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-13118212',id=15,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFyI0lKp1ntOYPGityGnnSBavRl0hSeYQxboJuGTBYyIPdaJHX27900OLhX0GU91RcLxOgMFJOVCotJNi9ZnC1rWux5jCR//n+7EdDi2c7USVCSopq2ZuImlyPrRPszQA==',key_name='tempest-keypair-1671594657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81481518f90a4d99abd102ab65d54caa',ramdisk_id='',reservation_id='r-p5fny93p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1418473661',owner_user_name='tempest-ServerActionsTestOtherB-1418473661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:48:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afbe4a406e6a43309a197e2a209c7554',uuid=c5e44d3b-ed41-4920-825f-e1d283caecfd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c307712-877a-44b9-9a89-ffad24cadbc4", "address": "fa:16:3e:21:83:11", "network": {"id": "7bf142ea-2d65-4e3e-95f4-691e535078c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409249207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81481518f90a4d99abd102ab65d54caa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c307712-87", "ovs_interfaceid": "6c307712-877a-44b9-9a89-ffad24cadbc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Converting VIF {"id": "6c307712-877a-44b9-9a89-ffad24cadbc4", "address": "fa:16:3e:21:83:11", "network": {"id": "7bf142ea-2d65-4e3e-95f4-691e535078c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409249207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81481518f90a4d99abd102ab65d54caa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c307712-87", "ovs_interfaceid": "6c307712-877a-44b9-9a89-ffad24cadbc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:83:11,bridge_name='br-int',has_traffic_filtering=True,id=6c307712-877a-44b9-9a89-ffad24cadbc4,network=Network(7bf142ea-2d65-4e3e-95f4-691e535078c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c307712-87') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.objects.instance [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lazy-loading 'pci_devices' on Instance uuid c5e44d3b-ed41-4920-825f-e1d283caecfd {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:48:52 user nova-compute[74342]:   <uuid>c5e44d3b-ed41-4920-825f-e1d283caecfd</uuid>
Oct 16 09:48:52 user nova-compute[74342]:   <name>instance-0000000f</name>
Oct 16 09:48:52 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:48:52 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:48:52 user nova-compute[74342]:   <metadata>
Oct 16 09:48:52 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:48:52 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:48:52 user nova-compute[74342]:       <nova:name>tempest-ServerActionsTestOtherB-server-13118212</nova:name>
Oct 16 09:48:52 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:48:52</nova:creationTime>
Oct 16 09:48:52 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:48:52 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:48:52 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:48:52 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:48:52 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:48:52 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:48:52 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:48:52 user nova-compute[74342]:       <nova:owner>
Oct 16 09:48:52 user nova-compute[74342]:         <nova:user uuid="afbe4a406e6a43309a197e2a209c7554">tempest-ServerActionsTestOtherB-1418473661-project-member</nova:user>
Oct 16 09:48:52 user nova-compute[74342]:         <nova:project uuid="81481518f90a4d99abd102ab65d54caa">tempest-ServerActionsTestOtherB-1418473661</nova:project>
Oct 16 09:48:52 user nova-compute[74342]:       </nova:owner>
Oct 16 09:48:52 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:48:52 user nova-compute[74342]:       <nova:ports>
Oct 16 09:48:52 user nova-compute[74342]:         <nova:port uuid="6c307712-877a-44b9-9a89-ffad24cadbc4">
Oct 16 09:48:52 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 09:48:52 user nova-compute[74342]:         </nova:port>
Oct 16 09:48:52 user nova-compute[74342]:       </nova:ports>
Oct 16 09:48:52 user nova-compute[74342]:     </nova:instance>
Oct 16 09:48:52 user nova-compute[74342]:   </metadata>
Oct 16 09:48:52 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:48:52 user nova-compute[74342]:     <system>
Oct 16 09:48:52 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:48:52 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:48:52 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:48:52 user nova-compute[74342]:       <entry name="serial">c5e44d3b-ed41-4920-825f-e1d283caecfd</entry>
Oct 16 09:48:52 user nova-compute[74342]:       <entry name="uuid">c5e44d3b-ed41-4920-825f-e1d283caecfd</entry>
Oct 16 09:48:52 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:48:52 user nova-compute[74342]:     </system>
Oct 16 09:48:52 user nova-compute[74342]:   </sysinfo>
Oct 16 09:48:52 user nova-compute[74342]:   <os>
Oct 16 09:48:52 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:48:52 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:48:52 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:48:52 user nova-compute[74342]:   </os>
Oct 16 09:48:52 user nova-compute[74342]:   <features>
Oct 16 09:48:52 user nova-compute[74342]:     <acpi/>
Oct 16 09:48:52 user nova-compute[74342]:     <apic/>
Oct 16 09:48:52 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:48:52 user nova-compute[74342]:   </features>
Oct 16 09:48:52 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:48:52 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:48:52 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:48:52 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:48:52 user nova-compute[74342]:   </clock>
Oct 16 09:48:52 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:48:52 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:48:52 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:48:52 user nova-compute[74342]:   </cpu>
Oct 16 09:48:52 user nova-compute[74342]:   <devices>
Oct 16 09:48:52 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 09:48:52 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 09:48:52 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk"/>
Oct 16 09:48:52 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:48:52 user nova-compute[74342]:     </disk>
Oct 16 09:48:52 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:48:52 user nova-compute[74342]:       <mac address="fa:16:3e:21:83:11"/>
Oct 16 09:48:52 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:48:52 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:48:52 user nova-compute[74342]:       <target dev="tap6c307712-87"/>
Oct 16 09:48:52 user nova-compute[74342]:     </interface>
Oct 16 09:48:52 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:48:52 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/console.log" append="off"/>
Oct 16 09:48:52 user nova-compute[74342]:     </serial>
Oct 16 09:48:52 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:48:52 user nova-compute[74342]:     <video>
Oct 16 09:48:52 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:48:52 user nova-compute[74342]:     </video>
Oct 16 09:48:52 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:48:52 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:48:52 user nova-compute[74342]:     </rng>
Oct 16 09:48:52 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:48:52 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:48:52 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:48:52 user nova-compute[74342]:     </memballoon>
Oct 16 09:48:52 user nova-compute[74342]:   </devices>
Oct 16 09:48:52 user nova-compute[74342]: </domain>
Oct 16 09:48:52 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:48:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-13118212',display_name='tempest-ServerActionsTestOtherB-server-13118212',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-13118212',id=15,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFyI0lKp1ntOYPGityGnnSBavRl0hSeYQxboJuGTBYyIPdaJHX27900OLhX0GU91RcLxOgMFJOVCotJNi9ZnC1rWux5jCR//n+7EdDi2c7USVCSopq2ZuImlyPrRPszQA==',key_name='tempest-keypair-1671594657',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='81481518f90a4d99abd102ab65d54caa',ramdisk_id='',reservation_id='r-p5fny93p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1418473661',owner_user_name='tempest-ServerActionsTestOtherB-1418473661-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:48:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afbe4a406e6a43309a197e2a209c7554',uuid=c5e44d3b-ed41-4920-825f-e1d283caecfd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6c307712-877a-44b9-9a89-ffad24cadbc4", "address": "fa:16:3e:21:83:11", "network": {"id": "7bf142ea-2d65-4e3e-95f4-691e535078c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409249207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81481518f90a4d99abd102ab65d54caa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c307712-87", "ovs_interfaceid": "6c307712-877a-44b9-9a89-ffad24cadbc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Converting VIF {"id": "6c307712-877a-44b9-9a89-ffad24cadbc4", "address": "fa:16:3e:21:83:11", "network": {"id": "7bf142ea-2d65-4e3e-95f4-691e535078c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409249207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81481518f90a4d99abd102ab65d54caa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c307712-87", "ovs_interfaceid": "6c307712-877a-44b9-9a89-ffad24cadbc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:83:11,bridge_name='br-int',has_traffic_filtering=True,id=6c307712-877a-44b9-9a89-ffad24cadbc4,network=Network(7bf142ea-2d65-4e3e-95f4-691e535078c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c307712-87') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG os_vif [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:83:11,bridge_name='br-int',has_traffic_filtering=True,id=6c307712-877a-44b9-9a89-ffad24cadbc4,network=Network(7bf142ea-2d65-4e3e-95f4-691e535078c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c307712-87') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'df0b30a2-34b6-59d8-b9ae-85f93c69d0a8', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6c307712-87, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6c307712-87, col_values=(('qos', UUID('0ca88ee3-53f2-4207-be27-9d02dc8fe63c')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6c307712-87, col_values=(('external_ids', {'iface-id': '6c307712-877a-44b9-9a89-ffad24cadbc4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:21:83:11', 'vm-uuid': 'c5e44d3b-ed41-4920-825f-e1d283caecfd'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:52 user nova-compute[74342]: INFO os_vif [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:83:11,bridge_name='br-int',has_traffic_filtering=True,id=6c307712-877a-44b9-9a89-ffad24cadbc4,network=Network(7bf142ea-2d65-4e3e-95f4-691e535078c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c307712-87')
Oct 16 09:48:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] No VIF found with MAC fa:16:3e:21:83:11, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.network.neutron [req-565de9a7-cd54-491b-90f9-a67ec69ba6d3 req-5bd199a9-8290-4559-9fab-4a83e615d22f service nova] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Updated VIF entry in instance network info cache for port 6c307712-877a-44b9-9a89-ffad24cadbc4. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG nova.network.neutron [req-565de9a7-cd54-491b-90f9-a67ec69ba6d3 req-5bd199a9-8290-4559-9fab-4a83e615d22f service nova] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Updating instance_info_cache with network_info: [{"id": "6c307712-877a-44b9-9a89-ffad24cadbc4", "address": "fa:16:3e:21:83:11", "network": {"id": "7bf142ea-2d65-4e3e-95f4-691e535078c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409249207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81481518f90a4d99abd102ab65d54caa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c307712-87", "ovs_interfaceid": "6c307712-877a-44b9-9a89-ffad24cadbc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:48:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-565de9a7-cd54-491b-90f9-a67ec69ba6d3 req-5bd199a9-8290-4559-9fab-4a83e615d22f service nova] Releasing lock "refresh_cache-c5e44d3b-ed41-4920-825f-e1d283caecfd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:48:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:54 user nova-compute[74342]: DEBUG nova.compute.manager [req-57a8fede-87fe-4337-8cce-9781ae827aa6 req-f72382d7-5aa0-4923-b91d-a68968bfcf7a service nova] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Received event network-vif-plugged-6c307712-877a-44b9-9a89-ffad24cadbc4 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:48:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-57a8fede-87fe-4337-8cce-9781ae827aa6 req-f72382d7-5aa0-4923-b91d-a68968bfcf7a service nova] Acquiring lock "c5e44d3b-ed41-4920-825f-e1d283caecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:48:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-57a8fede-87fe-4337-8cce-9781ae827aa6 req-f72382d7-5aa0-4923-b91d-a68968bfcf7a service nova] Lock "c5e44d3b-ed41-4920-825f-e1d283caecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:48:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-57a8fede-87fe-4337-8cce-9781ae827aa6 req-f72382d7-5aa0-4923-b91d-a68968bfcf7a service nova] Lock "c5e44d3b-ed41-4920-825f-e1d283caecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:48:54 user nova-compute[74342]: DEBUG nova.compute.manager [req-57a8fede-87fe-4337-8cce-9781ae827aa6 req-f72382d7-5aa0-4923-b91d-a68968bfcf7a service nova] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] No waiting events found dispatching network-vif-plugged-6c307712-877a-44b9-9a89-ffad24cadbc4 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:48:54 user nova-compute[74342]: WARNING nova.compute.manager [req-57a8fede-87fe-4337-8cce-9781ae827aa6 req-f72382d7-5aa0-4923-b91d-a68968bfcf7a service nova] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Received unexpected event network-vif-plugged-6c307712-877a-44b9-9a89-ffad24cadbc4 for instance with vm_state building and task_state spawning.
Oct 16 09:48:54 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:48:54 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:54 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:56 user nova-compute[74342]: DEBUG nova.compute.manager [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:48:56 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:48:56 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Instance spawned successfully.
Oct 16 09:48:56 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:48:56 user nova-compute[74342]: DEBUG nova.compute.manager [req-a1582ca8-f1f0-4927-8bec-e56ffe69ac18 req-3ca33a82-e8b4-42ab-8e46-7ed07b890902 service nova] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Received event network-vif-plugged-6c307712-877a-44b9-9a89-ffad24cadbc4 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:48:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a1582ca8-f1f0-4927-8bec-e56ffe69ac18 req-3ca33a82-e8b4-42ab-8e46-7ed07b890902 service nova] Acquiring lock "c5e44d3b-ed41-4920-825f-e1d283caecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:48:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a1582ca8-f1f0-4927-8bec-e56ffe69ac18 req-3ca33a82-e8b4-42ab-8e46-7ed07b890902 service nova] Lock "c5e44d3b-ed41-4920-825f-e1d283caecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:48:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a1582ca8-f1f0-4927-8bec-e56ffe69ac18 req-3ca33a82-e8b4-42ab-8e46-7ed07b890902 service nova] Lock "c5e44d3b-ed41-4920-825f-e1d283caecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:48:56 user nova-compute[74342]: DEBUG nova.compute.manager [req-a1582ca8-f1f0-4927-8bec-e56ffe69ac18 req-3ca33a82-e8b4-42ab-8e46-7ed07b890902 service nova] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] No waiting events found dispatching network-vif-plugged-6c307712-877a-44b9-9a89-ffad24cadbc4 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:48:56 user nova-compute[74342]: WARNING nova.compute.manager [req-a1582ca8-f1f0-4927-8bec-e56ffe69ac18 req-3ca33a82-e8b4-42ab-8e46-7ed07b890902 service nova] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Received unexpected event network-vif-plugged-6c307712-877a-44b9-9a89-ffad24cadbc4 for instance with vm_state building and task_state spawning.
Oct 16 09:48:56 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:48:56 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:48:56 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:48:56 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:48:56 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:48:56 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:48:56 user nova-compute[74342]: INFO nova.compute.manager [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Took 5.81 seconds to spawn the instance on the hypervisor.
Oct 16 09:48:56 user nova-compute[74342]: DEBUG nova.compute.manager [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:48:56 user nova-compute[74342]: INFO nova.compute.manager [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Took 6.55 seconds to build instance.
Oct 16 09:48:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ae7c8a9b-09ff-4d3d-98a4-18cae609ef32 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "c5e44d3b-ed41-4920-825f-e1d283caecfd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.655s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:48:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:48:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:05 user nova-compute[74342]: DEBUG nova.compute.manager [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:49:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:05 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:49:05 user nova-compute[74342]: INFO nova.compute.claims [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Claim successful on node user
Oct 16 09:49:06 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:49:06 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:49:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:06 user nova-compute[74342]: DEBUG nova.compute.manager [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:49:06 user nova-compute[74342]: DEBUG nova.compute.manager [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:49:06 user nova-compute[74342]: DEBUG nova.network.neutron [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:49:06 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:49:06 user nova-compute[74342]: DEBUG nova.compute.manager [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:49:06 user nova-compute[74342]: DEBUG nova.compute.manager [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 09:49:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:49:06 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Creating image(s)
Oct 16 09:49:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "/opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "/opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "/opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:06 user nova-compute[74342]: DEBUG nova.policy [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ee02f6ad1d9749948f43fb432685d067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08329cd0ad7d42a1999ca4f407d93245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:49:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.184s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.209s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk 1073741824" returned: 0 in 0.100s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.233s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:07 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 09:49:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:07 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Cannot resize image /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 09:49:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 09:49:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Ensure instance console log exists: /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:49:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:07 user nova-compute[74342]: DEBUG nova.network.neutron [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Successfully created port: 7fdd8609-f23f-4572-aa9b-68cdb668df83 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:49:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:09 user nova-compute[74342]: DEBUG nova.network.neutron [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Successfully updated port: 7fdd8609-f23f-4572-aa9b-68cdb668df83 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:49:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "refresh_cache-3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:49:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquired lock "refresh_cache-3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:49:09 user nova-compute[74342]: DEBUG nova.network.neutron [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:49:09 user nova-compute[74342]: DEBUG nova.compute.manager [req-8a93eafc-3811-4756-9da7-ef7e3f8cbb28 req-8506c7a8-597a-4209-8987-d1436bae1234 service nova] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Received event network-changed-7fdd8609-f23f-4572-aa9b-68cdb668df83 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:49:09 user nova-compute[74342]: DEBUG nova.compute.manager [req-8a93eafc-3811-4756-9da7-ef7e3f8cbb28 req-8506c7a8-597a-4209-8987-d1436bae1234 service nova] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Refreshing instance network info cache due to event network-changed-7fdd8609-f23f-4572-aa9b-68cdb668df83. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:49:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8a93eafc-3811-4756-9da7-ef7e3f8cbb28 req-8506c7a8-597a-4209-8987-d1436bae1234 service nova] Acquiring lock "refresh_cache-3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:49:09 user nova-compute[74342]: DEBUG nova.network.neutron [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:49:09 user nova-compute[74342]: DEBUG nova.network.neutron [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Updating instance_info_cache with network_info: [{"id": "7fdd8609-f23f-4572-aa9b-68cdb668df83", "address": "fa:16:3e:4f:14:0e", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fdd8609-f2", "ovs_interfaceid": "7fdd8609-f23f-4572-aa9b-68cdb668df83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:49:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Releasing lock "refresh_cache-3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:49:09 user nova-compute[74342]: DEBUG nova.compute.manager [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Instance network_info: |[{"id": "7fdd8609-f23f-4572-aa9b-68cdb668df83", "address": "fa:16:3e:4f:14:0e", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fdd8609-f2", "ovs_interfaceid": "7fdd8609-f23f-4572-aa9b-68cdb668df83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:49:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8a93eafc-3811-4756-9da7-ef7e3f8cbb28 req-8506c7a8-597a-4209-8987-d1436bae1234 service nova] Acquired lock "refresh_cache-3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:49:09 user nova-compute[74342]: DEBUG nova.network.neutron [req-8a93eafc-3811-4756-9da7-ef7e3f8cbb28 req-8506c7a8-597a-4209-8987-d1436bae1234 service nova] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Refreshing network info cache for port 7fdd8609-f23f-4572-aa9b-68cdb668df83 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:49:09 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Start _get_guest_xml network_info=[{"id": "7fdd8609-f23f-4572-aa9b-68cdb668df83", "address": "fa:16:3e:4f:14:0e", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fdd8609-f2", "ovs_interfaceid": "7fdd8609-f23f-4572-aa9b-68cdb668df83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:49:09 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:49:09 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:49:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:49:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-466043768',display_name='tempest-AttachVolumeNegativeTest-server-466043768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-466043768',id=16,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJafaVyeoMEpPXLf0Eb/aVsJ1zT8C2AU07lc45P1QngXqb/JD5qFvpzD+ZMC/ibKPbpZ+VL5cw/9kmvq1sIUMAK0pm5nIZKdhnoQdpFuP843B9xuYHrKUbwyNRjcZVU9vQ==',key_name='tempest-keypair-512064332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08329cd0ad7d42a1999ca4f407d93245',ramdisk_id='',reservation_id='r-9w0lpo5l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-119585701',owner_user_name='tempest-AttachVolumeNegativeTest-119585701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:49:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee02f6ad1d9749948f43fb432685d067',uuid=3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fdd8609-f23f-4572-aa9b-68cdb668df83", "address": "fa:16:3e:4f:14:0e", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fdd8609-f2", "ovs_interfaceid": "7fdd8609-f23f-4572-aa9b-68cdb668df83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Converting VIF {"id": "7fdd8609-f23f-4572-aa9b-68cdb668df83", "address": "fa:16:3e:4f:14:0e", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fdd8609-f2", "ovs_interfaceid": "7fdd8609-f23f-4572-aa9b-68cdb668df83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:14:0e,bridge_name='br-int',has_traffic_filtering=True,id=7fdd8609-f23f-4572-aa9b-68cdb668df83,network=Network(023e393d-f8ef-42f1-8879-6259a82218cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fdd8609-f2') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG nova.objects.instance [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lazy-loading 'pci_devices' on Instance uuid 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:49:10 user nova-compute[74342]:   <uuid>3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4</uuid>
Oct 16 09:49:10 user nova-compute[74342]:   <name>instance-00000010</name>
Oct 16 09:49:10 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:49:10 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:49:10 user nova-compute[74342]:   <metadata>
Oct 16 09:49:10 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:49:10 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:49:10 user nova-compute[74342]:       <nova:name>tempest-AttachVolumeNegativeTest-server-466043768</nova:name>
Oct 16 09:49:10 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:49:10</nova:creationTime>
Oct 16 09:49:10 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:49:10 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:49:10 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:49:10 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:49:10 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:49:10 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:49:10 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:49:10 user nova-compute[74342]:       <nova:owner>
Oct 16 09:49:10 user nova-compute[74342]:         <nova:user uuid="ee02f6ad1d9749948f43fb432685d067">tempest-AttachVolumeNegativeTest-119585701-project-member</nova:user>
Oct 16 09:49:10 user nova-compute[74342]:         <nova:project uuid="08329cd0ad7d42a1999ca4f407d93245">tempest-AttachVolumeNegativeTest-119585701</nova:project>
Oct 16 09:49:10 user nova-compute[74342]:       </nova:owner>
Oct 16 09:49:10 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:49:10 user nova-compute[74342]:       <nova:ports>
Oct 16 09:49:10 user nova-compute[74342]:         <nova:port uuid="7fdd8609-f23f-4572-aa9b-68cdb668df83">
Oct 16 09:49:10 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 16 09:49:10 user nova-compute[74342]:         </nova:port>
Oct 16 09:49:10 user nova-compute[74342]:       </nova:ports>
Oct 16 09:49:10 user nova-compute[74342]:     </nova:instance>
Oct 16 09:49:10 user nova-compute[74342]:   </metadata>
Oct 16 09:49:10 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:49:10 user nova-compute[74342]:     <system>
Oct 16 09:49:10 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:49:10 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:49:10 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:49:10 user nova-compute[74342]:       <entry name="serial">3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4</entry>
Oct 16 09:49:10 user nova-compute[74342]:       <entry name="uuid">3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4</entry>
Oct 16 09:49:10 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:49:10 user nova-compute[74342]:     </system>
Oct 16 09:49:10 user nova-compute[74342]:   </sysinfo>
Oct 16 09:49:10 user nova-compute[74342]:   <os>
Oct 16 09:49:10 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:49:10 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:49:10 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:49:10 user nova-compute[74342]:   </os>
Oct 16 09:49:10 user nova-compute[74342]:   <features>
Oct 16 09:49:10 user nova-compute[74342]:     <acpi/>
Oct 16 09:49:10 user nova-compute[74342]:     <apic/>
Oct 16 09:49:10 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:49:10 user nova-compute[74342]:   </features>
Oct 16 09:49:10 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:49:10 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:49:10 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:49:10 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:49:10 user nova-compute[74342]:   </clock>
Oct 16 09:49:10 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:49:10 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:49:10 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:49:10 user nova-compute[74342]:   </cpu>
Oct 16 09:49:10 user nova-compute[74342]:   <devices>
Oct 16 09:49:10 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 09:49:10 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 09:49:10 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk"/>
Oct 16 09:49:10 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:49:10 user nova-compute[74342]:     </disk>
Oct 16 09:49:10 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:49:10 user nova-compute[74342]:       <mac address="fa:16:3e:4f:14:0e"/>
Oct 16 09:49:10 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:49:10 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:49:10 user nova-compute[74342]:       <target dev="tap7fdd8609-f2"/>
Oct 16 09:49:10 user nova-compute[74342]:     </interface>
Oct 16 09:49:10 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:49:10 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/console.log" append="off"/>
Oct 16 09:49:10 user nova-compute[74342]:     </serial>
Oct 16 09:49:10 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:49:10 user nova-compute[74342]:     <video>
Oct 16 09:49:10 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:49:10 user nova-compute[74342]:     </video>
Oct 16 09:49:10 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:49:10 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:49:10 user nova-compute[74342]:     </rng>
Oct 16 09:49:10 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:49:10 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:49:10 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:49:10 user nova-compute[74342]:     </memballoon>
Oct 16 09:49:10 user nova-compute[74342]:   </devices>
Oct 16 09:49:10 user nova-compute[74342]: </domain>
Oct 16 09:49:10 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:49:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-466043768',display_name='tempest-AttachVolumeNegativeTest-server-466043768',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-466043768',id=16,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJafaVyeoMEpPXLf0Eb/aVsJ1zT8C2AU07lc45P1QngXqb/JD5qFvpzD+ZMC/ibKPbpZ+VL5cw/9kmvq1sIUMAK0pm5nIZKdhnoQdpFuP843B9xuYHrKUbwyNRjcZVU9vQ==',key_name='tempest-keypair-512064332',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08329cd0ad7d42a1999ca4f407d93245',ramdisk_id='',reservation_id='r-9w0lpo5l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-119585701',owner_user_name='tempest-AttachVolumeNegativeTest-119585701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:49:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee02f6ad1d9749948f43fb432685d067',uuid=3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7fdd8609-f23f-4572-aa9b-68cdb668df83", "address": "fa:16:3e:4f:14:0e", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fdd8609-f2", "ovs_interfaceid": "7fdd8609-f23f-4572-aa9b-68cdb668df83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Converting VIF {"id": "7fdd8609-f23f-4572-aa9b-68cdb668df83", "address": "fa:16:3e:4f:14:0e", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fdd8609-f2", "ovs_interfaceid": "7fdd8609-f23f-4572-aa9b-68cdb668df83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:14:0e,bridge_name='br-int',has_traffic_filtering=True,id=7fdd8609-f23f-4572-aa9b-68cdb668df83,network=Network(023e393d-f8ef-42f1-8879-6259a82218cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fdd8609-f2') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG os_vif [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:14:0e,bridge_name='br-int',has_traffic_filtering=True,id=7fdd8609-f23f-4572-aa9b-68cdb668df83,network=Network(023e393d-f8ef-42f1-8879-6259a82218cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fdd8609-f2') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c15dc304-1a27-58f9-90d5-fe0b10bd8cf6', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7fdd8609-f2, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7fdd8609-f2, col_values=(('qos', UUID('d1aebe7e-b8b4-445b-9576-14c289574233')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7fdd8609-f2, col_values=(('external_ids', {'iface-id': '7fdd8609-f23f-4572-aa9b-68cdb668df83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:14:0e', 'vm-uuid': '3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:10 user nova-compute[74342]: INFO os_vif [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:14:0e,bridge_name='br-int',has_traffic_filtering=True,id=7fdd8609-f23f-4572-aa9b-68cdb668df83,network=Network(023e393d-f8ef-42f1-8879-6259a82218cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fdd8609-f2')
Oct 16 09:49:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] No VIF found with MAC fa:16:3e:4f:14:0e, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG nova.network.neutron [req-8a93eafc-3811-4756-9da7-ef7e3f8cbb28 req-8506c7a8-597a-4209-8987-d1436bae1234 service nova] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Updated VIF entry in instance network info cache for port 7fdd8609-f23f-4572-aa9b-68cdb668df83. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG nova.network.neutron [req-8a93eafc-3811-4756-9da7-ef7e3f8cbb28 req-8506c7a8-597a-4209-8987-d1436bae1234 service nova] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Updating instance_info_cache with network_info: [{"id": "7fdd8609-f23f-4572-aa9b-68cdb668df83", "address": "fa:16:3e:4f:14:0e", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fdd8609-f2", "ovs_interfaceid": "7fdd8609-f23f-4572-aa9b-68cdb668df83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8a93eafc-3811-4756-9da7-ef7e3f8cbb28 req-8506c7a8-597a-4209-8987-d1436bae1234 service nova] Releasing lock "refresh_cache-3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:49:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:11 user nova-compute[74342]: DEBUG nova.compute.manager [req-3d8da4fc-9979-4383-acdc-6b7d1ba2bfe9 req-03942c07-d71e-45be-b99a-618878097bec service nova] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Received event network-vif-plugged-7fdd8609-f23f-4572-aa9b-68cdb668df83 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:49:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-3d8da4fc-9979-4383-acdc-6b7d1ba2bfe9 req-03942c07-d71e-45be-b99a-618878097bec service nova] Acquiring lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-3d8da4fc-9979-4383-acdc-6b7d1ba2bfe9 req-03942c07-d71e-45be-b99a-618878097bec service nova] Lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-3d8da4fc-9979-4383-acdc-6b7d1ba2bfe9 req-03942c07-d71e-45be-b99a-618878097bec service nova] Lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:11 user nova-compute[74342]: DEBUG nova.compute.manager [req-3d8da4fc-9979-4383-acdc-6b7d1ba2bfe9 req-03942c07-d71e-45be-b99a-618878097bec service nova] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] No waiting events found dispatching network-vif-plugged-7fdd8609-f23f-4572-aa9b-68cdb668df83 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:49:11 user nova-compute[74342]: WARNING nova.compute.manager [req-3d8da4fc-9979-4383-acdc-6b7d1ba2bfe9 req-03942c07-d71e-45be-b99a-618878097bec service nova] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Received unexpected event network-vif-plugged-7fdd8609-f23f-4572-aa9b-68cdb668df83 for instance with vm_state building and task_state spawning.
Oct 16 09:49:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:13 user nova-compute[74342]: DEBUG nova.compute.manager [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:49:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:49:13 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Instance spawned successfully.
Oct 16 09:49:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:49:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:49:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:49:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:49:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:49:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:49:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:49:13 user nova-compute[74342]: DEBUG nova.compute.manager [req-d28be293-1424-4b63-80f6-4bd898efd605 req-e6dad46c-3375-40b4-aff0-4ce7f50491ae service nova] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Received event network-vif-plugged-7fdd8609-f23f-4572-aa9b-68cdb668df83 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:49:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d28be293-1424-4b63-80f6-4bd898efd605 req-e6dad46c-3375-40b4-aff0-4ce7f50491ae service nova] Acquiring lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d28be293-1424-4b63-80f6-4bd898efd605 req-e6dad46c-3375-40b4-aff0-4ce7f50491ae service nova] Lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d28be293-1424-4b63-80f6-4bd898efd605 req-e6dad46c-3375-40b4-aff0-4ce7f50491ae service nova] Lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:13 user nova-compute[74342]: DEBUG nova.compute.manager [req-d28be293-1424-4b63-80f6-4bd898efd605 req-e6dad46c-3375-40b4-aff0-4ce7f50491ae service nova] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] No waiting events found dispatching network-vif-plugged-7fdd8609-f23f-4572-aa9b-68cdb668df83 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:49:13 user nova-compute[74342]: WARNING nova.compute.manager [req-d28be293-1424-4b63-80f6-4bd898efd605 req-e6dad46c-3375-40b4-aff0-4ce7f50491ae service nova] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Received unexpected event network-vif-plugged-7fdd8609-f23f-4572-aa9b-68cdb668df83 for instance with vm_state building and task_state spawning.
Oct 16 09:49:13 user nova-compute[74342]: INFO nova.compute.manager [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Took 7.41 seconds to spawn the instance on the hypervisor.
Oct 16 09:49:13 user nova-compute[74342]: DEBUG nova.compute.manager [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:49:14 user nova-compute[74342]: INFO nova.compute.manager [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Took 8.32 seconds to build instance.
Oct 16 09:49:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-23457ceb-abc8-46dd-8893-3db648477462 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.496s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Acquiring lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:22 user nova-compute[74342]: DEBUG nova.compute.manager [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:49:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:22 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:49:22 user nova-compute[74342]: INFO nova.compute.claims [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Claim successful on node user
Oct 16 09:49:23 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:49:23 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:49:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.676s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:23 user nova-compute[74342]: DEBUG nova.compute.manager [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:49:23 user nova-compute[74342]: DEBUG nova.compute.manager [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:49:23 user nova-compute[74342]: DEBUG nova.network.neutron [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:49:23 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:49:23 user nova-compute[74342]: DEBUG nova.compute.manager [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:49:23 user nova-compute[74342]: DEBUG nova.policy [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '86582c54136d4b07bf02392c984e0e02', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e198c124675940d69559cd3ae04644c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:49:23 user nova-compute[74342]: DEBUG nova.compute.manager [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 09:49:23 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:49:23 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Creating image(s)
Oct 16 09:49:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9acd5f6-12e3-488b-b6c6-e4b81f5fc897/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "/opt/stack/data/nova/instances/a9acd5f6-12e3-488b-b6c6-e4b81f5fc897/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "/opt/stack/data/nova/instances/a9acd5f6-12e3-488b-b6c6-e4b81f5fc897/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.239s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.205s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/a9acd5f6-12e3-488b-b6c6-e4b81f5fc897/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/a9acd5f6-12e3-488b-b6c6-e4b81f5fc897/disk 1073741824" returned: 0 in 0.055s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.277s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:24 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a9acd5f6-12e3-488b-b6c6-e4b81f5fc897/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 09:49:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9acd5f6-12e3-488b-b6c6-e4b81f5fc897/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:24 user nova-compute[74342]: DEBUG nova.network.neutron [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Successfully created port: da49a9b4-9434-45c8-93cd-e7bfb0654d87 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:49:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9acd5f6-12e3-488b-b6c6-e4b81f5fc897/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:24 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Cannot resize image /opt/stack/data/nova/instances/a9acd5f6-12e3-488b-b6c6-e4b81f5fc897/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 09:49:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 09:49:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Ensure instance console log exists: /opt/stack/data/nova/instances/a9acd5f6-12e3-488b-b6c6-e4b81f5fc897/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:49:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:25 user nova-compute[74342]: DEBUG nova.network.neutron [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Successfully updated port: da49a9b4-9434-45c8-93cd-e7bfb0654d87 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:49:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Acquiring lock "refresh_cache-a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:49:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Acquired lock "refresh_cache-a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:49:25 user nova-compute[74342]: DEBUG nova.network.neutron [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:49:25 user nova-compute[74342]: DEBUG nova.compute.manager [req-07948849-d3b3-4e3b-bd12-deb0db71ea1d req-4111cfb0-0ec5-42d9-8b06-4886cd4cff30 service nova] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Received event network-changed-da49a9b4-9434-45c8-93cd-e7bfb0654d87 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:49:25 user nova-compute[74342]: DEBUG nova.compute.manager [req-07948849-d3b3-4e3b-bd12-deb0db71ea1d req-4111cfb0-0ec5-42d9-8b06-4886cd4cff30 service nova] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Refreshing instance network info cache due to event network-changed-da49a9b4-9434-45c8-93cd-e7bfb0654d87. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:49:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-07948849-d3b3-4e3b-bd12-deb0db71ea1d req-4111cfb0-0ec5-42d9-8b06-4886cd4cff30 service nova] Acquiring lock "refresh_cache-a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:49:25 user nova-compute[74342]: DEBUG nova.network.neutron [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:49:25 user nova-compute[74342]: DEBUG nova.network.neutron [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Updating instance_info_cache with network_info: [{"id": "da49a9b4-9434-45c8-93cd-e7bfb0654d87", "address": "fa:16:3e:5a:fd:10", "network": {"id": "cb593fff-0bec-4f80-8b28-361a9ca3aa47", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-43873371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e198c124675940d69559cd3ae04644c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda49a9b4-94", "ovs_interfaceid": "da49a9b4-9434-45c8-93cd-e7bfb0654d87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:49:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Releasing lock "refresh_cache-a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:49:25 user nova-compute[74342]: DEBUG nova.compute.manager [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Instance network_info: |[{"id": "da49a9b4-9434-45c8-93cd-e7bfb0654d87", "address": "fa:16:3e:5a:fd:10", "network": {"id": "cb593fff-0bec-4f80-8b28-361a9ca3aa47", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-43873371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e198c124675940d69559cd3ae04644c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda49a9b4-94", "ovs_interfaceid": "da49a9b4-9434-45c8-93cd-e7bfb0654d87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:49:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-07948849-d3b3-4e3b-bd12-deb0db71ea1d req-4111cfb0-0ec5-42d9-8b06-4886cd4cff30 service nova] Acquired lock "refresh_cache-a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:49:25 user nova-compute[74342]: DEBUG nova.network.neutron [req-07948849-d3b3-4e3b-bd12-deb0db71ea1d req-4111cfb0-0ec5-42d9-8b06-4886cd4cff30 service nova] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Refreshing network info cache for port da49a9b4-9434-45c8-93cd-e7bfb0654d87 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:49:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Start _get_guest_xml network_info=[{"id": "da49a9b4-9434-45c8-93cd-e7bfb0654d87", "address": "fa:16:3e:5a:fd:10", "network": {"id": "cb593fff-0bec-4f80-8b28-361a9ca3aa47", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-43873371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e198c124675940d69559cd3ae04644c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda49a9b4-94", "ovs_interfaceid": "da49a9b4-9434-45c8-93cd-e7bfb0654d87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:49:25 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:49:25 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:49:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:49:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:49:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:49:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:49:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:49:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:49:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:49:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:49:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:49:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:49:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:49:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:49:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:49:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:49:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:49:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:49:26 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:49:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1952933349',display_name='tempest-TestServerVolumeAttachmentScenario-server-1952933349',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1952933349',id=17,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIg1CF/1Uk/w+c+EFhwpCueuNR4kL4fpwsqNe9Rcizbzi2wO4DqRZAGnAn9s6Q8iU73g3QYp0c/1K9KVH05HbyZ+9np9IIVcivVP90LQHXw2dt9hFGIzYT0h/SxU2mPYUQ==',key_name='tempest-keypair-528613319',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e198c124675940d69559cd3ae04644c3',ramdisk_id='',reservation_id='r-ubjivh6g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-584784491',owner_user_name='tempest-TestServerVolumeAttachmentScenario-584784491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:49:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86582c54136d4b07bf02392c984e0e02',uuid=a9acd5f6-12e3-488b-b6c6-e4b81f5fc897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da49a9b4-9434-45c8-93cd-e7bfb0654d87", "address": "fa:16:3e:5a:fd:10", "network": {"id": "cb593fff-0bec-4f80-8b28-361a9ca3aa47", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-43873371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e198c124675940d69559cd3ae04644c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda49a9b4-94", "ovs_interfaceid": "da49a9b4-9434-45c8-93cd-e7bfb0654d87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:49:26 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Converting VIF {"id": "da49a9b4-9434-45c8-93cd-e7bfb0654d87", "address": "fa:16:3e:5a:fd:10", "network": {"id": "cb593fff-0bec-4f80-8b28-361a9ca3aa47", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-43873371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e198c124675940d69559cd3ae04644c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda49a9b4-94", "ovs_interfaceid": "da49a9b4-9434-45c8-93cd-e7bfb0654d87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:49:26 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:fd:10,bridge_name='br-int',has_traffic_filtering=True,id=da49a9b4-9434-45c8-93cd-e7bfb0654d87,network=Network(cb593fff-0bec-4f80-8b28-361a9ca3aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda49a9b4-94') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:49:26 user nova-compute[74342]: DEBUG nova.objects.instance [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lazy-loading 'pci_devices' on Instance uuid a9acd5f6-12e3-488b-b6c6-e4b81f5fc897 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:49:26 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:49:26 user nova-compute[74342]:   <uuid>a9acd5f6-12e3-488b-b6c6-e4b81f5fc897</uuid>
Oct 16 09:49:26 user nova-compute[74342]:   <name>instance-00000011</name>
Oct 16 09:49:26 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:49:26 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:49:26 user nova-compute[74342]:   <metadata>
Oct 16 09:49:26 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:49:26 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:49:26 user nova-compute[74342]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1952933349</nova:name>
Oct 16 09:49:26 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:49:25</nova:creationTime>
Oct 16 09:49:26 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:49:26 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:49:26 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:49:26 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:49:26 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:49:26 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:49:26 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:49:26 user nova-compute[74342]:       <nova:owner>
Oct 16 09:49:26 user nova-compute[74342]:         <nova:user uuid="86582c54136d4b07bf02392c984e0e02">tempest-TestServerVolumeAttachmentScenario-584784491-project-member</nova:user>
Oct 16 09:49:26 user nova-compute[74342]:         <nova:project uuid="e198c124675940d69559cd3ae04644c3">tempest-TestServerVolumeAttachmentScenario-584784491</nova:project>
Oct 16 09:49:26 user nova-compute[74342]:       </nova:owner>
Oct 16 09:49:26 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:49:26 user nova-compute[74342]:       <nova:ports>
Oct 16 09:49:26 user nova-compute[74342]:         <nova:port uuid="da49a9b4-9434-45c8-93cd-e7bfb0654d87">
Oct 16 09:49:26 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 09:49:26 user nova-compute[74342]:         </nova:port>
Oct 16 09:49:26 user nova-compute[74342]:       </nova:ports>
Oct 16 09:49:26 user nova-compute[74342]:     </nova:instance>
Oct 16 09:49:26 user nova-compute[74342]:   </metadata>
Oct 16 09:49:26 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:49:26 user nova-compute[74342]:     <system>
Oct 16 09:49:26 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:49:26 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:49:26 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:49:26 user nova-compute[74342]:       <entry name="serial">a9acd5f6-12e3-488b-b6c6-e4b81f5fc897</entry>
Oct 16 09:49:26 user nova-compute[74342]:       <entry name="uuid">a9acd5f6-12e3-488b-b6c6-e4b81f5fc897</entry>
Oct 16 09:49:26 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:49:26 user nova-compute[74342]:     </system>
Oct 16 09:49:26 user nova-compute[74342]:   </sysinfo>
Oct 16 09:49:26 user nova-compute[74342]:   <os>
Oct 16 09:49:26 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:49:26 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:49:26 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:49:26 user nova-compute[74342]:   </os>
Oct 16 09:49:26 user nova-compute[74342]:   <features>
Oct 16 09:49:26 user nova-compute[74342]:     <acpi/>
Oct 16 09:49:26 user nova-compute[74342]:     <apic/>
Oct 16 09:49:26 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:49:26 user nova-compute[74342]:   </features>
Oct 16 09:49:26 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:49:26 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:49:26 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:49:26 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:49:26 user nova-compute[74342]:   </clock>
Oct 16 09:49:26 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:49:26 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:49:26 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:49:26 user nova-compute[74342]:   </cpu>
Oct 16 09:49:26 user nova-compute[74342]:   <devices>
Oct 16 09:49:26 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 09:49:26 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 09:49:26 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/a9acd5f6-12e3-488b-b6c6-e4b81f5fc897/disk"/>
Oct 16 09:49:26 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:49:26 user nova-compute[74342]:     </disk>
Oct 16 09:49:26 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:49:26 user nova-compute[74342]:       <mac address="fa:16:3e:5a:fd:10"/>
Oct 16 09:49:26 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:49:26 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:49:26 user nova-compute[74342]:       <target dev="tapda49a9b4-94"/>
Oct 16 09:49:26 user nova-compute[74342]:     </interface>
Oct 16 09:49:26 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:49:26 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/a9acd5f6-12e3-488b-b6c6-e4b81f5fc897/console.log" append="off"/>
Oct 16 09:49:26 user nova-compute[74342]:     </serial>
Oct 16 09:49:26 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:49:26 user nova-compute[74342]:     <video>
Oct 16 09:49:26 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:49:26 user nova-compute[74342]:     </video>
Oct 16 09:49:26 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:49:26 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:49:26 user nova-compute[74342]:     </rng>
Oct 16 09:49:26 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:49:26 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:49:26 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:49:26 user nova-compute[74342]:     </memballoon>
Oct 16 09:49:26 user nova-compute[74342]:   </devices>
Oct 16 09:49:26 user nova-compute[74342]: </domain>
Oct 16 09:49:26 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:49:26 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:49:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1952933349',display_name='tempest-TestServerVolumeAttachmentScenario-server-1952933349',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1952933349',id=17,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIg1CF/1Uk/w+c+EFhwpCueuNR4kL4fpwsqNe9Rcizbzi2wO4DqRZAGnAn9s6Q8iU73g3QYp0c/1K9KVH05HbyZ+9np9IIVcivVP90LQHXw2dt9hFGIzYT0h/SxU2mPYUQ==',key_name='tempest-keypair-528613319',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e198c124675940d69559cd3ae04644c3',ramdisk_id='',reservation_id='r-ubjivh6g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-584784491',owner_user_name='tempest-TestServerVolumeAttachmentScenario-584784491-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:49:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86582c54136d4b07bf02392c984e0e02',uuid=a9acd5f6-12e3-488b-b6c6-e4b81f5fc897,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da49a9b4-9434-45c8-93cd-e7bfb0654d87", "address": "fa:16:3e:5a:fd:10", "network": {"id": "cb593fff-0bec-4f80-8b28-361a9ca3aa47", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-43873371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e198c124675940d69559cd3ae04644c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda49a9b4-94", "ovs_interfaceid": "da49a9b4-9434-45c8-93cd-e7bfb0654d87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:49:26 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Converting VIF {"id": "da49a9b4-9434-45c8-93cd-e7bfb0654d87", "address": "fa:16:3e:5a:fd:10", "network": {"id": "cb593fff-0bec-4f80-8b28-361a9ca3aa47", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-43873371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e198c124675940d69559cd3ae04644c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda49a9b4-94", "ovs_interfaceid": "da49a9b4-9434-45c8-93cd-e7bfb0654d87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:49:26 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:fd:10,bridge_name='br-int',has_traffic_filtering=True,id=da49a9b4-9434-45c8-93cd-e7bfb0654d87,network=Network(cb593fff-0bec-4f80-8b28-361a9ca3aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda49a9b4-94') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:49:26 user nova-compute[74342]: DEBUG os_vif [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:fd:10,bridge_name='br-int',has_traffic_filtering=True,id=da49a9b4-9434-45c8-93cd-e7bfb0654d87,network=Network(cb593fff-0bec-4f80-8b28-361a9ca3aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda49a9b4-94') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:49:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:49:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:49:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7c01ee75-39fe-58cc-9a79-ff3d2e6eff7f', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:49:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:49:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda49a9b4-94, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:49:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapda49a9b4-94, col_values=(('qos', UUID('4a130598-1ad6-4e41-8eec-06806970f9a6')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:49:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapda49a9b4-94, col_values=(('external_ids', {'iface-id': 'da49a9b4-9434-45c8-93cd-e7bfb0654d87', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:fd:10', 'vm-uuid': 'a9acd5f6-12e3-488b-b6c6-e4b81f5fc897'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:49:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:49:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:26 user nova-compute[74342]: INFO os_vif [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:fd:10,bridge_name='br-int',has_traffic_filtering=True,id=da49a9b4-9434-45c8-93cd-e7bfb0654d87,network=Network(cb593fff-0bec-4f80-8b28-361a9ca3aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda49a9b4-94')
Oct 16 09:49:26 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:49:26 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] No VIF found with MAC fa:16:3e:5a:fd:10, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:49:26 user nova-compute[74342]: DEBUG nova.network.neutron [req-07948849-d3b3-4e3b-bd12-deb0db71ea1d req-4111cfb0-0ec5-42d9-8b06-4886cd4cff30 service nova] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Updated VIF entry in instance network info cache for port da49a9b4-9434-45c8-93cd-e7bfb0654d87. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:49:26 user nova-compute[74342]: DEBUG nova.network.neutron [req-07948849-d3b3-4e3b-bd12-deb0db71ea1d req-4111cfb0-0ec5-42d9-8b06-4886cd4cff30 service nova] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Updating instance_info_cache with network_info: [{"id": "da49a9b4-9434-45c8-93cd-e7bfb0654d87", "address": "fa:16:3e:5a:fd:10", "network": {"id": "cb593fff-0bec-4f80-8b28-361a9ca3aa47", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-43873371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e198c124675940d69559cd3ae04644c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda49a9b4-94", "ovs_interfaceid": "da49a9b4-9434-45c8-93cd-e7bfb0654d87", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:49:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-07948849-d3b3-4e3b-bd12-deb0db71ea1d req-4111cfb0-0ec5-42d9-8b06-4886cd4cff30 service nova] Releasing lock "refresh_cache-a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:49:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:27 user nova-compute[74342]: DEBUG nova.compute.manager [req-854c6eff-0b00-4f01-b2ef-e7baac325717 req-fcc01cdf-0dcb-4506-92ed-8bca12b1596a service nova] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Received event network-vif-plugged-da49a9b4-9434-45c8-93cd-e7bfb0654d87 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:49:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-854c6eff-0b00-4f01-b2ef-e7baac325717 req-fcc01cdf-0dcb-4506-92ed-8bca12b1596a service nova] Acquiring lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-854c6eff-0b00-4f01-b2ef-e7baac325717 req-fcc01cdf-0dcb-4506-92ed-8bca12b1596a service nova] Lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-854c6eff-0b00-4f01-b2ef-e7baac325717 req-fcc01cdf-0dcb-4506-92ed-8bca12b1596a service nova] Lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:27 user nova-compute[74342]: DEBUG nova.compute.manager [req-854c6eff-0b00-4f01-b2ef-e7baac325717 req-fcc01cdf-0dcb-4506-92ed-8bca12b1596a service nova] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] No waiting events found dispatching network-vif-plugged-da49a9b4-9434-45c8-93cd-e7bfb0654d87 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:49:27 user nova-compute[74342]: WARNING nova.compute.manager [req-854c6eff-0b00-4f01-b2ef-e7baac325717 req-fcc01cdf-0dcb-4506-92ed-8bca12b1596a service nova] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Received unexpected event network-vif-plugged-da49a9b4-9434-45c8-93cd-e7bfb0654d87 for instance with vm_state building and task_state spawning.
Oct 16 09:49:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:29 user nova-compute[74342]: DEBUG nova.compute.manager [req-5f11c275-005b-4c5f-8f24-d729f2897afa req-e4234f14-a9fc-4419-909f-f2eb37a9c457 service nova] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Received event network-vif-plugged-da49a9b4-9434-45c8-93cd-e7bfb0654d87 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:49:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5f11c275-005b-4c5f-8f24-d729f2897afa req-e4234f14-a9fc-4419-909f-f2eb37a9c457 service nova] Acquiring lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5f11c275-005b-4c5f-8f24-d729f2897afa req-e4234f14-a9fc-4419-909f-f2eb37a9c457 service nova] Lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5f11c275-005b-4c5f-8f24-d729f2897afa req-e4234f14-a9fc-4419-909f-f2eb37a9c457 service nova] Lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:29 user nova-compute[74342]: DEBUG nova.compute.manager [req-5f11c275-005b-4c5f-8f24-d729f2897afa req-e4234f14-a9fc-4419-909f-f2eb37a9c457 service nova] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] No waiting events found dispatching network-vif-plugged-da49a9b4-9434-45c8-93cd-e7bfb0654d87 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:49:29 user nova-compute[74342]: WARNING nova.compute.manager [req-5f11c275-005b-4c5f-8f24-d729f2897afa req-e4234f14-a9fc-4419-909f-f2eb37a9c457 service nova] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Received unexpected event network-vif-plugged-da49a9b4-9434-45c8-93cd-e7bfb0654d87 for instance with vm_state building and task_state spawning.
Oct 16 09:49:30 user nova-compute[74342]: DEBUG nova.compute.manager [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:49:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:49:30 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Instance spawned successfully.
Oct 16 09:49:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:49:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:49:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:49:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:49:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:49:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:49:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:49:30 user nova-compute[74342]: INFO nova.compute.manager [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Took 6.65 seconds to spawn the instance on the hypervisor.
Oct 16 09:49:30 user nova-compute[74342]: DEBUG nova.compute.manager [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:49:30 user nova-compute[74342]: INFO nova.compute.manager [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Took 7.80 seconds to build instance.
Oct 16 09:49:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7db894bf-5bd8-4ffe-a9fd-44243d3fe7de tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.957s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:33 user nova-compute[74342]: DEBUG nova.compute.manager [req-baf248e9-f1a7-4a83-baba-175e484163ba req-dba9af11-ad61-4700-9579-9c0203c3786b service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Received event network-changed-951f9dec-9a54-4fca-a7d4-c0044b873dbf {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:49:33 user nova-compute[74342]: DEBUG nova.compute.manager [req-baf248e9-f1a7-4a83-baba-175e484163ba req-dba9af11-ad61-4700-9579-9c0203c3786b service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Refreshing instance network info cache due to event network-changed-951f9dec-9a54-4fca-a7d4-c0044b873dbf. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:49:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-baf248e9-f1a7-4a83-baba-175e484163ba req-dba9af11-ad61-4700-9579-9c0203c3786b service nova] Acquiring lock "refresh_cache-5dc86029-dcbf-4886-bdc9-7d4413059c96" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:49:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-baf248e9-f1a7-4a83-baba-175e484163ba req-dba9af11-ad61-4700-9579-9c0203c3786b service nova] Acquired lock "refresh_cache-5dc86029-dcbf-4886-bdc9-7d4413059c96" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:49:33 user nova-compute[74342]: DEBUG nova.network.neutron [req-baf248e9-f1a7-4a83-baba-175e484163ba req-dba9af11-ad61-4700-9579-9c0203c3786b service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Refreshing network info cache for port 951f9dec-9a54-4fca-a7d4-c0044b873dbf {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:49:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "5dc86029-dcbf-4886-bdc9-7d4413059c96" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "5dc86029-dcbf-4886-bdc9-7d4413059c96" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:34 user nova-compute[74342]: DEBUG nova.objects.instance [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lazy-loading 'flavor' on Instance uuid 5dc86029-dcbf-4886-bdc9-7d4413059c96 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:49:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "5dc86029-dcbf-4886-bdc9-7d4413059c96" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:34 user nova-compute[74342]: DEBUG nova.network.neutron [req-baf248e9-f1a7-4a83-baba-175e484163ba req-dba9af11-ad61-4700-9579-9c0203c3786b service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Updated VIF entry in instance network info cache for port 951f9dec-9a54-4fca-a7d4-c0044b873dbf. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:49:34 user nova-compute[74342]: DEBUG nova.network.neutron [req-baf248e9-f1a7-4a83-baba-175e484163ba req-dba9af11-ad61-4700-9579-9c0203c3786b service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Updating instance_info_cache with network_info: [{"id": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "address": "fa:16:3e:72:e1:f9", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951f9dec-9a", "ovs_interfaceid": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:49:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-baf248e9-f1a7-4a83-baba-175e484163ba req-dba9af11-ad61-4700-9579-9c0203c3786b service nova] Releasing lock "refresh_cache-5dc86029-dcbf-4886-bdc9-7d4413059c96" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:49:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "5dc86029-dcbf-4886-bdc9-7d4413059c96" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "5dc86029-dcbf-4886-bdc9-7d4413059c96" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:34 user nova-compute[74342]: INFO nova.compute.manager [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Attaching volume c8c6991f-abcd-4da9-b892-764e07129192 to /dev/vdb
Oct 16 09:49:34 user nova-compute[74342]: DEBUG os_brick.utils [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:49:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6827d99b-bcad-444e-bc20-49f49f4e8ca7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:49:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.025s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d585153-b027-44f3-8a20-0d7d61b2fef1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:49:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.034s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b53ed6-4a55-46cc-8d45-619787e22ff3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:49:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a85af79-976b-429d-9233-b848321f708f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:49:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:49:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:49:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:49:34 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:49:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e027be-5650-43dc-a5fe-7532f0b0a147]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:49:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:49:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:49:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:49:34 user nova-compute[74342]: DEBUG os_brick.utils [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] <== get_connector_properties: return (236ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:49:34 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Updating existing volume attachment record: 264a2983-b90c-41e1-a339-b22341110753 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 09:49:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:38 user nova-compute[74342]: DEBUG nova.compute.manager [None req-262929f7-8162-48a6-8802-92573a95ac26 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:49:38 user nova-compute[74342]: INFO nova.compute.manager [None req-262929f7-8162-48a6-8802-92573a95ac26 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] instance snapshotting
Oct 16 09:49:38 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-262929f7-8162-48a6-8802-92573a95ac26 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Beginning live snapshot process
Oct 16 09:49:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-262929f7-8162-48a6-8802-92573a95ac26 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json -f qcow2 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-262929f7-8162-48a6-8802-92573a95ac26 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json -f qcow2" returned: 0 in 0.304s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-262929f7-8162-48a6-8802-92573a95ac26 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json -f qcow2 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-262929f7-8162-48a6-8802-92573a95ac26 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json -f qcow2" returned: 0 in 0.228s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-262929f7-8162-48a6-8802-92573a95ac26 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-262929f7-8162-48a6-8802-92573a95ac26 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.195s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-262929f7-8162-48a6-8802-92573a95ac26 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6d8fi2zr/fe50249136f84f258d226236ca2397e4.delta 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-262929f7-8162-48a6-8802-92573a95ac26 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp6d8fi2zr/fe50249136f84f258d226236ca2397e4.delta 1073741824" returned: 0 in 0.069s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:39 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-262929f7-8162-48a6-8802-92573a95ac26 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 16 09:49:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-262929f7-8162-48a6-8802-92573a95ac26 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=74342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 09:49:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-262929f7-8162-48a6-8802-92573a95ac26 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=74342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 09:49:40 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-262929f7-8162-48a6-8802-92573a95ac26 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 16 09:49:40 user nova-compute[74342]: DEBUG nova.privsep.utils [None req-262929f7-8162-48a6-8802-92573a95ac26 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 09:49:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-262929f7-8162-48a6-8802-92573a95ac26 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6d8fi2zr/fe50249136f84f258d226236ca2397e4.delta /opt/stack/data/nova/instances/snapshots/tmp6d8fi2zr/fe50249136f84f258d226236ca2397e4 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-262929f7-8162-48a6-8802-92573a95ac26 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp6d8fi2zr/fe50249136f84f258d226236ca2397e4.delta /opt/stack/data/nova/instances/snapshots/tmp6d8fi2zr/fe50249136f84f258d226236ca2397e4" returned: 0 in 0.653s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:41 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-262929f7-8162-48a6-8802-92573a95ac26 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Snapshot extracted, beginning image upload
Oct 16 09:49:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Acquiring lock "f3c66abd-af75-4b48-9e29-ab4335f229f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "f3c66abd-af75-4b48-9e29-ab4335f229f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:43 user nova-compute[74342]: DEBUG nova.compute.manager [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:49:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:43 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:49:43 user nova-compute[74342]: INFO nova.compute.claims [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Claim successful on node user
Oct 16 09:49:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:43 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:49:44 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:49:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.685s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:44 user nova-compute[74342]: DEBUG nova.compute.manager [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:49:44 user nova-compute[74342]: DEBUG nova.compute.manager [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:49:44 user nova-compute[74342]: DEBUG nova.network.neutron [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:49:44 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:49:44 user nova-compute[74342]: DEBUG nova.compute.manager [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:49:44 user nova-compute[74342]: DEBUG nova.policy [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '353ec67aa4b84aa7b6992ccb49423ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afd0e8f0d424fe393636bbcd26eed42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:49:44 user nova-compute[74342]: DEBUG nova.compute.manager [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 09:49:44 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:49:44 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Creating image(s)
Oct 16 09:49:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Acquiring lock "/opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "/opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "/opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.218s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.189s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk 1073741824" returned: 0 in 0.087s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:45 user nova-compute[74342]: DEBUG nova.network.neutron [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Successfully created port: 725894e9-c57a-469c-a85c-d5d9aabb805a {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:49:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.212s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:45 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 09:49:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:45 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-262929f7-8162-48a6-8802-92573a95ac26 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Snapshot image upload complete
Oct 16 09:49:45 user nova-compute[74342]: INFO nova.compute.manager [None req-262929f7-8162-48a6-8802-92573a95ac26 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Took 6.98 seconds to snapshot the instance on the hypervisor.
Oct 16 09:49:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:45 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Cannot resize image /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 09:49:45 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 09:49:45 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Ensure instance console log exists: /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:49:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:45 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:49:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:45 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 09:49:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:45 user nova-compute[74342]: DEBUG nova.network.neutron [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Successfully updated port: 725894e9-c57a-469c-a85c-d5d9aabb805a {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.compute.manager [req-06cef71f-1f31-4b3a-8ce7-26594297d282 req-bfc44906-9c97-41f7-9b95-2457784f26b8 service nova] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Received event network-changed-725894e9-c57a-469c-a85c-d5d9aabb805a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.compute.manager [req-06cef71f-1f31-4b3a-8ce7-26594297d282 req-bfc44906-9c97-41f7-9b95-2457784f26b8 service nova] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Refreshing instance network info cache due to event network-changed-725894e9-c57a-469c-a85c-d5d9aabb805a. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-06cef71f-1f31-4b3a-8ce7-26594297d282 req-bfc44906-9c97-41f7-9b95-2457784f26b8 service nova] Acquiring lock "refresh_cache-f3c66abd-af75-4b48-9e29-ab4335f229f3" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-06cef71f-1f31-4b3a-8ce7-26594297d282 req-bfc44906-9c97-41f7-9b95-2457784f26b8 service nova] Acquired lock "refresh_cache-f3c66abd-af75-4b48-9e29-ab4335f229f3" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.network.neutron [req-06cef71f-1f31-4b3a-8ce7-26594297d282 req-bfc44906-9c97-41f7-9b95-2457784f26b8 service nova] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Refreshing network info cache for port 725894e9-c57a-469c-a85c-d5d9aabb805a {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Acquiring lock "refresh_cache-f3c66abd-af75-4b48-9e29-ab4335f229f3" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.network.neutron [req-06cef71f-1f31-4b3a-8ce7-26594297d282 req-bfc44906-9c97-41f7-9b95-2457784f26b8 service nova] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.network.neutron [req-06cef71f-1f31-4b3a-8ce7-26594297d282 req-bfc44906-9c97-41f7-9b95-2457784f26b8 service nova] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-06cef71f-1f31-4b3a-8ce7-26594297d282 req-bfc44906-9c97-41f7-9b95-2457784f26b8 service nova] Releasing lock "refresh_cache-f3c66abd-af75-4b48-9e29-ab4335f229f3" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Acquired lock "refresh_cache-f3c66abd-af75-4b48-9e29-ab4335f229f3" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.network.neutron [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.network.neutron [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9acd5f6-12e3-488b-b6c6-e4b81f5fc897/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9acd5f6-12e3-488b-b6c6-e4b81f5fc897/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9acd5f6-12e3-488b-b6c6-e4b81f5fc897/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.network.neutron [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Updating instance_info_cache with network_info: [{"id": "725894e9-c57a-469c-a85c-d5d9aabb805a", "address": "fa:16:3e:fe:a5:67", "network": {"id": "7bc80f1e-0315-4a4e-bc89-2ad397451db6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1430189260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afd0e8f0d424fe393636bbcd26eed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725894e9-c5", "ovs_interfaceid": "725894e9-c57a-469c-a85c-d5d9aabb805a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Releasing lock "refresh_cache-f3c66abd-af75-4b48-9e29-ab4335f229f3" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.compute.manager [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Instance network_info: |[{"id": "725894e9-c57a-469c-a85c-d5d9aabb805a", "address": "fa:16:3e:fe:a5:67", "network": {"id": "7bc80f1e-0315-4a4e-bc89-2ad397451db6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1430189260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afd0e8f0d424fe393636bbcd26eed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725894e9-c5", "ovs_interfaceid": "725894e9-c57a-469c-a85c-d5d9aabb805a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Start _get_guest_xml network_info=[{"id": "725894e9-c57a-469c-a85c-d5d9aabb805a", "address": "fa:16:3e:fe:a5:67", "network": {"id": "7bc80f1e-0315-4a4e-bc89-2ad397451db6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1430189260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afd0e8f0d424fe393636bbcd26eed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725894e9-c5", "ovs_interfaceid": "725894e9-c57a-469c-a85c-d5d9aabb805a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:49:46 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:49:46 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1069689818',display_name='tempest-VolumesAdminNegativeTest-server-1069689818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1069689818',id=18,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8qEW/jc08xg0yK/anKoEas78/uRRjXPMs3J1Q2CdtZlqJBxAA+P75HNk4yvkINeaJbOJj1wIW2t5agPb4AjO5k/RwFj1UGwSZX9fk8rt3keM9RTNlE203GHNK5oC6tVw==',key_name='tempest-keypair-1462511116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0afd0e8f0d424fe393636bbcd26eed42',ramdisk_id='',reservation_id='r-mr0en132',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1903882113',owner_user_name='tempest-VolumesAdminNegativeTest-1903882113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:49:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='353ec67aa4b84aa7b6992ccb49423ca6',uuid=f3c66abd-af75-4b48-9e29-ab4335f229f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "725894e9-c57a-469c-a85c-d5d9aabb805a", "address": "fa:16:3e:fe:a5:67", "network": {"id": "7bc80f1e-0315-4a4e-bc89-2ad397451db6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1430189260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afd0e8f0d424fe393636bbcd26eed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725894e9-c5", "ovs_interfaceid": "725894e9-c57a-469c-a85c-d5d9aabb805a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Converting VIF {"id": "725894e9-c57a-469c-a85c-d5d9aabb805a", "address": "fa:16:3e:fe:a5:67", "network": {"id": "7bc80f1e-0315-4a4e-bc89-2ad397451db6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1430189260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afd0e8f0d424fe393636bbcd26eed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725894e9-c5", "ovs_interfaceid": "725894e9-c57a-469c-a85c-d5d9aabb805a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a5:67,bridge_name='br-int',has_traffic_filtering=True,id=725894e9-c57a-469c-a85c-d5d9aabb805a,network=Network(7bc80f1e-0315-4a4e-bc89-2ad397451db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725894e9-c5') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.objects.instance [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lazy-loading 'pci_devices' on Instance uuid f3c66abd-af75-4b48-9e29-ab4335f229f3 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:49:46 user nova-compute[74342]:   <uuid>f3c66abd-af75-4b48-9e29-ab4335f229f3</uuid>
Oct 16 09:49:46 user nova-compute[74342]:   <name>instance-00000012</name>
Oct 16 09:49:46 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:49:46 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:49:46 user nova-compute[74342]:   <metadata>
Oct 16 09:49:46 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:49:46 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:49:46 user nova-compute[74342]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1069689818</nova:name>
Oct 16 09:49:46 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:49:46</nova:creationTime>
Oct 16 09:49:46 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:49:46 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:49:46 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:49:46 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:49:46 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:49:46 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:49:46 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:49:46 user nova-compute[74342]:       <nova:owner>
Oct 16 09:49:46 user nova-compute[74342]:         <nova:user uuid="353ec67aa4b84aa7b6992ccb49423ca6">tempest-VolumesAdminNegativeTest-1903882113-project-member</nova:user>
Oct 16 09:49:46 user nova-compute[74342]:         <nova:project uuid="0afd0e8f0d424fe393636bbcd26eed42">tempest-VolumesAdminNegativeTest-1903882113</nova:project>
Oct 16 09:49:46 user nova-compute[74342]:       </nova:owner>
Oct 16 09:49:46 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:49:46 user nova-compute[74342]:       <nova:ports>
Oct 16 09:49:46 user nova-compute[74342]:         <nova:port uuid="725894e9-c57a-469c-a85c-d5d9aabb805a">
Oct 16 09:49:46 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 16 09:49:46 user nova-compute[74342]:         </nova:port>
Oct 16 09:49:46 user nova-compute[74342]:       </nova:ports>
Oct 16 09:49:46 user nova-compute[74342]:     </nova:instance>
Oct 16 09:49:46 user nova-compute[74342]:   </metadata>
Oct 16 09:49:46 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:49:46 user nova-compute[74342]:     <system>
Oct 16 09:49:46 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:49:46 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:49:46 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:49:46 user nova-compute[74342]:       <entry name="serial">f3c66abd-af75-4b48-9e29-ab4335f229f3</entry>
Oct 16 09:49:46 user nova-compute[74342]:       <entry name="uuid">f3c66abd-af75-4b48-9e29-ab4335f229f3</entry>
Oct 16 09:49:46 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:49:46 user nova-compute[74342]:     </system>
Oct 16 09:49:46 user nova-compute[74342]:   </sysinfo>
Oct 16 09:49:46 user nova-compute[74342]:   <os>
Oct 16 09:49:46 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:49:46 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:49:46 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:49:46 user nova-compute[74342]:   </os>
Oct 16 09:49:46 user nova-compute[74342]:   <features>
Oct 16 09:49:46 user nova-compute[74342]:     <acpi/>
Oct 16 09:49:46 user nova-compute[74342]:     <apic/>
Oct 16 09:49:46 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:49:46 user nova-compute[74342]:   </features>
Oct 16 09:49:46 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:49:46 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:49:46 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:49:46 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:49:46 user nova-compute[74342]:   </clock>
Oct 16 09:49:46 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:49:46 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:49:46 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:49:46 user nova-compute[74342]:   </cpu>
Oct 16 09:49:46 user nova-compute[74342]:   <devices>
Oct 16 09:49:46 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 09:49:46 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 09:49:46 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk"/>
Oct 16 09:49:46 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:49:46 user nova-compute[74342]:     </disk>
Oct 16 09:49:46 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:49:46 user nova-compute[74342]:       <mac address="fa:16:3e:fe:a5:67"/>
Oct 16 09:49:46 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:49:46 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:49:46 user nova-compute[74342]:       <target dev="tap725894e9-c5"/>
Oct 16 09:49:46 user nova-compute[74342]:     </interface>
Oct 16 09:49:46 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:49:46 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/console.log" append="off"/>
Oct 16 09:49:46 user nova-compute[74342]:     </serial>
Oct 16 09:49:46 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:49:46 user nova-compute[74342]:     <video>
Oct 16 09:49:46 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:49:46 user nova-compute[74342]:     </video>
Oct 16 09:49:46 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:49:46 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:49:46 user nova-compute[74342]:     </rng>
Oct 16 09:49:46 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:49:46 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:49:46 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:49:46 user nova-compute[74342]:     </memballoon>
Oct 16 09:49:46 user nova-compute[74342]:   </devices>
Oct 16 09:49:46 user nova-compute[74342]: </domain>
Oct 16 09:49:46 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1069689818',display_name='tempest-VolumesAdminNegativeTest-server-1069689818',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1069689818',id=18,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8qEW/jc08xg0yK/anKoEas78/uRRjXPMs3J1Q2CdtZlqJBxAA+P75HNk4yvkINeaJbOJj1wIW2t5agPb4AjO5k/RwFj1UGwSZX9fk8rt3keM9RTNlE203GHNK5oC6tVw==',key_name='tempest-keypair-1462511116',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0afd0e8f0d424fe393636bbcd26eed42',ramdisk_id='',reservation_id='r-mr0en132',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1903882113',owner_user_name='tempest-VolumesAdminNegativeTest-1903882113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:49:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='353ec67aa4b84aa7b6992ccb49423ca6',uuid=f3c66abd-af75-4b48-9e29-ab4335f229f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "725894e9-c57a-469c-a85c-d5d9aabb805a", "address": "fa:16:3e:fe:a5:67", "network": {"id": "7bc80f1e-0315-4a4e-bc89-2ad397451db6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1430189260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afd0e8f0d424fe393636bbcd26eed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725894e9-c5", "ovs_interfaceid": "725894e9-c57a-469c-a85c-d5d9aabb805a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Converting VIF {"id": "725894e9-c57a-469c-a85c-d5d9aabb805a", "address": "fa:16:3e:fe:a5:67", "network": {"id": "7bc80f1e-0315-4a4e-bc89-2ad397451db6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1430189260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afd0e8f0d424fe393636bbcd26eed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725894e9-c5", "ovs_interfaceid": "725894e9-c57a-469c-a85c-d5d9aabb805a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a5:67,bridge_name='br-int',has_traffic_filtering=True,id=725894e9-c57a-469c-a85c-d5d9aabb805a,network=Network(7bc80f1e-0315-4a4e-bc89-2ad397451db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725894e9-c5') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG os_vif [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a5:67,bridge_name='br-int',has_traffic_filtering=True,id=725894e9-c57a-469c-a85c-d5d9aabb805a,network=Network(7bc80f1e-0315-4a4e-bc89-2ad397451db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725894e9-c5') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '09205d25-e770-5030-9aa8-eb0038a26848', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap725894e9-c5, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap725894e9-c5, col_values=(('qos', UUID('f98fff2e-5108-4b28-b16e-ce8e2f0d818d')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap725894e9-c5, col_values=(('external_ids', {'iface-id': '725894e9-c57a-469c-a85c-d5d9aabb805a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fe:a5:67', 'vm-uuid': 'f3c66abd-af75-4b48-9e29-ab4335f229f3'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:46 user nova-compute[74342]: INFO os_vif [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fe:a5:67,bridge_name='br-int',has_traffic_filtering=True,id=725894e9-c57a-469c-a85c-d5d9aabb805a,network=Network(7bc80f1e-0315-4a4e-bc89-2ad397451db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725894e9-c5')
Oct 16 09:49:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9acd5f6-12e3-488b-b6c6-e4b81f5fc897/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:49:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] No VIF found with MAC fa:16:3e:fe:a5:67, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:49:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:48 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:49:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk.rescue --force-share --output=json" returned: 0 in 0.209s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:48 user nova-compute[74342]: DEBUG nova.compute.manager [req-dc3d65fa-891b-482d-a16c-e73327054a1f req-91b5612e-1bf1-400b-acc0-6fc36cf9fa88 service nova] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Received event network-vif-plugged-725894e9-c57a-469c-a85c-d5d9aabb805a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:49:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-dc3d65fa-891b-482d-a16c-e73327054a1f req-91b5612e-1bf1-400b-acc0-6fc36cf9fa88 service nova] Acquiring lock "f3c66abd-af75-4b48-9e29-ab4335f229f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-dc3d65fa-891b-482d-a16c-e73327054a1f req-91b5612e-1bf1-400b-acc0-6fc36cf9fa88 service nova] Lock "f3c66abd-af75-4b48-9e29-ab4335f229f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-dc3d65fa-891b-482d-a16c-e73327054a1f req-91b5612e-1bf1-400b-acc0-6fc36cf9fa88 service nova] Lock "f3c66abd-af75-4b48-9e29-ab4335f229f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:48 user nova-compute[74342]: DEBUG nova.compute.manager [req-dc3d65fa-891b-482d-a16c-e73327054a1f req-91b5612e-1bf1-400b-acc0-6fc36cf9fa88 service nova] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] No waiting events found dispatching network-vif-plugged-725894e9-c57a-469c-a85c-d5d9aabb805a {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:49:48 user nova-compute[74342]: WARNING nova.compute.manager [req-dc3d65fa-891b-482d-a16c-e73327054a1f req-91b5612e-1bf1-400b-acc0-6fc36cf9fa88 service nova] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Received unexpected event network-vif-plugged-725894e9-c57a-469c-a85c-d5d9aabb805a for instance with vm_state building and task_state spawning.
Oct 16 09:49:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.compute.manager [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.compute.manager [req-839fce83-96d0-485e-85a9-07c3435d37b7 req-ea05a7b4-936b-4816-aa52-2b4b724ee65b service nova] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Received event network-vif-plugged-725894e9-c57a-469c-a85c-d5d9aabb805a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-839fce83-96d0-485e-85a9-07c3435d37b7 req-ea05a7b4-936b-4816-aa52-2b4b724ee65b service nova] Acquiring lock "f3c66abd-af75-4b48-9e29-ab4335f229f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-839fce83-96d0-485e-85a9-07c3435d37b7 req-ea05a7b4-936b-4816-aa52-2b4b724ee65b service nova] Lock "f3c66abd-af75-4b48-9e29-ab4335f229f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-839fce83-96d0-485e-85a9-07c3435d37b7 req-ea05a7b4-936b-4816-aa52-2b4b724ee65b service nova] Lock "f3c66abd-af75-4b48-9e29-ab4335f229f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.compute.manager [req-839fce83-96d0-485e-85a9-07c3435d37b7 req-ea05a7b4-936b-4816-aa52-2b4b724ee65b service nova] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] No waiting events found dispatching network-vif-plugged-725894e9-c57a-469c-a85c-d5d9aabb805a {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:49:51 user nova-compute[74342]: WARNING nova.compute.manager [req-839fce83-96d0-485e-85a9-07c3435d37b7 req-ea05a7b4-936b-4816-aa52-2b4b724ee65b service nova] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Received unexpected event network-vif-plugged-725894e9-c57a-469c-a85c-d5d9aabb805a for instance with vm_state building and task_state spawning.
Oct 16 09:49:51 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:49:51 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=7595MB free_disk=25.21697235107422GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:51 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Instance spawned successfully.
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:49:51 user nova-compute[74342]: INFO nova.compute.manager [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Took 7.02 seconds to spawn the instance on the hypervisor.
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.compute.manager [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance d45abd20-3a58-4657-8f4c-a426d8e39be3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 98367a96-22f0-4edb-ab03-a8eb286b437b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance bdcd2e60-b36c-4d87-94d7-076e7430e1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 017caffb-5be2-4e78-ab48-a8091c5c00f4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 5dc86029-dcbf-4886-bdc9-7d4413059c96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance edcefbe0-e89f-4496-9032-f9431d9d5c53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance c5e44d3b-ed41-4920-825f-e1d283caecfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance a9acd5f6-12e3-488b-b6c6-e4b81f5fc897 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance f3c66abd-af75-4b48-9e29-ab4335f229f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 09:49:51 user nova-compute[74342]: INFO nova.compute.manager [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Took 8.20 seconds to build instance.
Oct 16 09:49:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5206602c-7468-4112-9ca3-47da96733806 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "f3c66abd-af75-4b48-9e29-ab4335f229f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.352s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.655s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Cleaning up deleted instances {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] There are 0 instances to clean {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:49:51 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74342) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-59fc10af-a4df-43e3-8e8f-1995b06ad94a tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Acquiring lock "1c0d394c-6e6b-41f6-b6eb-e5d54b82990f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-59fc10af-a4df-43e3-8e8f-1995b06ad94a tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Lock "1c0d394c-6e6b-41f6-b6eb-e5d54b82990f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-59fc10af-a4df-43e3-8e8f-1995b06ad94a tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Acquiring lock "1c0d394c-6e6b-41f6-b6eb-e5d54b82990f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-59fc10af-a4df-43e3-8e8f-1995b06ad94a tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Lock "1c0d394c-6e6b-41f6-b6eb-e5d54b82990f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-59fc10af-a4df-43e3-8e8f-1995b06ad94a tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Lock "1c0d394c-6e6b-41f6-b6eb-e5d54b82990f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:52 user nova-compute[74342]: INFO nova.compute.manager [None req-59fc10af-a4df-43e3-8e8f-1995b06ad94a tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Terminating instance
Oct 16 09:49:52 user nova-compute[74342]: DEBUG nova.compute.manager [None req-59fc10af-a4df-43e3-8e8f-1995b06ad94a tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Rebuilding the list of instances to heal {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Skipping network cache update for instance because it is being deleted. {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9938}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-d45abd20-3a58-4657-8f4c-a426d8e39be3" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-d45abd20-3a58-4657-8f4c-a426d8e39be3" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lazy-loading 'info_cache' on Instance uuid d45abd20-3a58-4657-8f4c-a426d8e39be3 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:49:52 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Instance destroyed successfully.
Oct 16 09:49:52 user nova-compute[74342]: DEBUG nova.objects.instance [None req-59fc10af-a4df-43e3-8e8f-1995b06ad94a tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Lazy-loading 'resources' on Instance uuid 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-59fc10af-a4df-43e3-8e8f-1995b06ad94a tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:44:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1526365471',display_name='tempest-TestVolumeSwap-server-1526365471',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1526365471',id=8,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCkerhSX2ESfi6yIwy3pqF6xZrlFRUGF12oJeq33lLeKQHy8c5rhTkNY8IXsANWd8wE4iLXnUdFod6fG0rtDOmdxB4KiLO13GHeDXbu3yUdDrnraYfYTMRCQ0m8EMPtUag==',key_name='tempest-keypair-193753504',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:44:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='96d85f52140448bca8fa0646bea02d75',ramdisk_id='',reservation_id='r-cu8z3kjp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-346509380',owner_user_name='tempest-TestVolumeSwap-346509380-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:44:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cfac413e4633478b9e524c34d5239d8b',uuid=1c0d394c-6e6b-41f6-b6eb-e5d54b82990f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9", "address": "fa:16:3e:42:54:d6", "network": {"id": "b6011a11-a0a3-40cb-bf20-d1df67f13d18", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1041414891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96d85f52140448bca8fa0646bea02d75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4900a7e6-eb", "ovs_interfaceid": "4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-59fc10af-a4df-43e3-8e8f-1995b06ad94a tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Converting VIF {"id": "4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9", "address": "fa:16:3e:42:54:d6", "network": {"id": "b6011a11-a0a3-40cb-bf20-d1df67f13d18", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1041414891-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "96d85f52140448bca8fa0646bea02d75", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4900a7e6-eb", "ovs_interfaceid": "4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-59fc10af-a4df-43e3-8e8f-1995b06ad94a tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:54:d6,bridge_name='br-int',has_traffic_filtering=True,id=4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9,network=Network(b6011a11-a0a3-40cb-bf20-d1df67f13d18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4900a7e6-eb') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG os_vif [None req-59fc10af-a4df-43e3-8e8f-1995b06ad94a tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:54:d6,bridge_name='br-int',has_traffic_filtering=True,id=4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9,network=Network(b6011a11-a0a3-40cb-bf20-d1df67f13d18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4900a7e6-eb') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4900a7e6-eb, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7864d22a-a4f1-4bb6-8a2a-e7bcf4121de6) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:52 user nova-compute[74342]: INFO os_vif [None req-59fc10af-a4df-43e3-8e8f-1995b06ad94a tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:54:d6,bridge_name='br-int',has_traffic_filtering=True,id=4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9,network=Network(b6011a11-a0a3-40cb-bf20-d1df67f13d18),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4900a7e6-eb')
Oct 16 09:49:52 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-59fc10af-a4df-43e3-8e8f-1995b06ad94a tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Deleting instance files /opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f_del
Oct 16 09:49:52 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-59fc10af-a4df-43e3-8e8f-1995b06ad94a tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Deletion of /opt/stack/data/nova/instances/1c0d394c-6e6b-41f6-b6eb-e5d54b82990f_del complete
Oct 16 09:49:52 user nova-compute[74342]: DEBUG nova.compute.manager [req-1de9fcf8-b01f-4269-b042-d918d6a868ee req-34221d3e-c504-41cb-931d-13afccdac120 service nova] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Received event network-vif-unplugged-4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-1de9fcf8-b01f-4269-b042-d918d6a868ee req-34221d3e-c504-41cb-931d-13afccdac120 service nova] Acquiring lock "1c0d394c-6e6b-41f6-b6eb-e5d54b82990f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-1de9fcf8-b01f-4269-b042-d918d6a868ee req-34221d3e-c504-41cb-931d-13afccdac120 service nova] Lock "1c0d394c-6e6b-41f6-b6eb-e5d54b82990f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-1de9fcf8-b01f-4269-b042-d918d6a868ee req-34221d3e-c504-41cb-931d-13afccdac120 service nova] Lock "1c0d394c-6e6b-41f6-b6eb-e5d54b82990f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG nova.compute.manager [req-1de9fcf8-b01f-4269-b042-d918d6a868ee req-34221d3e-c504-41cb-931d-13afccdac120 service nova] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] No waiting events found dispatching network-vif-unplugged-4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG nova.compute.manager [req-1de9fcf8-b01f-4269-b042-d918d6a868ee req-34221d3e-c504-41cb-931d-13afccdac120 service nova] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Received event network-vif-unplugged-4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9 for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 09:49:52 user nova-compute[74342]: INFO nova.compute.manager [None req-59fc10af-a4df-43e3-8e8f-1995b06ad94a tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Took 0.74 seconds to destroy the instance on the hypervisor.
Oct 16 09:49:52 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-59fc10af-a4df-43e3-8e8f-1995b06ad94a tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 09:49:52 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Updating instance_info_cache with network_info: [{"id": "2e5ec9cf-9b58-47bc-be15-0b896a7625bc", "address": "fa:16:3e:8c:de:8b", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e5ec9cf-9b", "ovs_interfaceid": "2e5ec9cf-9b58-47bc-be15-0b896a7625bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-d45abd20-3a58-4657-8f4c-a426d8e39be3" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAupThgs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:49:53 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:49:53 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:49:53 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:49:53 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:49:53 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 09:49:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb744eb-dcf7-4d92-99f2-b40541f8ac78]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 09:49:53 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bda7d0-dcd4-4cc9-b054-0d221b1fdb63]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192] added
Oct 16 09:49:53 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1035c3d-3683-4ad3-a141-aef63f48738c]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1fcb48-0e92-4617-8a05-4372d62e37f4]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tAupThgs {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tAupThgs" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6b971e9-40a5-40d3-bcf6-90a4b5cc42ba]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tAupThgs'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b03951-b7ec-4c7c-93f5-791a6087118b]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f673a205-4052-4fe6-a94d-91ca6f6bb7bd]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc (non-flash)
Oct 16 09:49:53 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc (non-flash)
Oct 16 09:49:53 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:49:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:54 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fa0490-281f-4efc-8d8a-792778d6990c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:49:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192, portal: 172.16.0.220,3260]
Oct 16 09:49:54 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192, portal: 172.16.0.220,3260] successful.
Oct 16 09:49:54 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:49:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:54 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c28603-bfe6-426b-b54a-5015a5b99cea]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:49:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:49:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:54 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfeeb76b-2e93-4b87-ab86-75f46530a0d9]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:49:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc (non-flash)
Oct 16 09:49:54 user nova-compute[74342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:49:54 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:49:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc (non-flash)
Oct 16 09:49:54 user nova-compute[74342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:49:54 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:49:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.285s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:49:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 09:49:54 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] HCTL ('34', '-', '-', 0) found on session 8 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 09:49:54 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 09:49:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:54 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebe948e-4f26-4970-b91e-dc7ffb26f113]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:49:54 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Searching for a device in session 8 and hctl ['34', '*', '*', 0] yield: None {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:49:54 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:49:54 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Took 1.40 seconds to deallocate network for instance.
Oct 16 09:49:54 user nova-compute[74342]: DEBUG nova.compute.manager [req-d516a75a-2d57-427a-9ba3-47c07b016baa req-7d0910fc-d098-498f-bbc8-9bbfc60f00f0 service nova] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Received event network-vif-deleted-4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:49:54 user nova-compute[74342]: INFO nova.compute.manager [req-d516a75a-2d57-427a-9ba3-47c07b016baa req-7d0910fc-d098-498f-bbc8-9bbfc60f00f0 service nova] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Neutron deleted interface 4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9; detaching it from the instance and deleting it from the info cache
Oct 16 09:49:54 user nova-compute[74342]: DEBUG nova.network.neutron [req-d516a75a-2d57-427a-9ba3-47c07b016baa req-7d0910fc-d098-498f-bbc8-9bbfc60f00f0 service nova] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:49:54 user nova-compute[74342]: DEBUG nova.compute.manager [req-d516a75a-2d57-427a-9ba3-47c07b016baa req-7d0910fc-d098-498f-bbc8-9bbfc60f00f0 service nova] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Detach interface failed, port_id=4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9, reason: Instance 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f could not be found. {{(pid=74342) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 09:49:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-59fc10af-a4df-43e3-8e8f-1995b06ad94a tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-59fc10af-a4df-43e3-8e8f-1995b06ad94a tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:55 user nova-compute[74342]: DEBUG nova.compute.manager [req-7fd0172f-6b72-4ead-94e0-eb528e4cf02f req-a1d14e78-b634-49bb-a43b-e53f497a2c7b service nova] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Received event network-vif-plugged-4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:49:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-7fd0172f-6b72-4ead-94e0-eb528e4cf02f req-a1d14e78-b634-49bb-a43b-e53f497a2c7b service nova] Acquiring lock "1c0d394c-6e6b-41f6-b6eb-e5d54b82990f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-7fd0172f-6b72-4ead-94e0-eb528e4cf02f req-a1d14e78-b634-49bb-a43b-e53f497a2c7b service nova] Lock "1c0d394c-6e6b-41f6-b6eb-e5d54b82990f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-7fd0172f-6b72-4ead-94e0-eb528e4cf02f req-a1d14e78-b634-49bb-a43b-e53f497a2c7b service nova] Lock "1c0d394c-6e6b-41f6-b6eb-e5d54b82990f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:55 user nova-compute[74342]: DEBUG nova.compute.manager [req-7fd0172f-6b72-4ead-94e0-eb528e4cf02f req-a1d14e78-b634-49bb-a43b-e53f497a2c7b service nova] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] No waiting events found dispatching network-vif-plugged-4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:49:55 user nova-compute[74342]: WARNING nova.compute.manager [req-7fd0172f-6b72-4ead-94e0-eb528e4cf02f req-a1d14e78-b634-49bb-a43b-e53f497a2c7b service nova] [instance: 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f] Received unexpected event network-vif-plugged-4900a7e6-ebaf-4b7e-b244-9ba4f926c1e9 for instance with vm_state deleted and task_state None.
Oct 16 09:49:55 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Searching for a device in session 8 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:49:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAupThgs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 09:49:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:49:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '23432646266353761', 'path': '/dev/sdc'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:49:55 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432646266353761', 'path': '/dev/sdc'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 09:49:55 user nova-compute[74342]: DEBUG nova.objects.instance [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lazy-loading 'flavor' on Instance uuid 5dc86029-dcbf-4886-bdc9-7d4413059c96 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:49:55 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 09:49:55 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:49:55 user nova-compute[74342]:   <source dev="/dev/sdc"/>
Oct 16 09:49:55 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:49:55 user nova-compute[74342]:   <serial>c8c6991f-abcd-4da9-b892-764e07129192</serial>
Oct 16 09:49:55 user nova-compute[74342]: </disk>
Oct 16 09:49:55 user nova-compute[74342]:  {{(pid=74342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 09:49:55 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-59fc10af-a4df-43e3-8e8f-1995b06ad94a tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:49:55 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-59fc10af-a4df-43e3-8e8f-1995b06ad94a tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:49:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-59fc10af-a4df-43e3-8e8f-1995b06ad94a tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.783s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:55 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-59fc10af-a4df-43e3-8e8f-1995b06ad94a tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Deleted allocations for instance 1c0d394c-6e6b-41f6-b6eb-e5d54b82990f
Oct 16 09:49:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-59fc10af-a4df-43e3-8e8f-1995b06ad94a tempest-TestVolumeSwap-346509380 tempest-TestVolumeSwap-346509380-project-member] Lock "1c0d394c-6e6b-41f6-b6eb-e5d54b82990f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.208s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:55 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:49:55 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:49:55 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] No VIF found with MAC fa:16:3e:72:e1:f9, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:49:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9b70ddd7-c437-415a-b359-95a23be9f64f tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "5dc86029-dcbf-4886-bdc9-7d4413059c96" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 21.422s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:49:56 user nova-compute[74342]: WARNING nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Oct 16 09:49:56 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Triggering sync for uuid d45abd20-3a58-4657-8f4c-a426d8e39be3 {{(pid=74342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Triggering sync for uuid 98367a96-22f0-4edb-ab03-a8eb286b437b {{(pid=74342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Triggering sync for uuid bdcd2e60-b36c-4d87-94d7-076e7430e1f0 {{(pid=74342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Triggering sync for uuid 5dc86029-dcbf-4886-bdc9-7d4413059c96 {{(pid=74342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Triggering sync for uuid edcefbe0-e89f-4496-9032-f9431d9d5c53 {{(pid=74342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Triggering sync for uuid c5e44d3b-ed41-4920-825f-e1d283caecfd {{(pid=74342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Triggering sync for uuid 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4 {{(pid=74342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Triggering sync for uuid a9acd5f6-12e3-488b-b6c6-e4b81f5fc897 {{(pid=74342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Triggering sync for uuid f3c66abd-af75-4b48-9e29-ab4335f229f3 {{(pid=74342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Triggering sync for uuid 017caffb-5be2-4e78-ab48-a8091c5c00f4 {{(pid=74342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "d45abd20-3a58-4657-8f4c-a426d8e39be3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "d45abd20-3a58-4657-8f4c-a426d8e39be3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "98367a96-22f0-4edb-ab03-a8eb286b437b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "98367a96-22f0-4edb-ab03-a8eb286b437b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "5dc86029-dcbf-4886-bdc9-7d4413059c96" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "5dc86029-dcbf-4886-bdc9-7d4413059c96" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "edcefbe0-e89f-4496-9032-f9431d9d5c53" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "edcefbe0-e89f-4496-9032-f9431d9d5c53" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "c5e44d3b-ed41-4920-825f-e1d283caecfd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "c5e44d3b-ed41-4920-825f-e1d283caecfd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "f3c66abd-af75-4b48-9e29-ab4335f229f3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "f3c66abd-af75-4b48-9e29-ab4335f229f3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "017caffb-5be2-4e78-ab48-a8091c5c00f4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "017caffb-5be2-4e78-ab48-a8091c5c00f4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "c5e44d3b-ed41-4920-825f-e1d283caecfd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.096s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "d45abd20-3a58-4657-8f4c-a426d8e39be3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "98367a96-22f0-4edb-ab03-a8eb286b437b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.113s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "5dc86029-dcbf-4886-bdc9-7d4413059c96" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.125s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:56 user nova-compute[74342]: INFO nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] During _sync_instance_power_state the DB power_state (1) does not match the vm_power_state from the hypervisor (0). Updating power_state in the DB to match the hypervisor.
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.123s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.135s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "f3c66abd-af75-4b48-9e29-ab4335f229f3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.136s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "edcefbe0-e89f-4496-9032-f9431d9d5c53" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.208s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:56 user nova-compute[74342]: WARNING nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Instance is unexpectedly not found. Ignore.
Oct 16 09:49:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "017caffb-5be2-4e78-ab48-a8091c5c00f4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.207s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:57 user nova-compute[74342]: INFO nova.compute.manager [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Rebuilding instance
Oct 16 09:49:57 user nova-compute[74342]: DEBUG nova.compute.manager [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:49:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:57 user nova-compute[74342]: DEBUG nova.compute.manager [req-2217fbda-98cf-45b1-aaf0-8e94ce0a4af5 req-7d6e5aad-6e46-48af-a25d-9e3e2b117644 service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Received event network-vif-unplugged-951f9dec-9a54-4fca-a7d4-c0044b873dbf {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:49:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-2217fbda-98cf-45b1-aaf0-8e94ce0a4af5 req-7d6e5aad-6e46-48af-a25d-9e3e2b117644 service nova] Acquiring lock "5dc86029-dcbf-4886-bdc9-7d4413059c96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-2217fbda-98cf-45b1-aaf0-8e94ce0a4af5 req-7d6e5aad-6e46-48af-a25d-9e3e2b117644 service nova] Lock "5dc86029-dcbf-4886-bdc9-7d4413059c96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-2217fbda-98cf-45b1-aaf0-8e94ce0a4af5 req-7d6e5aad-6e46-48af-a25d-9e3e2b117644 service nova] Lock "5dc86029-dcbf-4886-bdc9-7d4413059c96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:57 user nova-compute[74342]: DEBUG nova.compute.manager [req-2217fbda-98cf-45b1-aaf0-8e94ce0a4af5 req-7d6e5aad-6e46-48af-a25d-9e3e2b117644 service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] No waiting events found dispatching network-vif-unplugged-951f9dec-9a54-4fca-a7d4-c0044b873dbf {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:49:57 user nova-compute[74342]: WARNING nova.compute.manager [req-2217fbda-98cf-45b1-aaf0-8e94ce0a4af5 req-7d6e5aad-6e46-48af-a25d-9e3e2b117644 service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Received unexpected event network-vif-unplugged-951f9dec-9a54-4fca-a7d4-c0044b873dbf for instance with vm_state active and task_state rebuilding.
Oct 16 09:49:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:58 user nova-compute[74342]: INFO nova.compute.manager [None req-ac72fe20-2d20-44a2-8bdf-ecb53b3ab1da tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Unrescuing
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ac72fe20-2d20-44a2-8bdf-ecb53b3ab1da tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Acquiring lock "refresh_cache-bdcd2e60-b36c-4d87-94d7-076e7430e1f0" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ac72fe20-2d20-44a2-8bdf-ecb53b3ab1da tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Acquired lock "refresh_cache-bdcd2e60-b36c-4d87-94d7-076e7430e1f0" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG nova.network.neutron [None req-ac72fe20-2d20-44a2-8bdf-ecb53b3ab1da tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:49:58 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Instance destroyed successfully.
Oct 16 09:49:58 user nova-compute[74342]: INFO nova.compute.manager [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Detaching volume c8c6991f-abcd-4da9-b892-764e07129192
Oct 16 09:49:58 user nova-compute[74342]: INFO nova.virt.block_device [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Attempting to driver detach volume c8c6991f-abcd-4da9-b892-764e07129192 from mountpoint /dev/vdb
Oct 16 09:49:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Attempting to detach device vdb from instance 5dc86029-dcbf-4886-bdc9-7d4413059c96 from the persistent domain config. {{(pid=74342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 09:49:58 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:49:58 user nova-compute[74342]:   <source dev="/dev/sdc"/>
Oct 16 09:49:58 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:49:58 user nova-compute[74342]:   <serial>c8c6991f-abcd-4da9-b892-764e07129192</serial>
Oct 16 09:49:58 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 09:49:58 user nova-compute[74342]: </disk>
Oct 16 09:49:58 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 09:49:58 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Successfully detached device vdb from instance 5dc86029-dcbf-4886-bdc9-7d4413059c96 from the persistent domain config.
Oct 16 09:49:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAupThgs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:49:58 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 16 09:49:58 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9cf302f-4107-47b5-9bf5-992df17415a0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 09:49:58 user nova-compute[74342]: No targets found.
Oct 16 09:49:58 user nova-compute[74342]: iSNS:
Oct 16 09:49:58 user nova-compute[74342]: No targets found.
Oct 16 09:49:58 user nova-compute[74342]: STATIC:
Oct 16 09:49:58 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc
Oct 16 09:49:58 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:49:58 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:49:58 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192
Oct 16 09:49:58 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:49:58 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:49:58 user nova-compute[74342]: FIRMWARE:
Oct 16 09:49:58 user nova-compute[74342]: No targets found.
Oct 16 09:49:58 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 09:49:58 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 09:49:58 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[643925fa-ddca-4dda-885e-957eb2be942c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a719e72-7ecb-42f4-bf59-8e7fe44dc971]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc (non-flash)
Oct 16 09:49:58 user nova-compute[74342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:49:58 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc (non-flash)
Oct 16 09:49:58 user nova-compute[74342]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:49:58 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b801eea70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192'): ({'sdc'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Removing single pathed devices sdc {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f051e121-6842-471f-add8-8e1fafc87ae2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6c5fcf-640c-4023-9c4e-cb2f319fdea0]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Flushing IO for device /dev/sdc {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa11fc3-cb8f-4b21-aa7a-17eaf6b3164c]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdfdfad9-5b48-4afa-92b2-0d9e01f981a7]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] SCSI volumes sdc have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[82c64ddb-e06d-496a-b8d8-a0ef1efae618]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG nova.network.neutron [None req-ac72fe20-2d20-44a2-8bdf-ecb53b3ab1da tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Updating instance_info_cache with network_info: [{"id": "6880e1ef-5122-458c-a9b8-a8202cdee055", "address": "fa:16:3e:22:60:5b", "network": {"id": "b9e6ad97-cbbe-40e7-b487-5fc89166bc6a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-718322219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6679e55d6a194b399b6b2d27a8cbb147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6880e1ef-51", "ovs_interfaceid": "6880e1ef-5122-458c-a9b8-a8202cdee055", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ac72fe20-2d20-44a2-8bdf-ecb53b3ab1da tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Releasing lock "refresh_cache-bdcd2e60-b36c-4d87-94d7-076e7430e1f0" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG nova.objects.instance [None req-ac72fe20-2d20-44a2-8bdf-ecb53b3ab1da tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lazy-loading 'flavor' on Instance uuid bdcd2e60-b36c-4d87-94d7-076e7430e1f0 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --logout" returned: 0 in 0.117s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5736339b-0133-4497-8f51-9315afc08445]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192, portal: 172.16.0.220,3260]
Oct 16 09:49:58 user nova-compute[74342]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192, portal: 172.16.0.220,3260] successful.
Oct 16 09:49:58 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[648d0f86-e948-4313-b754-af905071d8ba]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.399s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] <== disconnect_volume: return (403ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:49:59 user nova-compute[74342]: DEBUG nova.compute.manager [req-e217fda5-a02d-4a65-be2e-ded3a7e8b892 req-dc0f6bd3-dcee-448c-abec-c6a8dbafde12 service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Received event network-vif-unplugged-6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:49:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e217fda5-a02d-4a65-be2e-ded3a7e8b892 req-dc0f6bd3-dcee-448c-abec-c6a8dbafde12 service nova] Acquiring lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e217fda5-a02d-4a65-be2e-ded3a7e8b892 req-dc0f6bd3-dcee-448c-abec-c6a8dbafde12 service nova] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e217fda5-a02d-4a65-be2e-ded3a7e8b892 req-dc0f6bd3-dcee-448c-abec-c6a8dbafde12 service nova] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:59 user nova-compute[74342]: DEBUG nova.compute.manager [req-e217fda5-a02d-4a65-be2e-ded3a7e8b892 req-dc0f6bd3-dcee-448c-abec-c6a8dbafde12 service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] No waiting events found dispatching network-vif-unplugged-6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:49:59 user nova-compute[74342]: WARNING nova.compute.manager [req-e217fda5-a02d-4a65-be2e-ded3a7e8b892 req-dc0f6bd3-dcee-448c-abec-c6a8dbafde12 service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Received unexpected event network-vif-unplugged-6880e1ef-5122-458c-a9b8-a8202cdee055 for instance with vm_state rescued and task_state unrescuing.
Oct 16 09:49:59 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Instance destroyed successfully.
Oct 16 09:49:59 user nova-compute[74342]: DEBUG nova.compute.manager [req-5d88bb43-fb98-4e0a-89d8-6125da8bf08a req-07bd8d5a-04f9-4e5b-8b77-a33cd73be6db service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Received event network-vif-plugged-951f9dec-9a54-4fca-a7d4-c0044b873dbf {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:49:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5d88bb43-fb98-4e0a-89d8-6125da8bf08a req-07bd8d5a-04f9-4e5b-8b77-a33cd73be6db service nova] Acquiring lock "5dc86029-dcbf-4886-bdc9-7d4413059c96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:49:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5d88bb43-fb98-4e0a-89d8-6125da8bf08a req-07bd8d5a-04f9-4e5b-8b77-a33cd73be6db service nova] Lock "5dc86029-dcbf-4886-bdc9-7d4413059c96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:49:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5d88bb43-fb98-4e0a-89d8-6125da8bf08a req-07bd8d5a-04f9-4e5b-8b77-a33cd73be6db service nova] Lock "5dc86029-dcbf-4886-bdc9-7d4413059c96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:49:59 user nova-compute[74342]: DEBUG nova.compute.manager [req-5d88bb43-fb98-4e0a-89d8-6125da8bf08a req-07bd8d5a-04f9-4e5b-8b77-a33cd73be6db service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] No waiting events found dispatching network-vif-plugged-951f9dec-9a54-4fca-a7d4-c0044b873dbf {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:49:59 user nova-compute[74342]: WARNING nova.compute.manager [req-5d88bb43-fb98-4e0a-89d8-6125da8bf08a req-07bd8d5a-04f9-4e5b-8b77-a33cd73be6db service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Received unexpected event network-vif-plugged-951f9dec-9a54-4fca-a7d4-c0044b873dbf for instance with vm_state active and task_state rebuilding.
Oct 16 09:50:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:01 user nova-compute[74342]: DEBUG nova.compute.manager [req-14f9ff0e-4b96-4276-b8c7-31f4081c15a4 req-9a7472db-231f-4ee5-98df-16e1ba39e6bf service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Received event network-changed-6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:50:01 user nova-compute[74342]: DEBUG nova.compute.manager [req-14f9ff0e-4b96-4276-b8c7-31f4081c15a4 req-9a7472db-231f-4ee5-98df-16e1ba39e6bf service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Refreshing instance network info cache due to event network-changed-6880e1ef-5122-458c-a9b8-a8202cdee055. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:50:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-14f9ff0e-4b96-4276-b8c7-31f4081c15a4 req-9a7472db-231f-4ee5-98df-16e1ba39e6bf service nova] Acquiring lock "refresh_cache-bdcd2e60-b36c-4d87-94d7-076e7430e1f0" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:50:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-14f9ff0e-4b96-4276-b8c7-31f4081c15a4 req-9a7472db-231f-4ee5-98df-16e1ba39e6bf service nova] Acquired lock "refresh_cache-bdcd2e60-b36c-4d87-94d7-076e7430e1f0" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:50:01 user nova-compute[74342]: DEBUG nova.network.neutron [req-14f9ff0e-4b96-4276-b8c7-31f4081c15a4 req-9a7472db-231f-4ee5-98df-16e1ba39e6bf service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Refreshing network info cache for port 6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:50:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:02 user nova-compute[74342]: DEBUG nova.network.neutron [req-14f9ff0e-4b96-4276-b8c7-31f4081c15a4 req-9a7472db-231f-4ee5-98df-16e1ba39e6bf service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Updated VIF entry in instance network info cache for port 6880e1ef-5122-458c-a9b8-a8202cdee055. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:50:02 user nova-compute[74342]: DEBUG nova.network.neutron [req-14f9ff0e-4b96-4276-b8c7-31f4081c15a4 req-9a7472db-231f-4ee5-98df-16e1ba39e6bf service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Updating instance_info_cache with network_info: [{"id": "6880e1ef-5122-458c-a9b8-a8202cdee055", "address": "fa:16:3e:22:60:5b", "network": {"id": "b9e6ad97-cbbe-40e7-b487-5fc89166bc6a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-718322219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6679e55d6a194b399b6b2d27a8cbb147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6880e1ef-51", "ovs_interfaceid": "6880e1ef-5122-458c-a9b8-a8202cdee055", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:50:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-14f9ff0e-4b96-4276-b8c7-31f4081c15a4 req-9a7472db-231f-4ee5-98df-16e1ba39e6bf service nova] Releasing lock "refresh_cache-bdcd2e60-b36c-4d87-94d7-076e7430e1f0" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:50:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-14f9ff0e-4b96-4276-b8c7-31f4081c15a4 req-9a7472db-231f-4ee5-98df-16e1ba39e6bf service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Received event network-vif-plugged-6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:50:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-14f9ff0e-4b96-4276-b8c7-31f4081c15a4 req-9a7472db-231f-4ee5-98df-16e1ba39e6bf service nova] Acquiring lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:50:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-14f9ff0e-4b96-4276-b8c7-31f4081c15a4 req-9a7472db-231f-4ee5-98df-16e1ba39e6bf service nova] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:50:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-14f9ff0e-4b96-4276-b8c7-31f4081c15a4 req-9a7472db-231f-4ee5-98df-16e1ba39e6bf service nova] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:50:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-14f9ff0e-4b96-4276-b8c7-31f4081c15a4 req-9a7472db-231f-4ee5-98df-16e1ba39e6bf service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] No waiting events found dispatching network-vif-plugged-6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:50:02 user nova-compute[74342]: WARNING nova.compute.manager [req-14f9ff0e-4b96-4276-b8c7-31f4081c15a4 req-9a7472db-231f-4ee5-98df-16e1ba39e6bf service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Received unexpected event network-vif-plugged-6880e1ef-5122-458c-a9b8-a8202cdee055 for instance with vm_state rescued and task_state unrescuing.
Oct 16 09:50:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-14f9ff0e-4b96-4276-b8c7-31f4081c15a4 req-9a7472db-231f-4ee5-98df-16e1ba39e6bf service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Received event network-changed-6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:50:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-14f9ff0e-4b96-4276-b8c7-31f4081c15a4 req-9a7472db-231f-4ee5-98df-16e1ba39e6bf service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Refreshing instance network info cache due to event network-changed-6880e1ef-5122-458c-a9b8-a8202cdee055. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:50:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-14f9ff0e-4b96-4276-b8c7-31f4081c15a4 req-9a7472db-231f-4ee5-98df-16e1ba39e6bf service nova] Acquiring lock "refresh_cache-bdcd2e60-b36c-4d87-94d7-076e7430e1f0" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:50:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-14f9ff0e-4b96-4276-b8c7-31f4081c15a4 req-9a7472db-231f-4ee5-98df-16e1ba39e6bf service nova] Acquired lock "refresh_cache-bdcd2e60-b36c-4d87-94d7-076e7430e1f0" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:50:02 user nova-compute[74342]: DEBUG nova.network.neutron [req-14f9ff0e-4b96-4276-b8c7-31f4081c15a4 req-9a7472db-231f-4ee5-98df-16e1ba39e6bf service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Refreshing network info cache for port 6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:50:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:02 user nova-compute[74342]: DEBUG nova.network.neutron [req-14f9ff0e-4b96-4276-b8c7-31f4081c15a4 req-9a7472db-231f-4ee5-98df-16e1ba39e6bf service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Updated VIF entry in instance network info cache for port 6880e1ef-5122-458c-a9b8-a8202cdee055. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:50:02 user nova-compute[74342]: DEBUG nova.network.neutron [req-14f9ff0e-4b96-4276-b8c7-31f4081c15a4 req-9a7472db-231f-4ee5-98df-16e1ba39e6bf service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Updating instance_info_cache with network_info: [{"id": "6880e1ef-5122-458c-a9b8-a8202cdee055", "address": "fa:16:3e:22:60:5b", "network": {"id": "b9e6ad97-cbbe-40e7-b487-5fc89166bc6a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-718322219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6679e55d6a194b399b6b2d27a8cbb147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6880e1ef-51", "ovs_interfaceid": "6880e1ef-5122-458c-a9b8-a8202cdee055", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:50:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-14f9ff0e-4b96-4276-b8c7-31f4081c15a4 req-9a7472db-231f-4ee5-98df-16e1ba39e6bf service nova] Releasing lock "refresh_cache-bdcd2e60-b36c-4d87-94d7-076e7430e1f0" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:50:03 user nova-compute[74342]: DEBUG nova.compute.manager [req-8e47367c-08a2-4714-b273-d38e7cf62fc4 req-e6d32471-09f0-4dfe-8f39-2ed5a1385813 service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Received event network-vif-plugged-6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:50:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8e47367c-08a2-4714-b273-d38e7cf62fc4 req-e6d32471-09f0-4dfe-8f39-2ed5a1385813 service nova] Acquiring lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:50:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8e47367c-08a2-4714-b273-d38e7cf62fc4 req-e6d32471-09f0-4dfe-8f39-2ed5a1385813 service nova] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:50:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8e47367c-08a2-4714-b273-d38e7cf62fc4 req-e6d32471-09f0-4dfe-8f39-2ed5a1385813 service nova] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:50:03 user nova-compute[74342]: DEBUG nova.compute.manager [req-8e47367c-08a2-4714-b273-d38e7cf62fc4 req-e6d32471-09f0-4dfe-8f39-2ed5a1385813 service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] No waiting events found dispatching network-vif-plugged-6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:50:03 user nova-compute[74342]: WARNING nova.compute.manager [req-8e47367c-08a2-4714-b273-d38e7cf62fc4 req-e6d32471-09f0-4dfe-8f39-2ed5a1385813 service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Received unexpected event network-vif-plugged-6880e1ef-5122-458c-a9b8-a8202cdee055 for instance with vm_state rescued and task_state unrescuing.
Oct 16 09:50:03 user nova-compute[74342]: DEBUG nova.compute.manager [req-8e47367c-08a2-4714-b273-d38e7cf62fc4 req-e6d32471-09f0-4dfe-8f39-2ed5a1385813 service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Received event network-vif-plugged-6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:50:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8e47367c-08a2-4714-b273-d38e7cf62fc4 req-e6d32471-09f0-4dfe-8f39-2ed5a1385813 service nova] Acquiring lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:50:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8e47367c-08a2-4714-b273-d38e7cf62fc4 req-e6d32471-09f0-4dfe-8f39-2ed5a1385813 service nova] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:50:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8e47367c-08a2-4714-b273-d38e7cf62fc4 req-e6d32471-09f0-4dfe-8f39-2ed5a1385813 service nova] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:50:03 user nova-compute[74342]: DEBUG nova.compute.manager [req-8e47367c-08a2-4714-b273-d38e7cf62fc4 req-e6d32471-09f0-4dfe-8f39-2ed5a1385813 service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] No waiting events found dispatching network-vif-plugged-6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:50:03 user nova-compute[74342]: WARNING nova.compute.manager [req-8e47367c-08a2-4714-b273-d38e7cf62fc4 req-e6d32471-09f0-4dfe-8f39-2ed5a1385813 service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Received unexpected event network-vif-plugged-6880e1ef-5122-458c-a9b8-a8202cdee055 for instance with vm_state rescued and task_state unrescuing.
Oct 16 09:50:03 user nova-compute[74342]: DEBUG nova.compute.manager [None req-ac72fe20-2d20-44a2-8bdf-ecb53b3ab1da tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:50:06 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Instance destroyed successfully.
Oct 16 09:50:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1925950729',display_name='tempest-ServerActionsTestOtherA-server-1573235159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1925950729',id=13,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENlsyLKWKrYF7OcOeajHHxxGyLS1hP9Z+t1OgPZy4taPt9sKtivrgHdPrFdyhMN0XH93w8AnoJZMLK1ZeOS0cwQwCLjdSdOan0bKTxZLlv4i5AfsZfy9oM6wACrGz48LQ==',key_name='tempest-keypair-501012977',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:47:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='355bac247f9d4ea8b3c2f0d87453f4c1',ramdisk_id='',reservation_id='r-o0rm909r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1004911708',owner_user_name='tempest-ServerActionsTestOtherA-1004911708-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:49:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3c728429a0a42789cfc0f1251d6f623',uuid=5dc86029-dcbf-4886-bdc9-7d4413059c96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "address": "fa:16:3e:72:e1:f9", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951f9dec-9a", "ovs_interfaceid": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Converting VIF {"id": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "address": "fa:16:3e:72:e1:f9", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951f9dec-9a", "ovs_interfaceid": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:e1:f9,bridge_name='br-int',has_traffic_filtering=True,id=951f9dec-9a54-4fca-a7d4-c0044b873dbf,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap951f9dec-9a') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG os_vif [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:e1:f9,bridge_name='br-int',has_traffic_filtering=True,id=951f9dec-9a54-4fca-a7d4-c0044b873dbf,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap951f9dec-9a') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap951f9dec-9a, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5eb67583-0af6-47de-ae5c-ab24acff13bb) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:50:06 user nova-compute[74342]: INFO os_vif [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:e1:f9,bridge_name='br-int',has_traffic_filtering=True,id=951f9dec-9a54-4fca-a7d4-c0044b873dbf,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap951f9dec-9a')
Oct 16 09:50:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAupThgs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:50:06 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 16 09:50:06 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a91d48da-0d47-4ca6-bc8e-017304034343]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 09:50:06 user nova-compute[74342]: No targets found.
Oct 16 09:50:06 user nova-compute[74342]: iSNS:
Oct 16 09:50:06 user nova-compute[74342]: No targets found.
Oct 16 09:50:06 user nova-compute[74342]: STATIC:
Oct 16 09:50:06 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc
Oct 16 09:50:06 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:50:06 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:50:06 user nova-compute[74342]: FIRMWARE:
Oct 16 09:50:06 user nova-compute[74342]: No targets found.
Oct 16 09:50:06 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 09:50:06 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 09:50:06 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d29410a1-802b-4877-af7c-3f5c68ed5fb5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d757c9b-c5c6-4675-8d15-c3222e7a545c]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc (non-flash)
Oct 16 09:50:06 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc (non-flash)
Oct 16 09:50:06 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b6039ae60>, {}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Disconnecting from: [] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.065s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] <== disconnect_volume: return (66ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 09:50:06 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Deleting instance files /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96_del
Oct 16 09:50:06 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Deletion of /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96_del complete
Oct 16 09:50:06 user nova-compute[74342]: INFO nova.virt.block_device [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Booting with volume c8c6991f-abcd-4da9-b892-764e07129192 at /dev/vdb
Oct 16 09:50:06 user nova-compute[74342]: DEBUG os_brick.utils [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[50a7ee95-59d1-4277-9e5d-b0c169000a7a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9282e84-97c5-49fc-b3c9-2f9bbc2ac3e0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[464d9555-b6e0-49a1-90b3-abea4279df89]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0819b922-c547-4a78-9d59-8f2218b64dbd]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:50:06 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:50:06 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0bec09-b21d-4e74-b0e1-8d14b4962396]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG os_brick.utils [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] <== get_connector_properties: return (160ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:50:06 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Updating existing volume attachment record: 27886065-8876-4df5-92cf-99bb3a3af2b5 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 09:50:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:23 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:50:23 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Creating image(s)
Oct 16 09:50:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "/opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:50:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "/opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:50:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "/opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:50:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.185s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:50:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:50:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.191s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk 1073741824" returned: 0 in 0.069s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:50:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.196s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Cannot resize image /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Ensure instance console log exists: /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Start _get_guest_xml network_info=[{"id": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "address": "fa:16:3e:72:e1:f9", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951f9dec-9a", "ovs_interfaceid": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '27886065-8876-4df5-92cf-99bb3a3af2b5', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAupThgs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5dc86029-dcbf-4886-bdc9-7d4413059c96', 'attached_at': '', 'detached_at': '', 'volume_id': 'c8c6991f-abcd-4da9-b892-764e07129192', 'serial': 'c8c6991f-abcd-4da9-b892-764e07129192'}, 'volume_type': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:50:24 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 16 09:50:24 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Oct 16 09:50:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG nova.objects.instance [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5dc86029-dcbf-4886-bdc9-7d4413059c96 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAupThgs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:50:24 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 16 09:50:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:50:24 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Oct 16 09:50:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:50:24 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[efcf33f5-c579-44ce-921b-83fd2e07600c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 09:50:24 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aac5d1b-b39c-41b6-bbb5-3eaea21c197f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192] added
Oct 16 09:50:24 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[572bb0d9-2bd2-4d95-abea-0d9165a7ba40]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11a7475-dbdb-40fa-9d7f-6074f197a3c5]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tAupThgs {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tAupThgs" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[affc3797-f5e2-46d0-b737-212f687c566b]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tAupThgs'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[058fd8b4-c9d1-4bea-8bb6-dbdf3ef9c7a7]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef247383-0d9f-4cb5-a2e0-88fd607c0fdb]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc (non-flash)
Oct 16 09:50:24 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc (non-flash)
Oct 16 09:50:24 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0245155-87fd-4a97-a43b-f3a5f8df1d0b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192, portal: 172.16.0.220,3260]
Oct 16 09:50:24 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192, portal: 172.16.0.220,3260] successful.
Oct 16 09:50:24 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.161s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de2f1b0-f082-434a-9092-8aff018ef0b5]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[081e74fe-d09a-488f-831a-24f0c9df1ca5]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc (non-flash)
Oct 16 09:50:24 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:50:24 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc (non-flash)
Oct 16 09:50:24 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:50:24 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.438s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] HCTL ('34', '-', '-', 0) found on session 9 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[494fbcf6-3b75-4967-9123-c2455becff3a]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:50:24 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Searching for a device in session 9 and hctl ['34', '*', '*', 0] yield: None {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:50:25 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Searching for a device in session 9 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:50:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAupThgs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 09:50:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.471s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:50:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] <== connect_volume: return (1473ms) {'type': 'block', 'scsi_wwn': '23432646266353761', 'path': '/dev/sdc'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:50:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23432646266353761', 'path': '/dev/sdc'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 09:50:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T09:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1925950729',display_name='tempest-ServerActionsTestOtherA-server-1573235159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1925950729',id=13,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENlsyLKWKrYF7OcOeajHHxxGyLS1hP9Z+t1OgPZy4taPt9sKtivrgHdPrFdyhMN0XH93w8AnoJZMLK1ZeOS0cwQwCLjdSdOan0bKTxZLlv4i5AfsZfy9oM6wACrGz48LQ==',key_name='tempest-keypair-501012977',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:47:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='355bac247f9d4ea8b3c2f0d87453f4c1',ramdisk_id='',reservation_id='r-o0rm909r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1004911708',owner_user_name='tempest-ServerActionsTestOtherA-1004911708-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3c728429a0a42789cfc0f1251d6f623',uuid=5dc86029-dcbf-4886-bdc9-7d4413059c96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "address": "fa:16:3e:72:e1:f9", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951f9dec-9a", "ovs_interfaceid": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:50:25 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Converting VIF {"id": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "address": "fa:16:3e:72:e1:f9", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951f9dec-9a", "ovs_interfaceid": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:50:25 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:e1:f9,bridge_name='br-int',has_traffic_filtering=True,id=951f9dec-9a54-4fca-a7d4-c0044b873dbf,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap951f9dec-9a') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:50:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:50:25 user nova-compute[74342]:   <uuid>5dc86029-dcbf-4886-bdc9-7d4413059c96</uuid>
Oct 16 09:50:25 user nova-compute[74342]:   <name>instance-0000000d</name>
Oct 16 09:50:25 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:50:25 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:50:25 user nova-compute[74342]:   <metadata>
Oct 16 09:50:25 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:50:25 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:50:25 user nova-compute[74342]:       <nova:name>tempest-ServerActionsTestOtherA-server-1573235159</nova:name>
Oct 16 09:50:25 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:50:24</nova:creationTime>
Oct 16 09:50:25 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:50:25 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:50:25 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:50:25 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:50:25 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:50:25 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:50:25 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:50:25 user nova-compute[74342]:       <nova:owner>
Oct 16 09:50:25 user nova-compute[74342]:         <nova:user uuid="e3c728429a0a42789cfc0f1251d6f623">tempest-ServerActionsTestOtherA-1004911708-project-member</nova:user>
Oct 16 09:50:25 user nova-compute[74342]:         <nova:project uuid="355bac247f9d4ea8b3c2f0d87453f4c1">tempest-ServerActionsTestOtherA-1004911708</nova:project>
Oct 16 09:50:25 user nova-compute[74342]:       </nova:owner>
Oct 16 09:50:25 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:50:25 user nova-compute[74342]:       <nova:ports>
Oct 16 09:50:25 user nova-compute[74342]:         <nova:port uuid="951f9dec-9a54-4fca-a7d4-c0044b873dbf">
Oct 16 09:50:25 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 16 09:50:25 user nova-compute[74342]:         </nova:port>
Oct 16 09:50:25 user nova-compute[74342]:       </nova:ports>
Oct 16 09:50:25 user nova-compute[74342]:     </nova:instance>
Oct 16 09:50:25 user nova-compute[74342]:   </metadata>
Oct 16 09:50:25 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:50:25 user nova-compute[74342]:     <system>
Oct 16 09:50:25 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:50:25 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:50:25 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:50:25 user nova-compute[74342]:       <entry name="serial">5dc86029-dcbf-4886-bdc9-7d4413059c96</entry>
Oct 16 09:50:25 user nova-compute[74342]:       <entry name="uuid">5dc86029-dcbf-4886-bdc9-7d4413059c96</entry>
Oct 16 09:50:25 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:50:25 user nova-compute[74342]:     </system>
Oct 16 09:50:25 user nova-compute[74342]:   </sysinfo>
Oct 16 09:50:25 user nova-compute[74342]:   <os>
Oct 16 09:50:25 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:50:25 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:50:25 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:50:25 user nova-compute[74342]:   </os>
Oct 16 09:50:25 user nova-compute[74342]:   <features>
Oct 16 09:50:25 user nova-compute[74342]:     <acpi/>
Oct 16 09:50:25 user nova-compute[74342]:     <apic/>
Oct 16 09:50:25 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:50:25 user nova-compute[74342]:   </features>
Oct 16 09:50:25 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:50:25 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:50:25 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:50:25 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:50:25 user nova-compute[74342]:   </clock>
Oct 16 09:50:25 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:50:25 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:50:25 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:50:25 user nova-compute[74342]:   </cpu>
Oct 16 09:50:25 user nova-compute[74342]:   <devices>
Oct 16 09:50:25 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 09:50:25 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 09:50:25 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk"/>
Oct 16 09:50:25 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:50:25 user nova-compute[74342]:     </disk>
Oct 16 09:50:25 user nova-compute[74342]:     <disk type="block" device="disk">
Oct 16 09:50:25 user nova-compute[74342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:50:25 user nova-compute[74342]:       <source dev="/dev/sdc"/>
Oct 16 09:50:25 user nova-compute[74342]:       <target dev="vdb" bus="virtio"/>
Oct 16 09:50:25 user nova-compute[74342]:       <serial>c8c6991f-abcd-4da9-b892-764e07129192</serial>
Oct 16 09:50:25 user nova-compute[74342]:     </disk>
Oct 16 09:50:25 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:50:25 user nova-compute[74342]:       <mac address="fa:16:3e:72:e1:f9"/>
Oct 16 09:50:25 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:50:25 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:50:25 user nova-compute[74342]:       <target dev="tap951f9dec-9a"/>
Oct 16 09:50:25 user nova-compute[74342]:     </interface>
Oct 16 09:50:25 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:50:25 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/console.log" append="off"/>
Oct 16 09:50:25 user nova-compute[74342]:     </serial>
Oct 16 09:50:25 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:50:25 user nova-compute[74342]:     <video>
Oct 16 09:50:25 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:50:25 user nova-compute[74342]:     </video>
Oct 16 09:50:25 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:50:25 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:50:25 user nova-compute[74342]:     </rng>
Oct 16 09:50:25 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:50:25 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:50:25 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:50:25 user nova-compute[74342]:     </memballoon>
Oct 16 09:50:25 user nova-compute[74342]:   </devices>
Oct 16 09:50:25 user nova-compute[74342]: </domain>
Oct 16 09:50:25 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:50:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T09:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1925950729',display_name='tempest-ServerActionsTestOtherA-server-1573235159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1925950729',id=13,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENlsyLKWKrYF7OcOeajHHxxGyLS1hP9Z+t1OgPZy4taPt9sKtivrgHdPrFdyhMN0XH93w8AnoJZMLK1ZeOS0cwQwCLjdSdOan0bKTxZLlv4i5AfsZfy9oM6wACrGz48LQ==',key_name='tempest-keypair-501012977',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:47:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='355bac247f9d4ea8b3c2f0d87453f4c1',ramdisk_id='',reservation_id='r-o0rm909r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1004911708',owner_user_name='tempest-ServerActionsTestOtherA-1004911708-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:50:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3c728429a0a42789cfc0f1251d6f623',uuid=5dc86029-dcbf-4886-bdc9-7d4413059c96,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "address": "fa:16:3e:72:e1:f9", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951f9dec-9a", "ovs_interfaceid": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:50:25 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Converting VIF {"id": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "address": "fa:16:3e:72:e1:f9", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951f9dec-9a", "ovs_interfaceid": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:50:25 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:e1:f9,bridge_name='br-int',has_traffic_filtering=True,id=951f9dec-9a54-4fca-a7d4-c0044b873dbf,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap951f9dec-9a') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:50:25 user nova-compute[74342]: DEBUG os_vif [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:e1:f9,bridge_name='br-int',has_traffic_filtering=True,id=951f9dec-9a54-4fca-a7d4-c0044b873dbf,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap951f9dec-9a') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:50:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:50:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:50:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f62e4683-bc49-5fa8-b1ad-c105657ef48e', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:50:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:50:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap951f9dec-9a, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:50:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap951f9dec-9a, col_values=(('qos', UUID('afa2d8d8-4580-42de-a2a8-3fe7b11a1985')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:50:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap951f9dec-9a, col_values=(('external_ids', {'iface-id': '951f9dec-9a54-4fca-a7d4-c0044b873dbf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:72:e1:f9', 'vm-uuid': '5dc86029-dcbf-4886-bdc9-7d4413059c96'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:50:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:50:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:25 user nova-compute[74342]: INFO os_vif [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:e1:f9,bridge_name='br-int',has_traffic_filtering=True,id=951f9dec-9a54-4fca-a7d4-c0044b873dbf,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap951f9dec-9a')
Oct 16 09:50:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:50:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:50:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] No VIF found with MAC fa:16:3e:72:e1:f9, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:50:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:27 user nova-compute[74342]: DEBUG nova.compute.manager [req-b8e36d53-7654-4907-bdd7-1f81abb42756 req-0e7c5cf0-007d-4266-8b43-366f0895c5c3 service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Received event network-vif-plugged-951f9dec-9a54-4fca-a7d4-c0044b873dbf {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:50:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b8e36d53-7654-4907-bdd7-1f81abb42756 req-0e7c5cf0-007d-4266-8b43-366f0895c5c3 service nova] Acquiring lock "5dc86029-dcbf-4886-bdc9-7d4413059c96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:50:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b8e36d53-7654-4907-bdd7-1f81abb42756 req-0e7c5cf0-007d-4266-8b43-366f0895c5c3 service nova] Lock "5dc86029-dcbf-4886-bdc9-7d4413059c96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:50:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b8e36d53-7654-4907-bdd7-1f81abb42756 req-0e7c5cf0-007d-4266-8b43-366f0895c5c3 service nova] Lock "5dc86029-dcbf-4886-bdc9-7d4413059c96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:50:27 user nova-compute[74342]: DEBUG nova.compute.manager [req-b8e36d53-7654-4907-bdd7-1f81abb42756 req-0e7c5cf0-007d-4266-8b43-366f0895c5c3 service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] No waiting events found dispatching network-vif-plugged-951f9dec-9a54-4fca-a7d4-c0044b873dbf {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:50:27 user nova-compute[74342]: WARNING nova.compute.manager [req-b8e36d53-7654-4907-bdd7-1f81abb42756 req-0e7c5cf0-007d-4266-8b43-366f0895c5c3 service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Received unexpected event network-vif-plugged-951f9dec-9a54-4fca-a7d4-c0044b873dbf for instance with vm_state active and task_state rebuild_spawning.
Oct 16 09:50:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:29 user nova-compute[74342]: DEBUG nova.compute.manager [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:50:29 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:50:29 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Instance spawned successfully.
Oct 16 09:50:29 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:50:29 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:50:29 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:50:29 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:50:29 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:50:29 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:50:29 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:50:29 user nova-compute[74342]: DEBUG nova.compute.manager [req-35538f2d-0196-4f56-bde0-a65cceaff7ad req-98f0e8d9-2eac-4639-a97d-73f0fb2fb72b service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Received event network-vif-plugged-951f9dec-9a54-4fca-a7d4-c0044b873dbf {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:50:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-35538f2d-0196-4f56-bde0-a65cceaff7ad req-98f0e8d9-2eac-4639-a97d-73f0fb2fb72b service nova] Acquiring lock "5dc86029-dcbf-4886-bdc9-7d4413059c96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:50:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-35538f2d-0196-4f56-bde0-a65cceaff7ad req-98f0e8d9-2eac-4639-a97d-73f0fb2fb72b service nova] Lock "5dc86029-dcbf-4886-bdc9-7d4413059c96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:50:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-35538f2d-0196-4f56-bde0-a65cceaff7ad req-98f0e8d9-2eac-4639-a97d-73f0fb2fb72b service nova] Lock "5dc86029-dcbf-4886-bdc9-7d4413059c96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:50:29 user nova-compute[74342]: DEBUG nova.compute.manager [req-35538f2d-0196-4f56-bde0-a65cceaff7ad req-98f0e8d9-2eac-4639-a97d-73f0fb2fb72b service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] No waiting events found dispatching network-vif-plugged-951f9dec-9a54-4fca-a7d4-c0044b873dbf {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:50:29 user nova-compute[74342]: WARNING nova.compute.manager [req-35538f2d-0196-4f56-bde0-a65cceaff7ad req-98f0e8d9-2eac-4639-a97d-73f0fb2fb72b service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Received unexpected event network-vif-plugged-951f9dec-9a54-4fca-a7d4-c0044b873dbf for instance with vm_state active and task_state rebuild_spawning.
Oct 16 09:50:29 user nova-compute[74342]: DEBUG nova.compute.manager [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:50:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:50:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:50:29 user nova-compute[74342]: DEBUG nova.objects.instance [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Trying to apply a migration context that does not seem to be set for this instance {{(pid=74342) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1078}}
Oct 16 09:50:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b24d9af3-8e35-4ab8-98a2-56cd14c3ccfc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.095s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:50:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Acquiring lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:50:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:50:31 user nova-compute[74342]: INFO nova.compute.manager [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Detaching volume 642c6df7-21ee-41cb-b410-2b14cb878dbc
Oct 16 09:50:31 user nova-compute[74342]: INFO nova.virt.block_device [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Attempting to driver detach volume 642c6df7-21ee-41cb-b410-2b14cb878dbc from mountpoint /dev/vdb
Oct 16 09:50:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Attempting to detach device vdb from instance bdcd2e60-b36c-4d87-94d7-076e7430e1f0 from the persistent domain config. {{(pid=74342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 09:50:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 09:50:31 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:50:31 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 09:50:31 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:50:31 user nova-compute[74342]:   <serial>642c6df7-21ee-41cb-b410-2b14cb878dbc</serial>
Oct 16 09:50:31 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 09:50:31 user nova-compute[74342]: </disk>
Oct 16 09:50:31 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 09:50:31 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Successfully detached device vdb from instance bdcd2e60-b36c-4d87-94d7-076e7430e1f0 from the persistent domain config.
Oct 16 09:50:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance bdcd2e60-b36c-4d87-94d7-076e7430e1f0 from the live domain config. {{(pid=74342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 09:50:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 09:50:31 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:50:31 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 09:50:31 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:50:31 user nova-compute[74342]:   <serial>642c6df7-21ee-41cb-b410-2b14cb878dbc</serial>
Oct 16 09:50:31 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 09:50:31 user nova-compute[74342]: </disk>
Oct 16 09:50:31 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 09:50:32 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance bdcd2e60-b36c-4d87-94d7-076e7430e1f0 {{(pid=74342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 09:50:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:41 user nova-compute[74342]: DEBUG nova.compute.manager [req-4eac0034-0004-4282-8509-2d302e2c8d3c req-b83fd1a5-532c-4b89-bcf9-7b16a05951af service nova] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Received event network-changed-6c307712-877a-44b9-9a89-ffad24cadbc4 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:50:41 user nova-compute[74342]: DEBUG nova.compute.manager [req-4eac0034-0004-4282-8509-2d302e2c8d3c req-b83fd1a5-532c-4b89-bcf9-7b16a05951af service nova] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Refreshing instance network info cache due to event network-changed-6c307712-877a-44b9-9a89-ffad24cadbc4. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:50:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4eac0034-0004-4282-8509-2d302e2c8d3c req-b83fd1a5-532c-4b89-bcf9-7b16a05951af service nova] Acquiring lock "refresh_cache-c5e44d3b-ed41-4920-825f-e1d283caecfd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:50:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4eac0034-0004-4282-8509-2d302e2c8d3c req-b83fd1a5-532c-4b89-bcf9-7b16a05951af service nova] Acquired lock "refresh_cache-c5e44d3b-ed41-4920-825f-e1d283caecfd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:50:41 user nova-compute[74342]: DEBUG nova.network.neutron [req-4eac0034-0004-4282-8509-2d302e2c8d3c req-b83fd1a5-532c-4b89-bcf9-7b16a05951af service nova] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Refreshing network info cache for port 6c307712-877a-44b9-9a89-ffad24cadbc4 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:50:41 user nova-compute[74342]: DEBUG nova.network.neutron [req-4eac0034-0004-4282-8509-2d302e2c8d3c req-b83fd1a5-532c-4b89-bcf9-7b16a05951af service nova] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Updated VIF entry in instance network info cache for port 6c307712-877a-44b9-9a89-ffad24cadbc4. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:50:41 user nova-compute[74342]: DEBUG nova.network.neutron [req-4eac0034-0004-4282-8509-2d302e2c8d3c req-b83fd1a5-532c-4b89-bcf9-7b16a05951af service nova] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Updating instance_info_cache with network_info: [{"id": "6c307712-877a-44b9-9a89-ffad24cadbc4", "address": "fa:16:3e:21:83:11", "network": {"id": "7bf142ea-2d65-4e3e-95f4-691e535078c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409249207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81481518f90a4d99abd102ab65d54caa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c307712-87", "ovs_interfaceid": "6c307712-877a-44b9-9a89-ffad24cadbc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:50:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4eac0034-0004-4282-8509-2d302e2c8d3c req-b83fd1a5-532c-4b89-bcf9-7b16a05951af service nova] Releasing lock "refresh_cache-c5e44d3b-ed41-4920-825f-e1d283caecfd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:50:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:45 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:50:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:50:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:50:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:50:45 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 09:50:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9acd5f6-12e3-488b-b6c6-e4b81f5fc897/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9acd5f6-12e3-488b-b6c6-e4b81f5fc897/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9acd5f6-12e3-488b-b6c6-e4b81f5fc897/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9acd5f6-12e3-488b-b6c6-e4b81f5fc897/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:47 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "2522364c-36c7-446d-87e7-113632ceeab6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:50:47 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "2522364c-36c7-446d-87e7-113632ceeab6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.008s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:50:47 user nova-compute[74342]: DEBUG nova.compute.manager [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:50:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk --force-share --output=json" returned: 0 in 0.290s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:47 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:50:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:50:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:50:48 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:50:48 user nova-compute[74342]: INFO nova.compute.claims [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Claim successful on node user
Oct 16 09:50:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:48 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Refreshing inventories for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 09:50:48 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Updating ProviderTree inventory for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 09:50:48 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Updating inventory in ProviderTree for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 09:50:48 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Refreshing aggregate associations for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca, aggregates: None {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 09:50:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:48 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Refreshing trait associations for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 09:50:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:48 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:50:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:48 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:50:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.885s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:50:48 user nova-compute[74342]: DEBUG nova.compute.manager [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:50:49 user nova-compute[74342]: DEBUG nova.compute.manager [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:50:49 user nova-compute[74342]: DEBUG nova.network.neutron [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:50:49 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:50:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:49 user nova-compute[74342]: DEBUG nova.compute.manager [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:50:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:49 user nova-compute[74342]: DEBUG nova.policy [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f90f091b76254a13957807feaeaef3fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4fcf2437a2d413ea584d0cc2508bed3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:50:49 user nova-compute[74342]: INFO nova.virt.block_device [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Booting with volume-backed-image 01fbac29-34fa-4a9a-a2f8-2f304b74a717 at /dev/vda
Oct 16 09:50:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Acquiring lock "68e6e026-f958-40c4-ab99-19deaaa1590d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:50:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Lock "68e6e026-f958-40c4-ab99-19deaaa1590d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:50:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:49 user nova-compute[74342]: DEBUG nova.compute.manager [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:50:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:50:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:50:49 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:50:49 user nova-compute[74342]: INFO nova.compute.claims [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Claim successful on node user
Oct 16 09:50:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:50 user nova-compute[74342]: DEBUG nova.network.neutron [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Successfully created port: 975f1cad-dbc7-462f-9702-55567afd639b {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:50:50 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:50:50 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:50:50 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=7512MB free_disk=25.17607879638672GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 09:50:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:50:50 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:50:50 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:50:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.064s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:50:50 user nova-compute[74342]: DEBUG nova.compute.manager [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:50:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.470s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:50:50 user nova-compute[74342]: DEBUG nova.compute.manager [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:50:50 user nova-compute[74342]: DEBUG nova.network.neutron [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:50:50 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:50:50 user nova-compute[74342]: DEBUG nova.compute.manager [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:50:50 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance d45abd20-3a58-4657-8f4c-a426d8e39be3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:50:50 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 98367a96-22f0-4edb-ab03-a8eb286b437b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:50:50 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance bdcd2e60-b36c-4d87-94d7-076e7430e1f0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:50:50 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 017caffb-5be2-4e78-ab48-a8091c5c00f4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:50:50 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 5dc86029-dcbf-4886-bdc9-7d4413059c96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:50:50 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance edcefbe0-e89f-4496-9032-f9431d9d5c53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:50:50 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance c5e44d3b-ed41-4920-825f-e1d283caecfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:50:50 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:50:50 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance a9acd5f6-12e3-488b-b6c6-e4b81f5fc897 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:50:50 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance f3c66abd-af75-4b48-9e29-ab4335f229f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:50:50 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 2522364c-36c7-446d-87e7-113632ceeab6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:50:50 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 68e6e026-f958-40c4-ab99-19deaaa1590d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:50:50 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 09:50:50 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 09:50:50 user nova-compute[74342]: DEBUG nova.policy [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b737bb80f17840b3a6eb803bfc4966be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4171b62daa60407f8e53376cf27928a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:50:50 user nova-compute[74342]: DEBUG nova.compute.manager [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 09:50:50 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:50:50 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Creating image(s)
Oct 16 09:50:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Acquiring lock "/opt/stack/data/nova/instances/68e6e026-f958-40c4-ab99-19deaaa1590d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:50:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Lock "/opt/stack/data/nova/instances/68e6e026-f958-40c4-ab99-19deaaa1590d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:50:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Lock "/opt/stack/data/nova/instances/68e6e026-f958-40c4-ab99-19deaaa1590d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:50:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.191s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG nova.network.neutron [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Successfully updated port: 975f1cad-dbc7-462f-9702-55567afd639b {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "refresh_cache-2522364c-36c7-446d-87e7-113632ceeab6" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquired lock "refresh_cache-2522364c-36c7-446d-87e7-113632ceeab6" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG nova.network.neutron [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG nova.compute.manager [req-b3aa3a34-8ea5-4b9a-9d50-158e18da6023 req-e2d5f721-5531-4eb2-be9a-5065b72f957a service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Received event network-changed-975f1cad-dbc7-462f-9702-55567afd639b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG nova.compute.manager [req-b3aa3a34-8ea5-4b9a-9d50-158e18da6023 req-e2d5f721-5531-4eb2-be9a-5065b72f957a service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Refreshing instance network info cache due to event network-changed-975f1cad-dbc7-462f-9702-55567afd639b. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b3aa3a34-8ea5-4b9a-9d50-158e18da6023 req-e2d5f721-5531-4eb2-be9a-5065b72f957a service nova] Acquiring lock "refresh_cache-2522364c-36c7-446d-87e7-113632ceeab6" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG nova.network.neutron [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.233s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/68e6e026-f958-40c4-ab99-19deaaa1590d/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.802s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/68e6e026-f958-40c4-ab99-19deaaa1590d/disk 1073741824" returned: 0 in 0.094s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.332s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.190s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68e6e026-f958-40c4-ab99-19deaaa1590d/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e6e026-f958-40c4-ab99-19deaaa1590d/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG nova.network.neutron [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Successfully created port: 131daf10-9476-45b2-b7cc-4a0c345200c6 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG nova.network.neutron [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Updating instance_info_cache with network_info: [{"id": "975f1cad-dbc7-462f-9702-55567afd639b", "address": "fa:16:3e:18:9d:9a", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap975f1cad-db", "ovs_interfaceid": "975f1cad-dbc7-462f-9702-55567afd639b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e6e026-f958-40c4-ab99-19deaaa1590d/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Cannot resize image /opt/stack/data/nova/instances/68e6e026-f958-40c4-ab99-19deaaa1590d/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Ensure instance console log exists: /opt/stack/data/nova/instances/68e6e026-f958-40c4-ab99-19deaaa1590d/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Releasing lock "refresh_cache-2522364c-36c7-446d-87e7-113632ceeab6" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG nova.compute.manager [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Instance network_info: |[{"id": "975f1cad-dbc7-462f-9702-55567afd639b", "address": "fa:16:3e:18:9d:9a", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap975f1cad-db", "ovs_interfaceid": "975f1cad-dbc7-462f-9702-55567afd639b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b3aa3a34-8ea5-4b9a-9d50-158e18da6023 req-e2d5f721-5531-4eb2-be9a-5065b72f957a service nova] Acquired lock "refresh_cache-2522364c-36c7-446d-87e7-113632ceeab6" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:50:51 user nova-compute[74342]: DEBUG nova.network.neutron [req-b3aa3a34-8ea5-4b9a-9d50-158e18da6023 req-e2d5f721-5531-4eb2-be9a-5065b72f957a service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Refreshing network info cache for port 975f1cad-dbc7-462f-9702-55567afd639b {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:50:52 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance bdcd2e60-b36c-4d87-94d7-076e7430e1f0 is timed out.
Oct 16 09:50:52 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Successfully detached device vdb from instance bdcd2e60-b36c-4d87-94d7-076e7430e1f0 from the live domain config.
Oct 16 09:50:52 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'evTrnmNX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:50:52 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:50:52 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e7d8c1-5357-4941-8c46-622657015300]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 09:50:52 user nova-compute[74342]: No targets found.
Oct 16 09:50:52 user nova-compute[74342]: iSNS:
Oct 16 09:50:52 user nova-compute[74342]: No targets found.
Oct 16 09:50:52 user nova-compute[74342]: STATIC:
Oct 16 09:50:52 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc
Oct 16 09:50:52 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:50:52 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:50:52 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192
Oct 16 09:50:52 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:50:52 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:50:52 user nova-compute[74342]: FIRMWARE:
Oct 16 09:50:52 user nova-compute[74342]: No targets found.
Oct 16 09:50:52 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 09:50:52 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 09:50:52 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a4b9ee0-f127-4a60-8fcc-703d6f315afb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG nova.network.neutron [req-b3aa3a34-8ea5-4b9a-9d50-158e18da6023 req-e2d5f721-5531-4eb2-be9a-5065b72f957a service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Updated VIF entry in instance network info cache for port 975f1cad-dbc7-462f-9702-55567afd639b. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG nova.network.neutron [req-b3aa3a34-8ea5-4b9a-9d50-158e18da6023 req-e2d5f721-5531-4eb2-be9a-5065b72f957a service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Updating instance_info_cache with network_info: [{"id": "975f1cad-dbc7-462f-9702-55567afd639b", "address": "fa:16:3e:18:9d:9a", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap975f1cad-db", "ovs_interfaceid": "975f1cad-dbc7-462f-9702-55567afd639b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebad9c0-1cf4-451d-bd4c-744dd31f5ffc]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc (non-flash)
Oct 16 09:50:52 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:50:52 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc (non-flash)
Oct 16 09:50:52 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:50:52 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b83f3dd80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc'): ({'sdb'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Removing single pathed devices sdb {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b3aa3a34-8ea5-4b9a-9d50-158e18da6023 req-e2d5f721-5531-4eb2-be9a-5065b72f957a service nova] Releasing lock "refresh_cache-2522364c-36c7-446d-87e7-113632ceeab6" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a824410-9b2e-422f-a154-984864b840db]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac784d4c-c41f-445d-b27c-04d652da1ccb]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Flushing IO for device /dev/sdb {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[236f7d51-0ce3-4b03-84ef-c65e279552b1]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd2dd18-7f7f-441b-9677-02132712e3ef]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f2d70f4-5d1a-4e3f-a536-c62c9af8f1f3]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b15fa09-9c8b-4a9b-98a0-f628e1763b1b]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc, portal: 172.16.0.220,3260]
Oct 16 09:50:52 user nova-compute[74342]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc, portal: 172.16.0.220,3260] successful.
Oct 16 09:50:52 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG nova.network.neutron [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Successfully updated port: 131daf10-9476-45b2-b7cc-4a0c345200c6 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:642c6df7-21ee-41cb-b410-2b14cb878dbc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7de3dec1-2f92-4e68-89d2-4a1d60c4efa0]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] <== disconnect_volume: return (315ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Acquiring lock "refresh_cache-68e6e026-f958-40c4-ab99-19deaaa1590d" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Acquired lock "refresh_cache-68e6e026-f958-40c4-ab99-19deaaa1590d" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG nova.network.neutron [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:50:52 user nova-compute[74342]: DEBUG nova.network.neutron [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.network.neutron [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Updating instance_info_cache with network_info: [{"id": "131daf10-9476-45b2-b7cc-4a0c345200c6", "address": "fa:16:3e:1a:68:d9", "network": {"id": "9353d3f4-c47f-4475-b7f1-5dce1d6e742c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-464040346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4171b62daa60407f8e53376cf27928a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131daf10-94", "ovs_interfaceid": "131daf10-9476-45b2-b7cc-4a0c345200c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.compute.manager [req-2a5735ed-fcf0-4bd9-b12f-8ba40b2db8a6 req-e02bc5c5-824e-4f19-91ea-5b9ad9deb0ed service nova] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Received event network-changed-131daf10-9476-45b2-b7cc-4a0c345200c6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.compute.manager [req-2a5735ed-fcf0-4bd9-b12f-8ba40b2db8a6 req-e02bc5c5-824e-4f19-91ea-5b9ad9deb0ed service nova] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Refreshing instance network info cache due to event network-changed-131daf10-9476-45b2-b7cc-4a0c345200c6. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-2a5735ed-fcf0-4bd9-b12f-8ba40b2db8a6 req-e02bc5c5-824e-4f19-91ea-5b9ad9deb0ed service nova] Acquiring lock "refresh_cache-68e6e026-f958-40c4-ab99-19deaaa1590d" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Releasing lock "refresh_cache-68e6e026-f958-40c4-ab99-19deaaa1590d" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.compute.manager [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Instance network_info: |[{"id": "131daf10-9476-45b2-b7cc-4a0c345200c6", "address": "fa:16:3e:1a:68:d9", "network": {"id": "9353d3f4-c47f-4475-b7f1-5dce1d6e742c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-464040346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4171b62daa60407f8e53376cf27928a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131daf10-94", "ovs_interfaceid": "131daf10-9476-45b2-b7cc-4a0c345200c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-2a5735ed-fcf0-4bd9-b12f-8ba40b2db8a6 req-e02bc5c5-824e-4f19-91ea-5b9ad9deb0ed service nova] Acquired lock "refresh_cache-68e6e026-f958-40c4-ab99-19deaaa1590d" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.network.neutron [req-2a5735ed-fcf0-4bd9-b12f-8ba40b2db8a6 req-e02bc5c5-824e-4f19-91ea-5b9ad9deb0ed service nova] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Refreshing network info cache for port 131daf10-9476-45b2-b7cc-4a0c345200c6 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Start _get_guest_xml network_info=[{"id": "131daf10-9476-45b2-b7cc-4a0c345200c6", "address": "fa:16:3e:1a:68:d9", "network": {"id": "9353d3f4-c47f-4475-b7f1-5dce1d6e742c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-464040346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4171b62daa60407f8e53376cf27928a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131daf10-94", "ovs_interfaceid": "131daf10-9476-45b2-b7cc-4a0c345200c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:50:53 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:50:53 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:50:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1104153645',display_name='tempest-VolumesActionsTest-instance-1104153645',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1104153645',id=20,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4171b62daa60407f8e53376cf27928a2',ramdisk_id='',reservation_id='r-ldh07k9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-903466454',owner_user_name='tempest-VolumesActionsTest-903466454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:50:51Z,user_data=None,user_id='b737bb80f17840b3a6eb803bfc4966be',uuid=68e6e026-f958-40c4-ab99-19deaaa1590d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "131daf10-9476-45b2-b7cc-4a0c345200c6", "address": "fa:16:3e:1a:68:d9", "network": {"id": "9353d3f4-c47f-4475-b7f1-5dce1d6e742c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-464040346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4171b62daa60407f8e53376cf27928a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131daf10-94", "ovs_interfaceid": "131daf10-9476-45b2-b7cc-4a0c345200c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Converting VIF {"id": "131daf10-9476-45b2-b7cc-4a0c345200c6", "address": "fa:16:3e:1a:68:d9", "network": {"id": "9353d3f4-c47f-4475-b7f1-5dce1d6e742c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-464040346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4171b62daa60407f8e53376cf27928a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131daf10-94", "ovs_interfaceid": "131daf10-9476-45b2-b7cc-4a0c345200c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:68:d9,bridge_name='br-int',has_traffic_filtering=True,id=131daf10-9476-45b2-b7cc-4a0c345200c6,network=Network(9353d3f4-c47f-4475-b7f1-5dce1d6e742c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap131daf10-94') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.objects.instance [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Lazy-loading 'pci_devices' on Instance uuid 68e6e026-f958-40c4-ab99-19deaaa1590d {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:50:53 user nova-compute[74342]:   <uuid>68e6e026-f958-40c4-ab99-19deaaa1590d</uuid>
Oct 16 09:50:53 user nova-compute[74342]:   <name>instance-00000014</name>
Oct 16 09:50:53 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:50:53 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:50:53 user nova-compute[74342]:   <metadata>
Oct 16 09:50:53 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:50:53 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:50:53 user nova-compute[74342]:       <nova:name>tempest-VolumesActionsTest-instance-1104153645</nova:name>
Oct 16 09:50:53 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:50:53</nova:creationTime>
Oct 16 09:50:53 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:50:53 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:50:53 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:50:53 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:50:53 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:50:53 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:50:53 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:50:53 user nova-compute[74342]:       <nova:owner>
Oct 16 09:50:53 user nova-compute[74342]:         <nova:user uuid="b737bb80f17840b3a6eb803bfc4966be">tempest-VolumesActionsTest-903466454-project-member</nova:user>
Oct 16 09:50:53 user nova-compute[74342]:         <nova:project uuid="4171b62daa60407f8e53376cf27928a2">tempest-VolumesActionsTest-903466454</nova:project>
Oct 16 09:50:53 user nova-compute[74342]:       </nova:owner>
Oct 16 09:50:53 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:50:53 user nova-compute[74342]:       <nova:ports>
Oct 16 09:50:53 user nova-compute[74342]:         <nova:port uuid="131daf10-9476-45b2-b7cc-4a0c345200c6">
Oct 16 09:50:53 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 16 09:50:53 user nova-compute[74342]:         </nova:port>
Oct 16 09:50:53 user nova-compute[74342]:       </nova:ports>
Oct 16 09:50:53 user nova-compute[74342]:     </nova:instance>
Oct 16 09:50:53 user nova-compute[74342]:   </metadata>
Oct 16 09:50:53 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:50:53 user nova-compute[74342]:     <system>
Oct 16 09:50:53 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:50:53 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:50:53 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:50:53 user nova-compute[74342]:       <entry name="serial">68e6e026-f958-40c4-ab99-19deaaa1590d</entry>
Oct 16 09:50:53 user nova-compute[74342]:       <entry name="uuid">68e6e026-f958-40c4-ab99-19deaaa1590d</entry>
Oct 16 09:50:53 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:50:53 user nova-compute[74342]:     </system>
Oct 16 09:50:53 user nova-compute[74342]:   </sysinfo>
Oct 16 09:50:53 user nova-compute[74342]:   <os>
Oct 16 09:50:53 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:50:53 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:50:53 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:50:53 user nova-compute[74342]:   </os>
Oct 16 09:50:53 user nova-compute[74342]:   <features>
Oct 16 09:50:53 user nova-compute[74342]:     <acpi/>
Oct 16 09:50:53 user nova-compute[74342]:     <apic/>
Oct 16 09:50:53 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:50:53 user nova-compute[74342]:   </features>
Oct 16 09:50:53 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:50:53 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:50:53 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:50:53 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:50:53 user nova-compute[74342]:   </clock>
Oct 16 09:50:53 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:50:53 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:50:53 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:50:53 user nova-compute[74342]:   </cpu>
Oct 16 09:50:53 user nova-compute[74342]:   <devices>
Oct 16 09:50:53 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 09:50:53 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 09:50:53 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/68e6e026-f958-40c4-ab99-19deaaa1590d/disk"/>
Oct 16 09:50:53 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:50:53 user nova-compute[74342]:     </disk>
Oct 16 09:50:53 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:50:53 user nova-compute[74342]:       <mac address="fa:16:3e:1a:68:d9"/>
Oct 16 09:50:53 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:50:53 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:50:53 user nova-compute[74342]:       <target dev="tap131daf10-94"/>
Oct 16 09:50:53 user nova-compute[74342]:     </interface>
Oct 16 09:50:53 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:50:53 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/68e6e026-f958-40c4-ab99-19deaaa1590d/console.log" append="off"/>
Oct 16 09:50:53 user nova-compute[74342]:     </serial>
Oct 16 09:50:53 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:50:53 user nova-compute[74342]:     <video>
Oct 16 09:50:53 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:50:53 user nova-compute[74342]:     </video>
Oct 16 09:50:53 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:50:53 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:50:53 user nova-compute[74342]:     </rng>
Oct 16 09:50:53 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:50:53 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:50:53 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:50:53 user nova-compute[74342]:     </memballoon>
Oct 16 09:50:53 user nova-compute[74342]:   </devices>
Oct 16 09:50:53 user nova-compute[74342]: </domain>
Oct 16 09:50:53 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:50:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1104153645',display_name='tempest-VolumesActionsTest-instance-1104153645',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1104153645',id=20,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4171b62daa60407f8e53376cf27928a2',ramdisk_id='',reservation_id='r-ldh07k9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-903466454',owner_user_name='tempest-VolumesActionsTest-903466454-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:50:51Z,user_data=None,user_id='b737bb80f17840b3a6eb803bfc4966be',uuid=68e6e026-f958-40c4-ab99-19deaaa1590d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "131daf10-9476-45b2-b7cc-4a0c345200c6", "address": "fa:16:3e:1a:68:d9", "network": {"id": "9353d3f4-c47f-4475-b7f1-5dce1d6e742c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-464040346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4171b62daa60407f8e53376cf27928a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131daf10-94", "ovs_interfaceid": "131daf10-9476-45b2-b7cc-4a0c345200c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Converting VIF {"id": "131daf10-9476-45b2-b7cc-4a0c345200c6", "address": "fa:16:3e:1a:68:d9", "network": {"id": "9353d3f4-c47f-4475-b7f1-5dce1d6e742c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-464040346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4171b62daa60407f8e53376cf27928a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131daf10-94", "ovs_interfaceid": "131daf10-9476-45b2-b7cc-4a0c345200c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:68:d9,bridge_name='br-int',has_traffic_filtering=True,id=131daf10-9476-45b2-b7cc-4a0c345200c6,network=Network(9353d3f4-c47f-4475-b7f1-5dce1d6e742c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap131daf10-94') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG os_vif [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:68:d9,bridge_name='br-int',has_traffic_filtering=True,id=131daf10-9476-45b2-b7cc-4a0c345200c6,network=Network(9353d3f4-c47f-4475-b7f1-5dce1d6e742c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap131daf10-94') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '50096fed-c093-5a97-9796-1c56ab3da541', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap131daf10-94, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap131daf10-94, col_values=(('qos', UUID('08f5e6a5-f196-4733-b20e-bc0e1595af09')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap131daf10-94, col_values=(('external_ids', {'iface-id': '131daf10-9476-45b2-b7cc-4a0c345200c6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1a:68:d9', 'vm-uuid': '68e6e026-f958-40c4-ab99-19deaaa1590d'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:53 user nova-compute[74342]: INFO os_vif [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:68:d9,bridge_name='br-int',has_traffic_filtering=True,id=131daf10-9476-45b2-b7cc-4a0c345200c6,network=Network(9353d3f4-c47f-4475-b7f1-5dce1d6e742c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap131daf10-94')
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] No VIF found with MAC fa:16:3e:1a:68:d9, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG nova.objects.instance [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lazy-loading 'flavor' on Instance uuid bdcd2e60-b36c-4d87-94d7-076e7430e1f0 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9ba76fdd-2712-4b31-bc9f-a140b7b28ac3 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.035s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:50:54 user nova-compute[74342]: DEBUG nova.network.neutron [req-2a5735ed-fcf0-4bd9-b12f-8ba40b2db8a6 req-e02bc5c5-824e-4f19-91ea-5b9ad9deb0ed service nova] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Updated VIF entry in instance network info cache for port 131daf10-9476-45b2-b7cc-4a0c345200c6. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:50:54 user nova-compute[74342]: DEBUG nova.network.neutron [req-2a5735ed-fcf0-4bd9-b12f-8ba40b2db8a6 req-e02bc5c5-824e-4f19-91ea-5b9ad9deb0ed service nova] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Updating instance_info_cache with network_info: [{"id": "131daf10-9476-45b2-b7cc-4a0c345200c6", "address": "fa:16:3e:1a:68:d9", "network": {"id": "9353d3f4-c47f-4475-b7f1-5dce1d6e742c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-464040346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4171b62daa60407f8e53376cf27928a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131daf10-94", "ovs_interfaceid": "131daf10-9476-45b2-b7cc-4a0c345200c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:50:54 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:50:54 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:50:54 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 09:50:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-2a5735ed-fcf0-4bd9-b12f-8ba40b2db8a6 req-e02bc5c5-824e-4f19-91ea-5b9ad9deb0ed service nova] Releasing lock "refresh_cache-68e6e026-f958-40c4-ab99-19deaaa1590d" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:50:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-98367a96-22f0-4edb-ab03-a8eb286b437b" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:50:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-98367a96-22f0-4edb-ab03-a8eb286b437b" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:50:54 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 09:50:54 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:54 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:54 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:55 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Updating instance_info_cache with network_info: [{"id": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "address": "fa:16:3e:7a:58:71", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f58c77-45", "ovs_interfaceid": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:50:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-98367a96-22f0-4edb-ab03-a8eb286b437b" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:50:55 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 09:50:55 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:50:55 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:50:55 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:50:55 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:50:55 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:50:55 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 09:50:55 user nova-compute[74342]: DEBUG nova.compute.manager [req-a18336ae-d4c3-48bc-8649-574f09514798 req-7d28fb87-2de3-48e1-b403-759f3a30ce2d service nova] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Received event network-vif-plugged-131daf10-9476-45b2-b7cc-4a0c345200c6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:50:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a18336ae-d4c3-48bc-8649-574f09514798 req-7d28fb87-2de3-48e1-b403-759f3a30ce2d service nova] Acquiring lock "68e6e026-f958-40c4-ab99-19deaaa1590d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:50:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a18336ae-d4c3-48bc-8649-574f09514798 req-7d28fb87-2de3-48e1-b403-759f3a30ce2d service nova] Lock "68e6e026-f958-40c4-ab99-19deaaa1590d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:50:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a18336ae-d4c3-48bc-8649-574f09514798 req-7d28fb87-2de3-48e1-b403-759f3a30ce2d service nova] Lock "68e6e026-f958-40c4-ab99-19deaaa1590d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:50:55 user nova-compute[74342]: DEBUG nova.compute.manager [req-a18336ae-d4c3-48bc-8649-574f09514798 req-7d28fb87-2de3-48e1-b403-759f3a30ce2d service nova] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] No waiting events found dispatching network-vif-plugged-131daf10-9476-45b2-b7cc-4a0c345200c6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:50:55 user nova-compute[74342]: WARNING nova.compute.manager [req-a18336ae-d4c3-48bc-8649-574f09514798 req-7d28fb87-2de3-48e1-b403-759f3a30ce2d service nova] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Received unexpected event network-vif-plugged-131daf10-9476-45b2-b7cc-4a0c345200c6 for instance with vm_state building and task_state spawning.
Oct 16 09:50:55 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:55 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:55 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:55 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:55 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:56 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:50:57 user nova-compute[74342]: DEBUG nova.compute.manager [req-27211b33-8520-46f8-a6ab-ffbc4c2028ce req-1f5abad8-50ef-4826-b6ec-203256726291 service nova] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Received event network-changed-7fdd8609-f23f-4572-aa9b-68cdb668df83 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:50:57 user nova-compute[74342]: DEBUG nova.compute.manager [req-27211b33-8520-46f8-a6ab-ffbc4c2028ce req-1f5abad8-50ef-4826-b6ec-203256726291 service nova] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Refreshing instance network info cache due to event network-changed-7fdd8609-f23f-4572-aa9b-68cdb668df83. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:50:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-27211b33-8520-46f8-a6ab-ffbc4c2028ce req-1f5abad8-50ef-4826-b6ec-203256726291 service nova] Acquiring lock "refresh_cache-3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:50:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-27211b33-8520-46f8-a6ab-ffbc4c2028ce req-1f5abad8-50ef-4826-b6ec-203256726291 service nova] Acquired lock "refresh_cache-3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:50:57 user nova-compute[74342]: DEBUG nova.network.neutron [req-27211b33-8520-46f8-a6ab-ffbc4c2028ce req-1f5abad8-50ef-4826-b6ec-203256726291 service nova] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Refreshing network info cache for port 7fdd8609-f23f-4572-aa9b-68cdb668df83 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:50:57 user nova-compute[74342]: DEBUG nova.compute.manager [req-bb62beae-d6d5-425e-90d7-c13275dd3d9f req-34bcd004-10fd-4626-835d-bec743b911bc service nova] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Received event network-vif-plugged-131daf10-9476-45b2-b7cc-4a0c345200c6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:50:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-bb62beae-d6d5-425e-90d7-c13275dd3d9f req-34bcd004-10fd-4626-835d-bec743b911bc service nova] Acquiring lock "68e6e026-f958-40c4-ab99-19deaaa1590d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:50:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-bb62beae-d6d5-425e-90d7-c13275dd3d9f req-34bcd004-10fd-4626-835d-bec743b911bc service nova] Lock "68e6e026-f958-40c4-ab99-19deaaa1590d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:50:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-bb62beae-d6d5-425e-90d7-c13275dd3d9f req-34bcd004-10fd-4626-835d-bec743b911bc service nova] Lock "68e6e026-f958-40c4-ab99-19deaaa1590d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:50:57 user nova-compute[74342]: DEBUG nova.compute.manager [req-bb62beae-d6d5-425e-90d7-c13275dd3d9f req-34bcd004-10fd-4626-835d-bec743b911bc service nova] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] No waiting events found dispatching network-vif-plugged-131daf10-9476-45b2-b7cc-4a0c345200c6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:50:57 user nova-compute[74342]: WARNING nova.compute.manager [req-bb62beae-d6d5-425e-90d7-c13275dd3d9f req-34bcd004-10fd-4626-835d-bec743b911bc service nova] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Received unexpected event network-vif-plugged-131daf10-9476-45b2-b7cc-4a0c345200c6 for instance with vm_state building and task_state spawning.
Oct 16 09:50:57 user nova-compute[74342]: DEBUG nova.network.neutron [req-27211b33-8520-46f8-a6ab-ffbc4c2028ce req-1f5abad8-50ef-4826-b6ec-203256726291 service nova] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Updated VIF entry in instance network info cache for port 7fdd8609-f23f-4572-aa9b-68cdb668df83. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:50:57 user nova-compute[74342]: DEBUG nova.network.neutron [req-27211b33-8520-46f8-a6ab-ffbc4c2028ce req-1f5abad8-50ef-4826-b6ec-203256726291 service nova] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Updating instance_info_cache with network_info: [{"id": "7fdd8609-f23f-4572-aa9b-68cdb668df83", "address": "fa:16:3e:4f:14:0e", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fdd8609-f2", "ovs_interfaceid": "7fdd8609-f23f-4572-aa9b-68cdb668df83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:50:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-27211b33-8520-46f8-a6ab-ffbc4c2028ce req-1f5abad8-50ef-4826-b6ec-203256726291 service nova] Releasing lock "refresh_cache-3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:50:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:58 user nova-compute[74342]: DEBUG nova.compute.manager [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:50:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:50:58 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Instance spawned successfully.
Oct 16 09:50:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:50:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:50:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:50:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:50:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:50:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:50:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:50:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Acquiring lock "a9a7676e-87d8-4e8a-832a-67a5470f16a1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:50:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lock "a9a7676e-87d8-4e8a-832a-67a5470f16a1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:50:58 user nova-compute[74342]: INFO nova.compute.manager [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Took 7.33 seconds to spawn the instance on the hypervisor.
Oct 16 09:50:58 user nova-compute[74342]: DEBUG nova.compute.manager [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:50:58 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:50:58 user nova-compute[74342]: INFO nova.compute.manager [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Took 8.83 seconds to build instance.
Oct 16 09:50:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b2c5fb4b-15b4-4afe-b1f2-12c69f432034 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Lock "68e6e026-f958-40c4-ab99-19deaaa1590d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.985s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:50:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:50:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:50:58 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:50:58 user nova-compute[74342]: INFO nova.compute.claims [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Claim successful on node user
Oct 16 09:50:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:50:58 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:50:58 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:50:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.685s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:50:58 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:50:59 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:50:59 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:50:59 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:50:59 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:50:59 user nova-compute[74342]: DEBUG nova.policy [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '59c0aa59cd974bdaaa893eb31c87222f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c305573fde27434282f0e3098415298d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:50:59 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 09:50:59 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:50:59 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Creating image(s)
Oct 16 09:50:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Acquiring lock "/opt/stack/data/nova/instances/a9a7676e-87d8-4e8a-832a-67a5470f16a1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:50:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lock "/opt/stack/data/nova/instances/a9a7676e-87d8-4e8a-832a-67a5470f16a1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:50:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lock "/opt/stack/data/nova/instances/a9a7676e-87d8-4e8a-832a-67a5470f16a1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:50:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.227s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:50:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:50:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.201s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/a9a7676e-87d8-4e8a-832a-67a5470f16a1/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/a9a7676e-87d8-4e8a-832a-67a5470f16a1/disk 1073741824" returned: 0 in 0.057s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:50:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:50:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:50:59 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Successfully created port: 4cea4774-6a45-4adc-8019-ffda4c7253cb {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:51:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.226s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:00 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a9a7676e-87d8-4e8a-832a-67a5470f16a1/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 09:51:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a7676e-87d8-4e8a-832a-67a5470f16a1/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a7676e-87d8-4e8a-832a-67a5470f16a1/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:00 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Cannot resize image /opt/stack/data/nova/instances/a9a7676e-87d8-4e8a-832a-67a5470f16a1/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 09:51:00 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 09:51:00 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Ensure instance console log exists: /opt/stack/data/nova/instances/a9a7676e-87d8-4e8a-832a-67a5470f16a1/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:51:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:00 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Successfully updated port: 4cea4774-6a45-4adc-8019-ffda4c7253cb {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:51:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Acquiring lock "refresh_cache-a9a7676e-87d8-4e8a-832a-67a5470f16a1" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:51:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Acquired lock "refresh_cache-a9a7676e-87d8-4e8a-832a-67a5470f16a1" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:51:00 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:51:00 user nova-compute[74342]: DEBUG nova.compute.manager [req-3d81d488-4c19-462e-b4bb-471b91cfca14 req-32153d4a-97f4-4846-9a8f-4fdd52d1547b service nova] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Received event network-changed-4cea4774-6a45-4adc-8019-ffda4c7253cb {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:51:00 user nova-compute[74342]: DEBUG nova.compute.manager [req-3d81d488-4c19-462e-b4bb-471b91cfca14 req-32153d4a-97f4-4846-9a8f-4fdd52d1547b service nova] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Refreshing instance network info cache due to event network-changed-4cea4774-6a45-4adc-8019-ffda4c7253cb. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:51:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-3d81d488-4c19-462e-b4bb-471b91cfca14 req-32153d4a-97f4-4846-9a8f-4fdd52d1547b service nova] Acquiring lock "refresh_cache-a9a7676e-87d8-4e8a-832a-67a5470f16a1" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:51:00 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Updating instance_info_cache with network_info: [{"id": "4cea4774-6a45-4adc-8019-ffda4c7253cb", "address": "fa:16:3e:cc:84:df", "network": {"id": "0b3a3bbd-b156-44ad-bffa-4248d61babfe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-567602513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c305573fde27434282f0e3098415298d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cea4774-6a", "ovs_interfaceid": "4cea4774-6a45-4adc-8019-ffda4c7253cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Releasing lock "refresh_cache-a9a7676e-87d8-4e8a-832a-67a5470f16a1" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Instance network_info: |[{"id": "4cea4774-6a45-4adc-8019-ffda4c7253cb", "address": "fa:16:3e:cc:84:df", "network": {"id": "0b3a3bbd-b156-44ad-bffa-4248d61babfe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-567602513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c305573fde27434282f0e3098415298d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cea4774-6a", "ovs_interfaceid": "4cea4774-6a45-4adc-8019-ffda4c7253cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-3d81d488-4c19-462e-b4bb-471b91cfca14 req-32153d4a-97f4-4846-9a8f-4fdd52d1547b service nova] Acquired lock "refresh_cache-a9a7676e-87d8-4e8a-832a-67a5470f16a1" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG nova.network.neutron [req-3d81d488-4c19-462e-b4bb-471b91cfca14 req-32153d4a-97f4-4846-9a8f-4fdd52d1547b service nova] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Refreshing network info cache for port 4cea4774-6a45-4adc-8019-ffda4c7253cb {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Start _get_guest_xml network_info=[{"id": "4cea4774-6a45-4adc-8019-ffda4c7253cb", "address": "fa:16:3e:cc:84:df", "network": {"id": "0b3a3bbd-b156-44ad-bffa-4248d61babfe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-567602513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c305573fde27434282f0e3098415298d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cea4774-6a", "ovs_interfaceid": "4cea4774-6a45-4adc-8019-ffda4c7253cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:51:01 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:51:01 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:51:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:50:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-78558754',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-78558754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7855875',id=21,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA+jEHNKD+6U8xW2OFDjJMQLHPhVunqe9i+g4Tu13BHF5vu58SjwzUzgNRHP++ShSGk7ueWxIgcSBB4T26ICAfNWMl5UQLdctDyI5rJfHUrbFXp4RuXz8Hko7uaz4a3mA==',key_name='tempest-keypair-519645125',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c305573fde27434282f0e3098415298d',ramdisk_id='',reservation_id='r-lw30a69m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-618744753',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:50:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59c0aa59cd974bdaaa893eb31c87222f',uuid=a9a7676e-87d8-4e8a-832a-67a5470f16a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cea4774-6a45-4adc-8019-ffda4c7253cb", "address": "fa:16:3e:cc:84:df", "network": {"id": "0b3a3bbd-b156-44ad-bffa-4248d61babfe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-567602513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c305573fde27434282f0e3098415298d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cea4774-6a", "ovs_interfaceid": "4cea4774-6a45-4adc-8019-ffda4c7253cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Converting VIF {"id": "4cea4774-6a45-4adc-8019-ffda4c7253cb", "address": "fa:16:3e:cc:84:df", "network": {"id": "0b3a3bbd-b156-44ad-bffa-4248d61babfe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-567602513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c305573fde27434282f0e3098415298d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cea4774-6a", "ovs_interfaceid": "4cea4774-6a45-4adc-8019-ffda4c7253cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:84:df,bridge_name='br-int',has_traffic_filtering=True,id=4cea4774-6a45-4adc-8019-ffda4c7253cb,network=Network(0b3a3bbd-b156-44ad-bffa-4248d61babfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cea4774-6a') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lazy-loading 'pci_devices' on Instance uuid a9a7676e-87d8-4e8a-832a-67a5470f16a1 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:51:01 user nova-compute[74342]:   <uuid>a9a7676e-87d8-4e8a-832a-67a5470f16a1</uuid>
Oct 16 09:51:01 user nova-compute[74342]:   <name>instance-00000015</name>
Oct 16 09:51:01 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:51:01 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:51:01 user nova-compute[74342]:   <metadata>
Oct 16 09:51:01 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:51:01 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:51:01 user nova-compute[74342]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-78558754</nova:name>
Oct 16 09:51:01 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:51:01</nova:creationTime>
Oct 16 09:51:01 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:51:01 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:51:01 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:51:01 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:51:01 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:51:01 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:51:01 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:51:01 user nova-compute[74342]:       <nova:owner>
Oct 16 09:51:01 user nova-compute[74342]:         <nova:user uuid="59c0aa59cd974bdaaa893eb31c87222f">tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member</nova:user>
Oct 16 09:51:01 user nova-compute[74342]:         <nova:project uuid="c305573fde27434282f0e3098415298d">tempest-TestServerVolumeAttachScenarioOldVersion-618744753</nova:project>
Oct 16 09:51:01 user nova-compute[74342]:       </nova:owner>
Oct 16 09:51:01 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:51:01 user nova-compute[74342]:       <nova:ports>
Oct 16 09:51:01 user nova-compute[74342]:         <nova:port uuid="4cea4774-6a45-4adc-8019-ffda4c7253cb">
Oct 16 09:51:01 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 16 09:51:01 user nova-compute[74342]:         </nova:port>
Oct 16 09:51:01 user nova-compute[74342]:       </nova:ports>
Oct 16 09:51:01 user nova-compute[74342]:     </nova:instance>
Oct 16 09:51:01 user nova-compute[74342]:   </metadata>
Oct 16 09:51:01 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:51:01 user nova-compute[74342]:     <system>
Oct 16 09:51:01 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:51:01 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:51:01 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:51:01 user nova-compute[74342]:       <entry name="serial">a9a7676e-87d8-4e8a-832a-67a5470f16a1</entry>
Oct 16 09:51:01 user nova-compute[74342]:       <entry name="uuid">a9a7676e-87d8-4e8a-832a-67a5470f16a1</entry>
Oct 16 09:51:01 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:51:01 user nova-compute[74342]:     </system>
Oct 16 09:51:01 user nova-compute[74342]:   </sysinfo>
Oct 16 09:51:01 user nova-compute[74342]:   <os>
Oct 16 09:51:01 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:51:01 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:51:01 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:51:01 user nova-compute[74342]:   </os>
Oct 16 09:51:01 user nova-compute[74342]:   <features>
Oct 16 09:51:01 user nova-compute[74342]:     <acpi/>
Oct 16 09:51:01 user nova-compute[74342]:     <apic/>
Oct 16 09:51:01 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:51:01 user nova-compute[74342]:   </features>
Oct 16 09:51:01 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:51:01 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:51:01 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:51:01 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:51:01 user nova-compute[74342]:   </clock>
Oct 16 09:51:01 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:51:01 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:51:01 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:51:01 user nova-compute[74342]:   </cpu>
Oct 16 09:51:01 user nova-compute[74342]:   <devices>
Oct 16 09:51:01 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 09:51:01 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 09:51:01 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/a9a7676e-87d8-4e8a-832a-67a5470f16a1/disk"/>
Oct 16 09:51:01 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:51:01 user nova-compute[74342]:     </disk>
Oct 16 09:51:01 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:51:01 user nova-compute[74342]:       <mac address="fa:16:3e:cc:84:df"/>
Oct 16 09:51:01 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:51:01 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:51:01 user nova-compute[74342]:       <target dev="tap4cea4774-6a"/>
Oct 16 09:51:01 user nova-compute[74342]:     </interface>
Oct 16 09:51:01 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:51:01 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/a9a7676e-87d8-4e8a-832a-67a5470f16a1/console.log" append="off"/>
Oct 16 09:51:01 user nova-compute[74342]:     </serial>
Oct 16 09:51:01 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:51:01 user nova-compute[74342]:     <video>
Oct 16 09:51:01 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:51:01 user nova-compute[74342]:     </video>
Oct 16 09:51:01 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:51:01 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:51:01 user nova-compute[74342]:     </rng>
Oct 16 09:51:01 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:51:01 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:51:01 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:51:01 user nova-compute[74342]:     </memballoon>
Oct 16 09:51:01 user nova-compute[74342]:   </devices>
Oct 16 09:51:01 user nova-compute[74342]: </domain>
Oct 16 09:51:01 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:50:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-78558754',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-78558754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7855875',id=21,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA+jEHNKD+6U8xW2OFDjJMQLHPhVunqe9i+g4Tu13BHF5vu58SjwzUzgNRHP++ShSGk7ueWxIgcSBB4T26ICAfNWMl5UQLdctDyI5rJfHUrbFXp4RuXz8Hko7uaz4a3mA==',key_name='tempest-keypair-519645125',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c305573fde27434282f0e3098415298d',ramdisk_id='',reservation_id='r-lw30a69m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-618744753',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:50:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59c0aa59cd974bdaaa893eb31c87222f',uuid=a9a7676e-87d8-4e8a-832a-67a5470f16a1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4cea4774-6a45-4adc-8019-ffda4c7253cb", "address": "fa:16:3e:cc:84:df", "network": {"id": "0b3a3bbd-b156-44ad-bffa-4248d61babfe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-567602513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c305573fde27434282f0e3098415298d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cea4774-6a", "ovs_interfaceid": "4cea4774-6a45-4adc-8019-ffda4c7253cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Converting VIF {"id": "4cea4774-6a45-4adc-8019-ffda4c7253cb", "address": "fa:16:3e:cc:84:df", "network": {"id": "0b3a3bbd-b156-44ad-bffa-4248d61babfe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-567602513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c305573fde27434282f0e3098415298d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cea4774-6a", "ovs_interfaceid": "4cea4774-6a45-4adc-8019-ffda4c7253cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cc:84:df,bridge_name='br-int',has_traffic_filtering=True,id=4cea4774-6a45-4adc-8019-ffda4c7253cb,network=Network(0b3a3bbd-b156-44ad-bffa-4248d61babfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cea4774-6a') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG os_vif [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:84:df,bridge_name='br-int',has_traffic_filtering=True,id=4cea4774-6a45-4adc-8019-ffda4c7253cb,network=Network(0b3a3bbd-b156-44ad-bffa-4248d61babfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cea4774-6a') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ca06f61c-8333-572a-8b39-284f5a9445dc', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4cea4774-6a, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4cea4774-6a, col_values=(('qos', UUID('047ca08c-0781-4878-9009-3d68f70ab5ab')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4cea4774-6a, col_values=(('external_ids', {'iface-id': '4cea4774-6a45-4adc-8019-ffda4c7253cb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cc:84:df', 'vm-uuid': 'a9a7676e-87d8-4e8a-832a-67a5470f16a1'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:01 user nova-compute[74342]: INFO os_vif [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cc:84:df,bridge_name='br-int',has_traffic_filtering=True,id=4cea4774-6a45-4adc-8019-ffda4c7253cb,network=Network(0b3a3bbd-b156-44ad-bffa-4248d61babfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cea4774-6a')
Oct 16 09:51:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:51:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] No VIF found with MAC fa:16:3e:cc:84:df, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:51:02 user nova-compute[74342]: DEBUG nova.network.neutron [req-3d81d488-4c19-462e-b4bb-471b91cfca14 req-32153d4a-97f4-4846-9a8f-4fdd52d1547b service nova] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Updated VIF entry in instance network info cache for port 4cea4774-6a45-4adc-8019-ffda4c7253cb. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:51:02 user nova-compute[74342]: DEBUG nova.network.neutron [req-3d81d488-4c19-462e-b4bb-471b91cfca14 req-32153d4a-97f4-4846-9a8f-4fdd52d1547b service nova] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Updating instance_info_cache with network_info: [{"id": "4cea4774-6a45-4adc-8019-ffda4c7253cb", "address": "fa:16:3e:cc:84:df", "network": {"id": "0b3a3bbd-b156-44ad-bffa-4248d61babfe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-567602513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c305573fde27434282f0e3098415298d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cea4774-6a", "ovs_interfaceid": "4cea4774-6a45-4adc-8019-ffda4c7253cb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:51:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-3d81d488-4c19-462e-b4bb-471b91cfca14 req-32153d4a-97f4-4846-9a8f-4fdd52d1547b service nova] Releasing lock "refresh_cache-a9a7676e-87d8-4e8a-832a-67a5470f16a1" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:51:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:03 user nova-compute[74342]: DEBUG nova.objects.instance [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lazy-loading 'flavor' on Instance uuid 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:51:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:03 user nova-compute[74342]: DEBUG nova.compute.manager [req-3191a31f-3b44-4382-aae3-7c16c8669474 req-25b665ff-a7f7-4c47-a34a-982bcf8f3615 service nova] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Received event network-vif-plugged-4cea4774-6a45-4adc-8019-ffda4c7253cb {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:51:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-3191a31f-3b44-4382-aae3-7c16c8669474 req-25b665ff-a7f7-4c47-a34a-982bcf8f3615 service nova] Acquiring lock "a9a7676e-87d8-4e8a-832a-67a5470f16a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-3191a31f-3b44-4382-aae3-7c16c8669474 req-25b665ff-a7f7-4c47-a34a-982bcf8f3615 service nova] Lock "a9a7676e-87d8-4e8a-832a-67a5470f16a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-3191a31f-3b44-4382-aae3-7c16c8669474 req-25b665ff-a7f7-4c47-a34a-982bcf8f3615 service nova] Lock "a9a7676e-87d8-4e8a-832a-67a5470f16a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:03 user nova-compute[74342]: DEBUG nova.compute.manager [req-3191a31f-3b44-4382-aae3-7c16c8669474 req-25b665ff-a7f7-4c47-a34a-982bcf8f3615 service nova] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] No waiting events found dispatching network-vif-plugged-4cea4774-6a45-4adc-8019-ffda4c7253cb {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:51:03 user nova-compute[74342]: WARNING nova.compute.manager [req-3191a31f-3b44-4382-aae3-7c16c8669474 req-25b665ff-a7f7-4c47-a34a-982bcf8f3615 service nova] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Received unexpected event network-vif-plugged-4cea4774-6a45-4adc-8019-ffda4c7253cb for instance with vm_state building and task_state spawning.
Oct 16 09:51:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:03 user nova-compute[74342]: INFO nova.compute.manager [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Attaching volume 98a7eb7a-b514-4dde-858c-4f0676d16f84 to /dev/vdb
Oct 16 09:51:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:03 user nova-compute[74342]: DEBUG os_brick.utils [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:51:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:04 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[baa71991-e8a9-4984-85dc-ba1c023139e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:04 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[83900aa3-3b8b-44ad-8980-02472e49e63b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:04 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb52932-78f3-45d7-9d43-c7291a807ea0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:04 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7299b84d-4462-4b15-87bf-d6814b717a37]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:51:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:51:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:51:04 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:51:04 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a02aa406-a739-4a33-9ff3-5748a95d03e7]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:51:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:51:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:51:04 user nova-compute[74342]: DEBUG os_brick.utils [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:51:04 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Updating existing volume attachment record: 185ffcd7-0042-45a1-b620-ede23da9ccc4 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 09:51:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG os_brick.utils [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.088s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b3f4b9b-eb9d-4bd2-bd8b-11936f883dba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:05 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Instance spawned successfully.
Oct 16 09:51:05 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.029s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fef7d6-f105-4ef6-8a22-0960383a52bd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[44294b60-b7e2-4471-9cac-01c85df2ec64]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc0d684-e353-47af-aee8-4bac69a85efb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG nova.compute.manager [req-ce3b8b4c-4990-44d6-bcac-70865460e3b2 req-436c44ef-dab6-44f8-bc94-d57f3ead3baf service nova] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Received event network-vif-plugged-4cea4774-6a45-4adc-8019-ffda4c7253cb {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ce3b8b4c-4990-44d6-bcac-70865460e3b2 req-436c44ef-dab6-44f8-bc94-d57f3ead3baf service nova] Acquiring lock "a9a7676e-87d8-4e8a-832a-67a5470f16a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ce3b8b4c-4990-44d6-bcac-70865460e3b2 req-436c44ef-dab6-44f8-bc94-d57f3ead3baf service nova] Lock "a9a7676e-87d8-4e8a-832a-67a5470f16a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ce3b8b4c-4990-44d6-bcac-70865460e3b2 req-436c44ef-dab6-44f8-bc94-d57f3ead3baf service nova] Lock "a9a7676e-87d8-4e8a-832a-67a5470f16a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG nova.compute.manager [req-ce3b8b4c-4990-44d6-bcac-70865460e3b2 req-436c44ef-dab6-44f8-bc94-d57f3ead3baf service nova] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] No waiting events found dispatching network-vif-plugged-4cea4774-6a45-4adc-8019-ffda4c7253cb {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:51:05 user nova-compute[74342]: WARNING nova.compute.manager [req-ce3b8b4c-4990-44d6-bcac-70865460e3b2 req-436c44ef-dab6-44f8-bc94-d57f3ead3baf service nova] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Received unexpected event network-vif-plugged-4cea4774-6a45-4adc-8019-ffda4c7253cb for instance with vm_state building and task_state spawning.
Oct 16 09:51:05 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:05 user nova-compute[74342]: INFO nova.compute.manager [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Took 6.54 seconds to spawn the instance on the hypervisor.
Oct 16 09:51:05 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:51:05 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:51:05 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6bfdde-55a8-4810-86df-013615a9c718]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG os_brick.utils [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] <== get_connector_properties: return (286ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:51:05 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Updating existing volume attachment record: e840c3ff-ad61-4697-bec2-fcdd9b215066 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 09:51:06 user nova-compute[74342]: INFO nova.compute.manager [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Took 7.75 seconds to build instance.
Oct 16 09:51:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fd26e96a-a2b0-4f79-9d6a-04d0e44bb434 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lock "a9a7676e-87d8-4e8a-832a-67a5470f16a1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.900s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:14 user nova-compute[74342]: DEBUG nova.compute.manager [req-3b75f0f7-3881-42dc-87ab-448ae3908b0e req-12e9bbc2-75b1-44a2-9be8-321029619a8b service nova] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Received event network-changed-da49a9b4-9434-45c8-93cd-e7bfb0654d87 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:51:14 user nova-compute[74342]: DEBUG nova.compute.manager [req-3b75f0f7-3881-42dc-87ab-448ae3908b0e req-12e9bbc2-75b1-44a2-9be8-321029619a8b service nova] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Refreshing instance network info cache due to event network-changed-da49a9b4-9434-45c8-93cd-e7bfb0654d87. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:51:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-3b75f0f7-3881-42dc-87ab-448ae3908b0e req-12e9bbc2-75b1-44a2-9be8-321029619a8b service nova] Acquiring lock "refresh_cache-a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:51:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-3b75f0f7-3881-42dc-87ab-448ae3908b0e req-12e9bbc2-75b1-44a2-9be8-321029619a8b service nova] Acquired lock "refresh_cache-a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:51:14 user nova-compute[74342]: DEBUG nova.network.neutron [req-3b75f0f7-3881-42dc-87ab-448ae3908b0e req-12e9bbc2-75b1-44a2-9be8-321029619a8b service nova] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Refreshing network info cache for port da49a9b4-9434-45c8-93cd-e7bfb0654d87 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:51:14 user nova-compute[74342]: DEBUG nova.network.neutron [req-3b75f0f7-3881-42dc-87ab-448ae3908b0e req-12e9bbc2-75b1-44a2-9be8-321029619a8b service nova] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Updated VIF entry in instance network info cache for port da49a9b4-9434-45c8-93cd-e7bfb0654d87. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:51:14 user nova-compute[74342]: DEBUG nova.network.neutron [req-3b75f0f7-3881-42dc-87ab-448ae3908b0e req-12e9bbc2-75b1-44a2-9be8-321029619a8b service nova] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Updating instance_info_cache with network_info: [{"id": "da49a9b4-9434-45c8-93cd-e7bfb0654d87", "address": "fa:16:3e:5a:fd:10", "network": {"id": "cb593fff-0bec-4f80-8b28-361a9ca3aa47", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-43873371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e198c124675940d69559cd3ae04644c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda49a9b4-94", "ovs_interfaceid": "da49a9b4-9434-45c8-93cd-e7bfb0654d87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:51:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-3b75f0f7-3881-42dc-87ab-448ae3908b0e req-12e9bbc2-75b1-44a2-9be8-321029619a8b service nova] Releasing lock "refresh_cache-a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:51:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Acquiring lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:14 user nova-compute[74342]: DEBUG nova.objects.instance [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lazy-loading 'flavor' on Instance uuid a9acd5f6-12e3-488b-b6c6-e4b81f5fc897 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:51:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Acquiring lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:15 user nova-compute[74342]: INFO nova.compute.manager [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Attaching volume ed3c06eb-8a87-4939-b3f5-28aecc6c0449 to /dev/vdb
Oct 16 09:51:15 user nova-compute[74342]: DEBUG os_brick.utils [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:51:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d219c617-1d15-423c-879b-35c1fd620729]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[12432b63-2f09-4990-bcc1-0cdd2e8c75b7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a54079d1-1c9e-4735-aea6-79aa43ec2cd4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa0fdc6-9750-460f-b724-f3bcf1c9f1ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:51:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:51:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:51:15 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:51:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e97997af-b629-4415-a56e-573e050f502d]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:51:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:51:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:51:15 user nova-compute[74342]: DEBUG os_brick.utils [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:51:15 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Updating existing volume attachment record: 3de8714c-851d-4c67-8a0e-78f3dd4639a7 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 09:51:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HgLqdcys', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:51:21 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:51:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:51:21 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:51:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:51:21 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3dce752-80bb-4214-b9bc-13e8ca781ed3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 09:51:21 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7fccb81-7ece-49af-acec-33bd7e070ca8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84] added
Oct 16 09:51:21 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f847ef62-166c-4493-9ff3-68a9161c1f82]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab010ee3-f8ed-4e50-a865-7fc77a49c757]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HgLqdcys {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HgLqdcys" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ac1823-3cfa-4674-a021-383b3b31b2be]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HgLqdcys'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a82b7269-b79c-470e-a647-732a92014834]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b39bcf7-fd3b-4a20-8bf8-b45bfa58c235]: (4, ('tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:51:21 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsi session list stdout=tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:51:21 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3130a4d1-d90b-4dfc-9e69-2e2a4d4b0ede]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84, portal: 172.16.0.220,3260]
Oct 16 09:51:21 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84, portal: 172.16.0.220,3260] successful.
Oct 16 09:51:21 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f9ab74-3926-4e08-9bee-d8beeabb3d92]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e389ee04-e4b4-40a6-8e2c-481b6df09239]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:51:21 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:51:21 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:51:21 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:51:21 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] HCTL ('33', '-', '-', 0) found on session 10 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 09:51:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:22 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f98e28-a03d-4074-80df-1520fa2e5f75]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:22 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Searching for a device in session 10 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:51:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HgLqdcys', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 09:51:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8ccff95e-d096-4f03-8f76-1067e574c295 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Acquiring lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8ccff95e-d096-4f03-8f76-1067e574c295 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8ccff95e-d096-4f03-8f76-1067e574c295 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Acquiring lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8ccff95e-d096-4f03-8f76-1067e574c295 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8ccff95e-d096-4f03-8f76-1067e574c295 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:22 user nova-compute[74342]: INFO nova.compute.manager [None req-8ccff95e-d096-4f03-8f76-1067e574c295 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Terminating instance
Oct 16 09:51:22 user nova-compute[74342]: DEBUG nova.compute.manager [None req-8ccff95e-d096-4f03-8f76-1067e574c295 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 09:51:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:22 user nova-compute[74342]: DEBUG nova.compute.manager [req-badbcb36-c5ea-43eb-8fc4-a0cda24aaeab req-940ee3f0-1641-4844-be4c-a1a36eba0658 service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Received event network-vif-unplugged-6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:51:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-badbcb36-c5ea-43eb-8fc4-a0cda24aaeab req-940ee3f0-1641-4844-be4c-a1a36eba0658 service nova] Acquiring lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-badbcb36-c5ea-43eb-8fc4-a0cda24aaeab req-940ee3f0-1641-4844-be4c-a1a36eba0658 service nova] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-badbcb36-c5ea-43eb-8fc4-a0cda24aaeab req-940ee3f0-1641-4844-be4c-a1a36eba0658 service nova] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:22 user nova-compute[74342]: DEBUG nova.compute.manager [req-badbcb36-c5ea-43eb-8fc4-a0cda24aaeab req-940ee3f0-1641-4844-be4c-a1a36eba0658 service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] No waiting events found dispatching network-vif-unplugged-6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:51:22 user nova-compute[74342]: DEBUG nova.compute.manager [req-badbcb36-c5ea-43eb-8fc4-a0cda24aaeab req-940ee3f0-1641-4844-be4c-a1a36eba0658 service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Received event network-vif-unplugged-6880e1ef-5122-458c-a9b8-a8202cdee055 for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 09:51:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "eeee39f2-9728-4114-8bd3-1d05f69a1215" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "eeee39f2-9728-4114-8bd3-1d05f69a1215" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:22 user nova-compute[74342]: DEBUG nova.compute.manager [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] <== connect_volume: return (1348ms) {'type': 'block', 'scsi_wwn': '23833653935353630', 'path': '/dev/sdb'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23833653935353630', 'path': '/dev/sdb'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG nova.objects.instance [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lazy-loading 'flavor' on Instance uuid 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 09:51:23 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:51:23 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 09:51:23 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:51:23 user nova-compute[74342]:   <serial>98a7eb7a-b514-4dde-858c-4f0676d16f84</serial>
Oct 16 09:51:23 user nova-compute[74342]: </disk>
Oct 16 09:51:23 user nova-compute[74342]:  {{(pid=74342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:51:23 user nova-compute[74342]: INFO nova.compute.claims [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Claim successful on node user
Oct 16 09:51:23 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Instance destroyed successfully.
Oct 16 09:51:23 user nova-compute[74342]: DEBUG nova.objects.instance [None req-8ccff95e-d096-4f03-8f76-1067e574c295 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lazy-loading 'resources' on Instance uuid bdcd2e60-b36c-4d87-94d7-076e7430e1f0 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-8ccff95e-d096-4f03-8f76-1067e574c295 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:44:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-1284670649',display_name='tempest-ServerStableDeviceRescueTest-server-1284670649',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-1284670649',id=4,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNrXoD5Hrtp0ROS6ovoeBvzjEfPpR4UjjC7ZqIID+HojYD/xMrg9FWvTD4l6ndTedTgydSxzmceB9u2uBK/WxkE0f/ZCFoLaDqAKtcEYleUSzfATZXWIic1PChOdLmXIwA==',key_name='tempest-keypair-1191894411',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:48:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6679e55d6a194b399b6b2d27a8cbb147',ramdisk_id='',reservation_id='r-2zs156t5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-864442118',owner_user_name='tempest-ServerStableDeviceRescueTest-864442118-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:50:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cb81780de8824c3bb51b416c5f73f2b5',uuid=bdcd2e60-b36c-4d87-94d7-076e7430e1f0,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6880e1ef-5122-458c-a9b8-a8202cdee055", "address": "fa:16:3e:22:60:5b", "network": {"id": "b9e6ad97-cbbe-40e7-b487-5fc89166bc6a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-718322219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6679e55d6a194b399b6b2d27a8cbb147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6880e1ef-51", "ovs_interfaceid": "6880e1ef-5122-458c-a9b8-a8202cdee055", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-8ccff95e-d096-4f03-8f76-1067e574c295 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Converting VIF {"id": "6880e1ef-5122-458c-a9b8-a8202cdee055", "address": "fa:16:3e:22:60:5b", "network": {"id": "b9e6ad97-cbbe-40e7-b487-5fc89166bc6a", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-718322219-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.131", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6679e55d6a194b399b6b2d27a8cbb147", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6880e1ef-51", "ovs_interfaceid": "6880e1ef-5122-458c-a9b8-a8202cdee055", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-8ccff95e-d096-4f03-8f76-1067e574c295 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:22:60:5b,bridge_name='br-int',has_traffic_filtering=True,id=6880e1ef-5122-458c-a9b8-a8202cdee055,network=Network(b9e6ad97-cbbe-40e7-b487-5fc89166bc6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6880e1ef-51') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG os_vif [None req-8ccff95e-d096-4f03-8f76-1067e574c295 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:60:5b,bridge_name='br-int',has_traffic_filtering=True,id=6880e1ef-5122-458c-a9b8-a8202cdee055,network=Network(b9e6ad97-cbbe-40e7-b487-5fc89166bc6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6880e1ef-51') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6880e1ef-51, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9c4c895b-7ccc-4ebd-99b2-7ad96b755bb0) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:23 user nova-compute[74342]: INFO os_vif [None req-8ccff95e-d096-4f03-8f76-1067e574c295 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:22:60:5b,bridge_name='br-int',has_traffic_filtering=True,id=6880e1ef-5122-458c-a9b8-a8202cdee055,network=Network(b9e6ad97-cbbe-40e7-b487-5fc89166bc6a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6880e1ef-51')
Oct 16 09:51:23 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-8ccff95e-d096-4f03-8f76-1067e574c295 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Deleting instance files /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0_del
Oct 16 09:51:23 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-8ccff95e-d096-4f03-8f76-1067e574c295 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Deletion of /opt/stack/data/nova/instances/bdcd2e60-b36c-4d87-94d7-076e7430e1f0_del complete
Oct 16 09:51:23 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] No VIF found with MAC fa:16:3e:4f:14:0e, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:51:23 user nova-compute[74342]: INFO nova.compute.manager [None req-8ccff95e-d096-4f03-8f76-1067e574c295 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Took 1.22 seconds to destroy the instance on the hypervisor.
Oct 16 09:51:23 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-8ccff95e-d096-4f03-8f76-1067e574c295 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.659s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG nova.compute.manager [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cd057833-bff5-45e2-9556-27406094e203 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.959s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG nova.compute.manager [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG nova.network.neutron [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:51:23 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:51:23 user nova-compute[74342]: DEBUG nova.compute.manager [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG nova.compute.manager [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:51:23 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Creating image(s)
Oct 16 09:51:23 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Did not create local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Ensure instance console log exists: /opt/stack/data/nova/instances/2522364c-36c7-446d-87e7-113632ceeab6/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Start _get_guest_xml network_info=[{"id": "975f1cad-dbc7-462f-9702-55567afd639b", "address": "fa:16:3e:18:9d:9a", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap975f1cad-db", "ovs_interfaceid": "975f1cad-dbc7-462f-9702-55567afd639b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'e840c3ff-ad61-4697-bec2-fcdd9b215066', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xSlhtdYW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2522364c-36c7-446d-87e7-113632ceeab6', 'attached_at': '', 'detached_at': '', 'volume_id': '4bffc475-b62a-4b57-ab2c-1d23cf21e1ea', 'serial': '4bffc475-b62a-4b57-ab2c-1d23cf21e1ea'}, 'volume_type': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG nova.compute.manager [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:51:23 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Creating image(s)
Oct 16 09:51:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "/opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "/opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "/opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:24 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:51:24 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:51:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xSlhtdYW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:51:24 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:51:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:51:24 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:51:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:51:24 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 09:51:24 user nova-compute[74342]: DEBUG nova.policy [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c8bf8aa8ab2d4105ad0b1fd04247e3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70b9ea5f3404a5690cd0a73db23f034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5effef11-dfde-4de1-9af2-be11e42a9c94]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 09:51:24 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1af6bbd-cebd-435f-a829-6c30f0dd9bb4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea] added
Oct 16 09:51:24 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada3e330-d19b-498b-b0b1-14f4f843b021]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.184s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7275db-2272-4782-8b09-3cc8e3dc57b7]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xSlhtdYW {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xSlhtdYW" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[deda3d58-a7c5-4e6d-a913-61363cc7b14a]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xSlhtdYW'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7451b5-02be-4548-9fa4-fc74b6d0b591]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bea671a-d237-461d-9db9-fcecfac9aed7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:51:24 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:51:24 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:51:24 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:51:24 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b7dd7b-5b92-47f4-b772-4d4b5414c53f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea, portal: 172.16.0.220,3260]
Oct 16 09:51:24 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea, portal: 172.16.0.220,3260] successful.
Oct 16 09:51:24 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.220s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.109s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e93ad74-4dab-4f0a-a811-438e759515c5]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk 1073741824" returned: 0 in 0.248s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.471s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eff8bbf-cfd9-4cdb-bcd1-3d1490daff7c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:51:24 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:51:24 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:51:24 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:51:24 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:51:24 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:51:24 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.600s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] HCTL ('35', '-', '-', 0) found on session 11 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.046s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b225cf-fede-4230-bba2-38632c2c4203]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Searching for a device in session 11 and hctl ['35', '*', '*', 0] yield: None {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG nova.compute.manager [req-b855bc1b-17e0-40de-9eca-846ea779d07f req-793966f8-7b4b-4ad7-bd7d-9804496e712d service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Received event network-vif-plugged-6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b855bc1b-17e0-40de-9eca-846ea779d07f req-793966f8-7b4b-4ad7-bd7d-9804496e712d service nova] Acquiring lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b855bc1b-17e0-40de-9eca-846ea779d07f req-793966f8-7b4b-4ad7-bd7d-9804496e712d service nova] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b855bc1b-17e0-40de-9eca-846ea779d07f req-793966f8-7b4b-4ad7-bd7d-9804496e712d service nova] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG nova.compute.manager [req-b855bc1b-17e0-40de-9eca-846ea779d07f req-793966f8-7b4b-4ad7-bd7d-9804496e712d service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] No waiting events found dispatching network-vif-plugged-6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:51:24 user nova-compute[74342]: WARNING nova.compute.manager [req-b855bc1b-17e0-40de-9eca-846ea779d07f req-793966f8-7b4b-4ad7-bd7d-9804496e712d service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Received unexpected event network-vif-plugged-6880e1ef-5122-458c-a9b8-a8202cdee055 for instance with vm_state active and task_state deleting.
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.294s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 09:51:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG nova.compute.manager [req-d3e7565e-def1-48b9-9967-185aa30d8194 req-70904b08-1a42-4854-8ee1-165f4e130bdb service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Received event network-vif-deleted-6880e1ef-5122-458c-a9b8-a8202cdee055 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:51:25 user nova-compute[74342]: INFO nova.compute.manager [req-d3e7565e-def1-48b9-9967-185aa30d8194 req-70904b08-1a42-4854-8ee1-165f4e130bdb service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Neutron deleted interface 6880e1ef-5122-458c-a9b8-a8202cdee055; detaching it from the instance and deleting it from the info cache
Oct 16 09:51:25 user nova-compute[74342]: DEBUG nova.network.neutron [req-d3e7565e-def1-48b9-9967-185aa30d8194 req-70904b08-1a42-4854-8ee1-165f4e130bdb service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:51:25 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Took 1.31 seconds to deallocate network for instance.
Oct 16 09:51:25 user nova-compute[74342]: DEBUG nova.compute.manager [req-d3e7565e-def1-48b9-9967-185aa30d8194 req-70904b08-1a42-4854-8ee1-165f4e130bdb service nova] [instance: bdcd2e60-b36c-4d87-94d7-076e7430e1f0] Detach interface failed, port_id=6880e1ef-5122-458c-a9b8-a8202cdee055, reason: Instance bdcd2e60-b36c-4d87-94d7-076e7430e1f0 could not be found. {{(pid=74342) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8ccff95e-d096-4f03-8f76-1067e574c295 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8ccff95e-d096-4f03-8f76-1067e574c295 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Cannot resize image /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Ensure instance console log exists: /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG nova.network.neutron [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Successfully created port: 2f21663b-c324-4ed7-80ff-fedf6e5631c8 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-8ccff95e-d096-4f03-8f76-1067e574c295 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-8ccff95e-d096-4f03-8f76-1067e574c295 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8ccff95e-d096-4f03-8f76-1067e574c295 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:25 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-8ccff95e-d096-4f03-8f76-1067e574c295 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Deleted allocations for instance bdcd2e60-b36c-4d87-94d7-076e7430e1f0
Oct 16 09:51:25 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Searching for a device in session 11 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xSlhtdYW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.662s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] <== connect_volume: return (1664ms) {'type': 'block', 'scsi_wwn': '23865643861623364', 'path': '/dev/sdd'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865643861623364', 'path': '/dev/sdd'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8ccff95e-d096-4f03-8f76-1067e574c295 tempest-ServerStableDeviceRescueTest-864442118 tempest-ServerStableDeviceRescueTest-864442118-project-member] Lock "bdcd2e60-b36c-4d87-94d7-076e7430e1f0" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.274s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:50:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1187825465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1187825465',id=19,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4fcf2437a2d413ea584d0cc2508bed3',ramdisk_id='',reservation_id='r-cy1bowxe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-476995503',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:50:49Z,user_data=None,user_id='f90f091b76254a13957807feaeaef3fc',uuid=2522364c-36c7-446d-87e7-113632ceeab6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "975f1cad-dbc7-462f-9702-55567afd639b", "address": "fa:16:3e:18:9d:9a", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap975f1cad-db", "ovs_interfaceid": "975f1cad-dbc7-462f-9702-55567afd639b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Converting VIF {"id": "975f1cad-dbc7-462f-9702-55567afd639b", "address": "fa:16:3e:18:9d:9a", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap975f1cad-db", "ovs_interfaceid": "975f1cad-dbc7-462f-9702-55567afd639b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:9d:9a,bridge_name='br-int',has_traffic_filtering=True,id=975f1cad-dbc7-462f-9702-55567afd639b,network=Network(a571ad70-6f8b-4b02-86b9-df50290509f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap975f1cad-db') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG nova.objects.instance [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lazy-loading 'pci_devices' on Instance uuid 2522364c-36c7-446d-87e7-113632ceeab6 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:51:25 user nova-compute[74342]:   <uuid>2522364c-36c7-446d-87e7-113632ceeab6</uuid>
Oct 16 09:51:25 user nova-compute[74342]:   <name>instance-00000013</name>
Oct 16 09:51:25 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:51:25 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:51:25 user nova-compute[74342]:   <metadata>
Oct 16 09:51:25 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:51:25 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:51:25 user nova-compute[74342]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1187825465</nova:name>
Oct 16 09:51:25 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:51:24</nova:creationTime>
Oct 16 09:51:25 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:51:25 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:51:25 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:51:25 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:51:25 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:51:25 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:51:25 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:51:25 user nova-compute[74342]:       <nova:owner>
Oct 16 09:51:25 user nova-compute[74342]:         <nova:user uuid="f90f091b76254a13957807feaeaef3fc">tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member</nova:user>
Oct 16 09:51:25 user nova-compute[74342]:         <nova:project uuid="a4fcf2437a2d413ea584d0cc2508bed3">tempest-ServerBootFromVolumeStableRescueTest-476995503</nova:project>
Oct 16 09:51:25 user nova-compute[74342]:       </nova:owner>
Oct 16 09:51:25 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:51:25 user nova-compute[74342]:       <nova:ports>
Oct 16 09:51:25 user nova-compute[74342]:         <nova:port uuid="975f1cad-dbc7-462f-9702-55567afd639b">
Oct 16 09:51:25 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 16 09:51:25 user nova-compute[74342]:         </nova:port>
Oct 16 09:51:25 user nova-compute[74342]:       </nova:ports>
Oct 16 09:51:25 user nova-compute[74342]:     </nova:instance>
Oct 16 09:51:25 user nova-compute[74342]:   </metadata>
Oct 16 09:51:25 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:51:25 user nova-compute[74342]:     <system>
Oct 16 09:51:25 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:51:25 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:51:25 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:51:25 user nova-compute[74342]:       <entry name="serial">2522364c-36c7-446d-87e7-113632ceeab6</entry>
Oct 16 09:51:25 user nova-compute[74342]:       <entry name="uuid">2522364c-36c7-446d-87e7-113632ceeab6</entry>
Oct 16 09:51:25 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:51:25 user nova-compute[74342]:     </system>
Oct 16 09:51:25 user nova-compute[74342]:   </sysinfo>
Oct 16 09:51:25 user nova-compute[74342]:   <os>
Oct 16 09:51:25 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:51:25 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:51:25 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:51:25 user nova-compute[74342]:   </os>
Oct 16 09:51:25 user nova-compute[74342]:   <features>
Oct 16 09:51:25 user nova-compute[74342]:     <acpi/>
Oct 16 09:51:25 user nova-compute[74342]:     <apic/>
Oct 16 09:51:25 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:51:25 user nova-compute[74342]:   </features>
Oct 16 09:51:25 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:51:25 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:51:25 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:51:25 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:51:25 user nova-compute[74342]:   </clock>
Oct 16 09:51:25 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:51:25 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:51:25 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:51:25 user nova-compute[74342]:   </cpu>
Oct 16 09:51:25 user nova-compute[74342]:   <devices>
Oct 16 09:51:25 user nova-compute[74342]:     <disk type="block" device="disk">
Oct 16 09:51:25 user nova-compute[74342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:51:25 user nova-compute[74342]:       <source dev="/dev/sdd"/>
Oct 16 09:51:25 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:51:25 user nova-compute[74342]:       <serial>4bffc475-b62a-4b57-ab2c-1d23cf21e1ea</serial>
Oct 16 09:51:25 user nova-compute[74342]:     </disk>
Oct 16 09:51:25 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:51:25 user nova-compute[74342]:       <mac address="fa:16:3e:18:9d:9a"/>
Oct 16 09:51:25 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:51:25 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:51:25 user nova-compute[74342]:       <target dev="tap975f1cad-db"/>
Oct 16 09:51:25 user nova-compute[74342]:     </interface>
Oct 16 09:51:25 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:51:25 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/2522364c-36c7-446d-87e7-113632ceeab6/console.log" append="off"/>
Oct 16 09:51:25 user nova-compute[74342]:     </serial>
Oct 16 09:51:25 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:51:25 user nova-compute[74342]:     <video>
Oct 16 09:51:25 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:51:25 user nova-compute[74342]:     </video>
Oct 16 09:51:25 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:51:25 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:51:25 user nova-compute[74342]:     </rng>
Oct 16 09:51:25 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:51:25 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:51:25 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:51:25 user nova-compute[74342]:     </memballoon>
Oct 16 09:51:25 user nova-compute[74342]:   </devices>
Oct 16 09:51:25 user nova-compute[74342]: </domain>
Oct 16 09:51:25 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:50:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1187825465',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1187825465',id=19,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a4fcf2437a2d413ea584d0cc2508bed3',ramdisk_id='',reservation_id='r-cy1bowxe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-476995503',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:50:49Z,user_data=None,user_id='f90f091b76254a13957807feaeaef3fc',uuid=2522364c-36c7-446d-87e7-113632ceeab6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "975f1cad-dbc7-462f-9702-55567afd639b", "address": "fa:16:3e:18:9d:9a", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap975f1cad-db", "ovs_interfaceid": "975f1cad-dbc7-462f-9702-55567afd639b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Converting VIF {"id": "975f1cad-dbc7-462f-9702-55567afd639b", "address": "fa:16:3e:18:9d:9a", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap975f1cad-db", "ovs_interfaceid": "975f1cad-dbc7-462f-9702-55567afd639b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:9d:9a,bridge_name='br-int',has_traffic_filtering=True,id=975f1cad-dbc7-462f-9702-55567afd639b,network=Network(a571ad70-6f8b-4b02-86b9-df50290509f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap975f1cad-db') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG os_vif [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:9d:9a,bridge_name='br-int',has_traffic_filtering=True,id=975f1cad-dbc7-462f-9702-55567afd639b,network=Network(a571ad70-6f8b-4b02-86b9-df50290509f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap975f1cad-db') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bbb49bfd-8e2c-5055-a80e-2be9d24dc33b', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap975f1cad-db, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap975f1cad-db, col_values=(('qos', UUID('ef8f9e7c-16a3-43eb-8c46-fcc8a30bf692')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap975f1cad-db, col_values=(('external_ids', {'iface-id': '975f1cad-dbc7-462f-9702-55567afd639b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:9d:9a', 'vm-uuid': '2522364c-36c7-446d-87e7-113632ceeab6'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:25 user nova-compute[74342]: INFO os_vif [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:9d:9a,bridge_name='br-int',has_traffic_filtering=True,id=975f1cad-dbc7-462f-9702-55567afd639b,network=Network(a571ad70-6f8b-4b02-86b9-df50290509f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap975f1cad-db')
Oct 16 09:51:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:51:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] No VIF found with MAC fa:16:3e:18:9d:9a, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.network.neutron [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Successfully updated port: 2f21663b-c324-4ed7-80ff-fedf6e5631c8 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "refresh_cache-eeee39f2-9728-4114-8bd3-1d05f69a1215" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquired lock "refresh_cache-eeee39f2-9728-4114-8bd3-1d05f69a1215" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.network.neutron [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.network.neutron [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.network.neutron [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Updating instance_info_cache with network_info: [{"id": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "address": "fa:16:3e:7a:a5:ca", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f21663b-c3", "ovs_interfaceid": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Releasing lock "refresh_cache-eeee39f2-9728-4114-8bd3-1d05f69a1215" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.compute.manager [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Instance network_info: |[{"id": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "address": "fa:16:3e:7a:a5:ca", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f21663b-c3", "ovs_interfaceid": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Start _get_guest_xml network_info=[{"id": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "address": "fa:16:3e:7a:a5:ca", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f21663b-c3", "ovs_interfaceid": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:51:26 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:51:26 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1957313876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1957313876',id=22,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA73VdBJ5ylQREnZzo1DcCKTXomTVssllhy6Bsc/R9T/BngGDJaacG1M/H4yJnuSLGKGGYKR1zjZCaYpdn685spvq9Aw7a1FZR+w5BmYmqQ12LQgzJnL3CoZ3rsf0xXY0A==',key_name='tempest-keypair-1825544135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a70b9ea5f3404a5690cd0a73db23f034',ramdisk_id='',reservation_id='r-1dw8qoh2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-939526853',owner_user_name='tempest-AttachVolumeShelveTestJSON-939526853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:51:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8bf8aa8ab2d4105ad0b1fd04247e3a0',uuid=eeee39f2-9728-4114-8bd3-1d05f69a1215,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "address": "fa:16:3e:7a:a5:ca", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f21663b-c3", "ovs_interfaceid": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Converting VIF {"id": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "address": "fa:16:3e:7a:a5:ca", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f21663b-c3", "ovs_interfaceid": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:a5:ca,bridge_name='br-int',has_traffic_filtering=True,id=2f21663b-c324-4ed7-80ff-fedf6e5631c8,network=Network(bbeb1d70-a5dc-46d6-a0dd-240bf3018d31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f21663b-c3') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.objects.instance [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lazy-loading 'pci_devices' on Instance uuid eeee39f2-9728-4114-8bd3-1d05f69a1215 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:51:26 user nova-compute[74342]:   <uuid>eeee39f2-9728-4114-8bd3-1d05f69a1215</uuid>
Oct 16 09:51:26 user nova-compute[74342]:   <name>instance-00000016</name>
Oct 16 09:51:26 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:51:26 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:51:26 user nova-compute[74342]:   <metadata>
Oct 16 09:51:26 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:51:26 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:51:26 user nova-compute[74342]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1957313876</nova:name>
Oct 16 09:51:26 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:51:26</nova:creationTime>
Oct 16 09:51:26 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:51:26 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:51:26 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:51:26 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:51:26 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:51:26 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:51:26 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:51:26 user nova-compute[74342]:       <nova:owner>
Oct 16 09:51:26 user nova-compute[74342]:         <nova:user uuid="c8bf8aa8ab2d4105ad0b1fd04247e3a0">tempest-AttachVolumeShelveTestJSON-939526853-project-member</nova:user>
Oct 16 09:51:26 user nova-compute[74342]:         <nova:project uuid="a70b9ea5f3404a5690cd0a73db23f034">tempest-AttachVolumeShelveTestJSON-939526853</nova:project>
Oct 16 09:51:26 user nova-compute[74342]:       </nova:owner>
Oct 16 09:51:26 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:51:26 user nova-compute[74342]:       <nova:ports>
Oct 16 09:51:26 user nova-compute[74342]:         <nova:port uuid="2f21663b-c324-4ed7-80ff-fedf6e5631c8">
Oct 16 09:51:26 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 16 09:51:26 user nova-compute[74342]:         </nova:port>
Oct 16 09:51:26 user nova-compute[74342]:       </nova:ports>
Oct 16 09:51:26 user nova-compute[74342]:     </nova:instance>
Oct 16 09:51:26 user nova-compute[74342]:   </metadata>
Oct 16 09:51:26 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:51:26 user nova-compute[74342]:     <system>
Oct 16 09:51:26 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:51:26 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:51:26 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:51:26 user nova-compute[74342]:       <entry name="serial">eeee39f2-9728-4114-8bd3-1d05f69a1215</entry>
Oct 16 09:51:26 user nova-compute[74342]:       <entry name="uuid">eeee39f2-9728-4114-8bd3-1d05f69a1215</entry>
Oct 16 09:51:26 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:51:26 user nova-compute[74342]:     </system>
Oct 16 09:51:26 user nova-compute[74342]:   </sysinfo>
Oct 16 09:51:26 user nova-compute[74342]:   <os>
Oct 16 09:51:26 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:51:26 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:51:26 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:51:26 user nova-compute[74342]:   </os>
Oct 16 09:51:26 user nova-compute[74342]:   <features>
Oct 16 09:51:26 user nova-compute[74342]:     <acpi/>
Oct 16 09:51:26 user nova-compute[74342]:     <apic/>
Oct 16 09:51:26 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:51:26 user nova-compute[74342]:   </features>
Oct 16 09:51:26 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:51:26 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:51:26 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:51:26 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:51:26 user nova-compute[74342]:   </clock>
Oct 16 09:51:26 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:51:26 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:51:26 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:51:26 user nova-compute[74342]:   </cpu>
Oct 16 09:51:26 user nova-compute[74342]:   <devices>
Oct 16 09:51:26 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 09:51:26 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 09:51:26 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk"/>
Oct 16 09:51:26 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:51:26 user nova-compute[74342]:     </disk>
Oct 16 09:51:26 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:51:26 user nova-compute[74342]:       <mac address="fa:16:3e:7a:a5:ca"/>
Oct 16 09:51:26 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:51:26 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:51:26 user nova-compute[74342]:       <target dev="tap2f21663b-c3"/>
Oct 16 09:51:26 user nova-compute[74342]:     </interface>
Oct 16 09:51:26 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:51:26 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/console.log" append="off"/>
Oct 16 09:51:26 user nova-compute[74342]:     </serial>
Oct 16 09:51:26 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:51:26 user nova-compute[74342]:     <video>
Oct 16 09:51:26 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:51:26 user nova-compute[74342]:     </video>
Oct 16 09:51:26 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:51:26 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:51:26 user nova-compute[74342]:     </rng>
Oct 16 09:51:26 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:51:26 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:51:26 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:51:26 user nova-compute[74342]:     </memballoon>
Oct 16 09:51:26 user nova-compute[74342]:   </devices>
Oct 16 09:51:26 user nova-compute[74342]: </domain>
Oct 16 09:51:26 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1957313876',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1957313876',id=22,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA73VdBJ5ylQREnZzo1DcCKTXomTVssllhy6Bsc/R9T/BngGDJaacG1M/H4yJnuSLGKGGYKR1zjZCaYpdn685spvq9Aw7a1FZR+w5BmYmqQ12LQgzJnL3CoZ3rsf0xXY0A==',key_name='tempest-keypair-1825544135',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a70b9ea5f3404a5690cd0a73db23f034',ramdisk_id='',reservation_id='r-1dw8qoh2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-939526853',owner_user_name='tempest-AttachVolumeShelveTestJSON-939526853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:51:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8bf8aa8ab2d4105ad0b1fd04247e3a0',uuid=eeee39f2-9728-4114-8bd3-1d05f69a1215,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "address": "fa:16:3e:7a:a5:ca", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f21663b-c3", "ovs_interfaceid": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Converting VIF {"id": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "address": "fa:16:3e:7a:a5:ca", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f21663b-c3", "ovs_interfaceid": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:a5:ca,bridge_name='br-int',has_traffic_filtering=True,id=2f21663b-c324-4ed7-80ff-fedf6e5631c8,network=Network(bbeb1d70-a5dc-46d6-a0dd-240bf3018d31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f21663b-c3') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG os_vif [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:a5:ca,bridge_name='br-int',has_traffic_filtering=True,id=2f21663b-c324-4ed7-80ff-fedf6e5631c8,network=Network(bbeb1d70-a5dc-46d6-a0dd-240bf3018d31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f21663b-c3') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '522f72eb-9ae3-548a-8c6a-2efaf924f9bb', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f21663b-c3, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f21663b-c3, col_values=(('qos', UUID('97d7fa90-fe0b-4028-8084-1078e55d097f')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f21663b-c3, col_values=(('external_ids', {'iface-id': '2f21663b-c324-4ed7-80ff-fedf6e5631c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:a5:ca', 'vm-uuid': 'eeee39f2-9728-4114-8bd3-1d05f69a1215'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:26 user nova-compute[74342]: INFO os_vif [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:a5:ca,bridge_name='br-int',has_traffic_filtering=True,id=2f21663b-c324-4ed7-80ff-fedf6e5631c8,network=Network(bbeb1d70-a5dc-46d6-a0dd-240bf3018d31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f21663b-c3')
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:51:26 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] No VIF found with MAC fa:16:3e:7a:a5:ca, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:51:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "b16a3439-f343-4fae-9a5e-e07d8c84b955" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "b16a3439-f343-4fae-9a5e-e07d8c84b955" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:27 user nova-compute[74342]: DEBUG nova.compute.manager [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:51:27 user nova-compute[74342]: DEBUG nova.compute.manager [req-ecd5e17d-f606-48e5-a166-6069fb80390a req-f2f479d6-847b-48b5-b316-f32024516271 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Received event network-changed-2f21663b-c324-4ed7-80ff-fedf6e5631c8 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:51:27 user nova-compute[74342]: DEBUG nova.compute.manager [req-ecd5e17d-f606-48e5-a166-6069fb80390a req-f2f479d6-847b-48b5-b316-f32024516271 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Refreshing instance network info cache due to event network-changed-2f21663b-c324-4ed7-80ff-fedf6e5631c8. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:51:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ecd5e17d-f606-48e5-a166-6069fb80390a req-f2f479d6-847b-48b5-b316-f32024516271 service nova] Acquiring lock "refresh_cache-eeee39f2-9728-4114-8bd3-1d05f69a1215" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:51:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ecd5e17d-f606-48e5-a166-6069fb80390a req-f2f479d6-847b-48b5-b316-f32024516271 service nova] Acquired lock "refresh_cache-eeee39f2-9728-4114-8bd3-1d05f69a1215" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:51:27 user nova-compute[74342]: DEBUG nova.network.neutron [req-ecd5e17d-f606-48e5-a166-6069fb80390a req-f2f479d6-847b-48b5-b316-f32024516271 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Refreshing network info cache for port 2f21663b-c324-4ed7-80ff-fedf6e5631c8 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:51:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:27 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:51:27 user nova-compute[74342]: INFO nova.compute.claims [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Claim successful on node user
Oct 16 09:51:27 user nova-compute[74342]: DEBUG nova.network.neutron [req-ecd5e17d-f606-48e5-a166-6069fb80390a req-f2f479d6-847b-48b5-b316-f32024516271 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Updated VIF entry in instance network info cache for port 2f21663b-c324-4ed7-80ff-fedf6e5631c8. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:51:27 user nova-compute[74342]: DEBUG nova.network.neutron [req-ecd5e17d-f606-48e5-a166-6069fb80390a req-f2f479d6-847b-48b5-b316-f32024516271 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Updating instance_info_cache with network_info: [{"id": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "address": "fa:16:3e:7a:a5:ca", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f21663b-c3", "ovs_interfaceid": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:51:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ecd5e17d-f606-48e5-a166-6069fb80390a req-f2f479d6-847b-48b5-b316-f32024516271 service nova] Releasing lock "refresh_cache-eeee39f2-9728-4114-8bd3-1d05f69a1215" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:51:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:27 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:51:27 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:51:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.592s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:27 user nova-compute[74342]: DEBUG nova.compute.manager [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:51:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:27 user nova-compute[74342]: DEBUG nova.compute.manager [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:51:27 user nova-compute[74342]: DEBUG nova.network.neutron [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:51:27 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:51:27 user nova-compute[74342]: DEBUG nova.compute.manager [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:51:27 user nova-compute[74342]: DEBUG nova.policy [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ee02f6ad1d9749948f43fb432685d067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08329cd0ad7d42a1999ca4f407d93245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:51:28 user nova-compute[74342]: DEBUG nova.compute.manager [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 09:51:28 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:51:28 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Creating image(s)
Oct 16 09:51:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "/opt/stack/data/nova/instances/b16a3439-f343-4fae-9a5e-e07d8c84b955/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "/opt/stack/data/nova/instances/b16a3439-f343-4fae-9a5e-e07d8c84b955/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "/opt/stack/data/nova/instances/b16a3439-f343-4fae-9a5e-e07d8c84b955/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.173s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.184s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/b16a3439-f343-4fae-9a5e-e07d8c84b955/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/b16a3439-f343-4fae-9a5e-e07d8c84b955/disk 1073741824" returned: 0 in 0.066s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:28 user nova-compute[74342]: DEBUG nova.network.neutron [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Successfully created port: e597fbea-47fd-4bc6-b92e-e1ca5ba6059a {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:51:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.217s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:28 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b16a3439-f343-4fae-9a5e-e07d8c84b955/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 09:51:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b16a3439-f343-4fae-9a5e-e07d8c84b955/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b16a3439-f343-4fae-9a5e-e07d8c84b955/disk --force-share --output=json" returned: 0 in 0.277s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:28 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Cannot resize image /opt/stack/data/nova/instances/b16a3439-f343-4fae-9a5e-e07d8c84b955/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 09:51:28 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 09:51:28 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Ensure instance console log exists: /opt/stack/data/nova/instances/b16a3439-f343-4fae-9a5e-e07d8c84b955/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:51:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:29 user nova-compute[74342]: DEBUG nova.compute.manager [req-526bca6e-728b-4b94-b05d-e3591561aabc req-3da8eb87-7603-4216-9316-034d96ec3b73 service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Received event network-vif-plugged-975f1cad-dbc7-462f-9702-55567afd639b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:51:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-526bca6e-728b-4b94-b05d-e3591561aabc req-3da8eb87-7603-4216-9316-034d96ec3b73 service nova] Acquiring lock "2522364c-36c7-446d-87e7-113632ceeab6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-526bca6e-728b-4b94-b05d-e3591561aabc req-3da8eb87-7603-4216-9316-034d96ec3b73 service nova] Lock "2522364c-36c7-446d-87e7-113632ceeab6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-526bca6e-728b-4b94-b05d-e3591561aabc req-3da8eb87-7603-4216-9316-034d96ec3b73 service nova] Lock "2522364c-36c7-446d-87e7-113632ceeab6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:29 user nova-compute[74342]: DEBUG nova.compute.manager [req-526bca6e-728b-4b94-b05d-e3591561aabc req-3da8eb87-7603-4216-9316-034d96ec3b73 service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] No waiting events found dispatching network-vif-plugged-975f1cad-dbc7-462f-9702-55567afd639b {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:51:29 user nova-compute[74342]: WARNING nova.compute.manager [req-526bca6e-728b-4b94-b05d-e3591561aabc req-3da8eb87-7603-4216-9316-034d96ec3b73 service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Received unexpected event network-vif-plugged-975f1cad-dbc7-462f-9702-55567afd639b for instance with vm_state building and task_state spawning.
Oct 16 09:51:29 user nova-compute[74342]: DEBUG nova.compute.manager [req-526bca6e-728b-4b94-b05d-e3591561aabc req-3da8eb87-7603-4216-9316-034d96ec3b73 service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Received event network-vif-plugged-975f1cad-dbc7-462f-9702-55567afd639b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:51:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-526bca6e-728b-4b94-b05d-e3591561aabc req-3da8eb87-7603-4216-9316-034d96ec3b73 service nova] Acquiring lock "2522364c-36c7-446d-87e7-113632ceeab6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-526bca6e-728b-4b94-b05d-e3591561aabc req-3da8eb87-7603-4216-9316-034d96ec3b73 service nova] Lock "2522364c-36c7-446d-87e7-113632ceeab6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-526bca6e-728b-4b94-b05d-e3591561aabc req-3da8eb87-7603-4216-9316-034d96ec3b73 service nova] Lock "2522364c-36c7-446d-87e7-113632ceeab6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:29 user nova-compute[74342]: DEBUG nova.compute.manager [req-526bca6e-728b-4b94-b05d-e3591561aabc req-3da8eb87-7603-4216-9316-034d96ec3b73 service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] No waiting events found dispatching network-vif-plugged-975f1cad-dbc7-462f-9702-55567afd639b {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:51:29 user nova-compute[74342]: WARNING nova.compute.manager [req-526bca6e-728b-4b94-b05d-e3591561aabc req-3da8eb87-7603-4216-9316-034d96ec3b73 service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Received unexpected event network-vif-plugged-975f1cad-dbc7-462f-9702-55567afd639b for instance with vm_state building and task_state spawning.
Oct 16 09:51:29 user nova-compute[74342]: DEBUG nova.compute.manager [req-526bca6e-728b-4b94-b05d-e3591561aabc req-3da8eb87-7603-4216-9316-034d96ec3b73 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Received event network-vif-plugged-2f21663b-c324-4ed7-80ff-fedf6e5631c8 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:51:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-526bca6e-728b-4b94-b05d-e3591561aabc req-3da8eb87-7603-4216-9316-034d96ec3b73 service nova] Acquiring lock "eeee39f2-9728-4114-8bd3-1d05f69a1215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-526bca6e-728b-4b94-b05d-e3591561aabc req-3da8eb87-7603-4216-9316-034d96ec3b73 service nova] Lock "eeee39f2-9728-4114-8bd3-1d05f69a1215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-526bca6e-728b-4b94-b05d-e3591561aabc req-3da8eb87-7603-4216-9316-034d96ec3b73 service nova] Lock "eeee39f2-9728-4114-8bd3-1d05f69a1215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:29 user nova-compute[74342]: DEBUG nova.compute.manager [req-526bca6e-728b-4b94-b05d-e3591561aabc req-3da8eb87-7603-4216-9316-034d96ec3b73 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] No waiting events found dispatching network-vif-plugged-2f21663b-c324-4ed7-80ff-fedf6e5631c8 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:51:29 user nova-compute[74342]: WARNING nova.compute.manager [req-526bca6e-728b-4b94-b05d-e3591561aabc req-3da8eb87-7603-4216-9316-034d96ec3b73 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Received unexpected event network-vif-plugged-2f21663b-c324-4ed7-80ff-fedf6e5631c8 for instance with vm_state building and task_state spawning.
Oct 16 09:51:29 user nova-compute[74342]: DEBUG nova.network.neutron [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Successfully updated port: e597fbea-47fd-4bc6-b92e-e1ca5ba6059a {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:51:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "refresh_cache-b16a3439-f343-4fae-9a5e-e07d8c84b955" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:51:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquired lock "refresh_cache-b16a3439-f343-4fae-9a5e-e07d8c84b955" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:51:29 user nova-compute[74342]: DEBUG nova.network.neutron [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:51:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:29 user nova-compute[74342]: DEBUG nova.network.neutron [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG nova.network.neutron [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Updating instance_info_cache with network_info: [{"id": "e597fbea-47fd-4bc6-b92e-e1ca5ba6059a", "address": "fa:16:3e:0b:7e:19", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape597fbea-47", "ovs_interfaceid": "e597fbea-47fd-4bc6-b92e-e1ca5ba6059a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Releasing lock "refresh_cache-b16a3439-f343-4fae-9a5e-e07d8c84b955" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG nova.compute.manager [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Instance network_info: |[{"id": "e597fbea-47fd-4bc6-b92e-e1ca5ba6059a", "address": "fa:16:3e:0b:7e:19", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape597fbea-47", "ovs_interfaceid": "e597fbea-47fd-4bc6-b92e-e1ca5ba6059a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Start _get_guest_xml network_info=[{"id": "e597fbea-47fd-4bc6-b92e-e1ca5ba6059a", "address": "fa:16:3e:0b:7e:19", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape597fbea-47", "ovs_interfaceid": "e597fbea-47fd-4bc6-b92e-e1ca5ba6059a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:51:30 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:51:30 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:51:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:51:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-475402272',display_name='tempest-AttachVolumeNegativeTest-server-475402272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-475402272',id=23,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMeIPdvex+JZNXj/40qWOU3f3UKPw8zHWUSC188YeGbQLbJ6P0u0Edksw6VipIFuh2or2bSs/2gWMgShxgKAGmFtBRcPIIWfTF3k0vP1ejV46S0PYhHmfblo/iqzFLyGA==',key_name='tempest-keypair-966876636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08329cd0ad7d42a1999ca4f407d93245',ramdisk_id='',reservation_id='r-7udztms0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-119585701',owner_user_name='tempest-AttachVolumeNegativeTest-119585701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:51:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee02f6ad1d9749948f43fb432685d067',uuid=b16a3439-f343-4fae-9a5e-e07d8c84b955,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e597fbea-47fd-4bc6-b92e-e1ca5ba6059a", "address": "fa:16:3e:0b:7e:19", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape597fbea-47", "ovs_interfaceid": "e597fbea-47fd-4bc6-b92e-e1ca5ba6059a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Converting VIF {"id": "e597fbea-47fd-4bc6-b92e-e1ca5ba6059a", "address": "fa:16:3e:0b:7e:19", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape597fbea-47", "ovs_interfaceid": "e597fbea-47fd-4bc6-b92e-e1ca5ba6059a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7e:19,bridge_name='br-int',has_traffic_filtering=True,id=e597fbea-47fd-4bc6-b92e-e1ca5ba6059a,network=Network(023e393d-f8ef-42f1-8879-6259a82218cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape597fbea-47') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG nova.objects.instance [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lazy-loading 'pci_devices' on Instance uuid b16a3439-f343-4fae-9a5e-e07d8c84b955 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:51:30 user nova-compute[74342]:   <uuid>b16a3439-f343-4fae-9a5e-e07d8c84b955</uuid>
Oct 16 09:51:30 user nova-compute[74342]:   <name>instance-00000017</name>
Oct 16 09:51:30 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:51:30 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:51:30 user nova-compute[74342]:   <metadata>
Oct 16 09:51:30 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:51:30 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:51:30 user nova-compute[74342]:       <nova:name>tempest-AttachVolumeNegativeTest-server-475402272</nova:name>
Oct 16 09:51:30 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:51:30</nova:creationTime>
Oct 16 09:51:30 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:51:30 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:51:30 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:51:30 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:51:30 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:51:30 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:51:30 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:51:30 user nova-compute[74342]:       <nova:owner>
Oct 16 09:51:30 user nova-compute[74342]:         <nova:user uuid="ee02f6ad1d9749948f43fb432685d067">tempest-AttachVolumeNegativeTest-119585701-project-member</nova:user>
Oct 16 09:51:30 user nova-compute[74342]:         <nova:project uuid="08329cd0ad7d42a1999ca4f407d93245">tempest-AttachVolumeNegativeTest-119585701</nova:project>
Oct 16 09:51:30 user nova-compute[74342]:       </nova:owner>
Oct 16 09:51:30 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:51:30 user nova-compute[74342]:       <nova:ports>
Oct 16 09:51:30 user nova-compute[74342]:         <nova:port uuid="e597fbea-47fd-4bc6-b92e-e1ca5ba6059a">
Oct 16 09:51:30 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 16 09:51:30 user nova-compute[74342]:         </nova:port>
Oct 16 09:51:30 user nova-compute[74342]:       </nova:ports>
Oct 16 09:51:30 user nova-compute[74342]:     </nova:instance>
Oct 16 09:51:30 user nova-compute[74342]:   </metadata>
Oct 16 09:51:30 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:51:30 user nova-compute[74342]:     <system>
Oct 16 09:51:30 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:51:30 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:51:30 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:51:30 user nova-compute[74342]:       <entry name="serial">b16a3439-f343-4fae-9a5e-e07d8c84b955</entry>
Oct 16 09:51:30 user nova-compute[74342]:       <entry name="uuid">b16a3439-f343-4fae-9a5e-e07d8c84b955</entry>
Oct 16 09:51:30 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:51:30 user nova-compute[74342]:     </system>
Oct 16 09:51:30 user nova-compute[74342]:   </sysinfo>
Oct 16 09:51:30 user nova-compute[74342]:   <os>
Oct 16 09:51:30 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:51:30 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:51:30 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:51:30 user nova-compute[74342]:   </os>
Oct 16 09:51:30 user nova-compute[74342]:   <features>
Oct 16 09:51:30 user nova-compute[74342]:     <acpi/>
Oct 16 09:51:30 user nova-compute[74342]:     <apic/>
Oct 16 09:51:30 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:51:30 user nova-compute[74342]:   </features>
Oct 16 09:51:30 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:51:30 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:51:30 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:51:30 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:51:30 user nova-compute[74342]:   </clock>
Oct 16 09:51:30 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:51:30 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:51:30 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:51:30 user nova-compute[74342]:   </cpu>
Oct 16 09:51:30 user nova-compute[74342]:   <devices>
Oct 16 09:51:30 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 09:51:30 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 09:51:30 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/b16a3439-f343-4fae-9a5e-e07d8c84b955/disk"/>
Oct 16 09:51:30 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:51:30 user nova-compute[74342]:     </disk>
Oct 16 09:51:30 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:51:30 user nova-compute[74342]:       <mac address="fa:16:3e:0b:7e:19"/>
Oct 16 09:51:30 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:51:30 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:51:30 user nova-compute[74342]:       <target dev="tape597fbea-47"/>
Oct 16 09:51:30 user nova-compute[74342]:     </interface>
Oct 16 09:51:30 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:51:30 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/b16a3439-f343-4fae-9a5e-e07d8c84b955/console.log" append="off"/>
Oct 16 09:51:30 user nova-compute[74342]:     </serial>
Oct 16 09:51:30 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:51:30 user nova-compute[74342]:     <video>
Oct 16 09:51:30 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:51:30 user nova-compute[74342]:     </video>
Oct 16 09:51:30 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:51:30 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:51:30 user nova-compute[74342]:     </rng>
Oct 16 09:51:30 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:51:30 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:51:30 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:51:30 user nova-compute[74342]:     </memballoon>
Oct 16 09:51:30 user nova-compute[74342]:   </devices>
Oct 16 09:51:30 user nova-compute[74342]: </domain>
Oct 16 09:51:30 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:51:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-475402272',display_name='tempest-AttachVolumeNegativeTest-server-475402272',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-475402272',id=23,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMeIPdvex+JZNXj/40qWOU3f3UKPw8zHWUSC188YeGbQLbJ6P0u0Edksw6VipIFuh2or2bSs/2gWMgShxgKAGmFtBRcPIIWfTF3k0vP1ejV46S0PYhHmfblo/iqzFLyGA==',key_name='tempest-keypair-966876636',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08329cd0ad7d42a1999ca4f407d93245',ramdisk_id='',reservation_id='r-7udztms0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-119585701',owner_user_name='tempest-AttachVolumeNegativeTest-119585701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:51:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee02f6ad1d9749948f43fb432685d067',uuid=b16a3439-f343-4fae-9a5e-e07d8c84b955,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e597fbea-47fd-4bc6-b92e-e1ca5ba6059a", "address": "fa:16:3e:0b:7e:19", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape597fbea-47", "ovs_interfaceid": "e597fbea-47fd-4bc6-b92e-e1ca5ba6059a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Converting VIF {"id": "e597fbea-47fd-4bc6-b92e-e1ca5ba6059a", "address": "fa:16:3e:0b:7e:19", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape597fbea-47", "ovs_interfaceid": "e597fbea-47fd-4bc6-b92e-e1ca5ba6059a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7e:19,bridge_name='br-int',has_traffic_filtering=True,id=e597fbea-47fd-4bc6-b92e-e1ca5ba6059a,network=Network(023e393d-f8ef-42f1-8879-6259a82218cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape597fbea-47') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG os_vif [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7e:19,bridge_name='br-int',has_traffic_filtering=True,id=e597fbea-47fd-4bc6-b92e-e1ca5ba6059a,network=Network(023e393d-f8ef-42f1-8879-6259a82218cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape597fbea-47') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eb253ad8-f1a5-569c-9375-7720ac832387', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape597fbea-47, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape597fbea-47, col_values=(('qos', UUID('02e24948-2651-4ee8-a3a7-c047f3473585')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape597fbea-47, col_values=(('external_ids', {'iface-id': 'e597fbea-47fd-4bc6-b92e-e1ca5ba6059a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:7e:19', 'vm-uuid': 'b16a3439-f343-4fae-9a5e-e07d8c84b955'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:30 user nova-compute[74342]: INFO os_vif [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7e:19,bridge_name='br-int',has_traffic_filtering=True,id=e597fbea-47fd-4bc6-b92e-e1ca5ba6059a,network=Network(023e393d-f8ef-42f1-8879-6259a82218cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape597fbea-47')
Oct 16 09:51:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:51:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] No VIF found with MAC fa:16:3e:0b:7e:19, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:51:31 user nova-compute[74342]: DEBUG nova.compute.manager [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:51:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:51:31 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Instance spawned successfully.
Oct 16 09:51:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:51:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:51:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:51:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:51:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:51:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:51:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:51:31 user nova-compute[74342]: INFO nova.compute.manager [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Took 7.26 seconds to spawn the instance on the hypervisor.
Oct 16 09:51:31 user nova-compute[74342]: DEBUG nova.compute.manager [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:51:31 user nova-compute[74342]: DEBUG nova.compute.manager [req-f9f85ce2-450a-4b97-ac8f-4902b7240098 req-f7bfdaab-73b1-40de-b8b7-471d1ff56a6c service nova] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Received event network-changed-e597fbea-47fd-4bc6-b92e-e1ca5ba6059a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:51:31 user nova-compute[74342]: DEBUG nova.compute.manager [req-f9f85ce2-450a-4b97-ac8f-4902b7240098 req-f7bfdaab-73b1-40de-b8b7-471d1ff56a6c service nova] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Refreshing instance network info cache due to event network-changed-e597fbea-47fd-4bc6-b92e-e1ca5ba6059a. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:51:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f9f85ce2-450a-4b97-ac8f-4902b7240098 req-f7bfdaab-73b1-40de-b8b7-471d1ff56a6c service nova] Acquiring lock "refresh_cache-b16a3439-f343-4fae-9a5e-e07d8c84b955" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:51:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f9f85ce2-450a-4b97-ac8f-4902b7240098 req-f7bfdaab-73b1-40de-b8b7-471d1ff56a6c service nova] Acquired lock "refresh_cache-b16a3439-f343-4fae-9a5e-e07d8c84b955" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:51:31 user nova-compute[74342]: DEBUG nova.network.neutron [req-f9f85ce2-450a-4b97-ac8f-4902b7240098 req-f7bfdaab-73b1-40de-b8b7-471d1ff56a6c service nova] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Refreshing network info cache for port e597fbea-47fd-4bc6-b92e-e1ca5ba6059a {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:51:31 user nova-compute[74342]: INFO nova.compute.manager [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Took 43.66 seconds to build instance.
Oct 16 09:51:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4d2e1d00-49a7-4e47-8ab1-877e00dd6afa tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "2522364c-36c7-446d-87e7-113632ceeab6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.941s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:31 user nova-compute[74342]: DEBUG nova.compute.manager [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:51:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:51:31 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Instance spawned successfully.
Oct 16 09:51:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:51:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:51:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:51:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:51:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:51:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:51:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:51:31 user nova-compute[74342]: INFO nova.compute.manager [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Took 7.64 seconds to spawn the instance on the hypervisor.
Oct 16 09:51:31 user nova-compute[74342]: DEBUG nova.compute.manager [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:51:31 user nova-compute[74342]: INFO nova.compute.manager [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Took 8.70 seconds to build instance.
Oct 16 09:51:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8f3e747e-b5c8-4ea8-aceb-31f9077d6213 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "eeee39f2-9728-4114-8bd3-1d05f69a1215" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.818s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:31 user nova-compute[74342]: DEBUG nova.network.neutron [req-f9f85ce2-450a-4b97-ac8f-4902b7240098 req-f7bfdaab-73b1-40de-b8b7-471d1ff56a6c service nova] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Updated VIF entry in instance network info cache for port e597fbea-47fd-4bc6-b92e-e1ca5ba6059a. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:51:31 user nova-compute[74342]: DEBUG nova.network.neutron [req-f9f85ce2-450a-4b97-ac8f-4902b7240098 req-f7bfdaab-73b1-40de-b8b7-471d1ff56a6c service nova] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Updating instance_info_cache with network_info: [{"id": "e597fbea-47fd-4bc6-b92e-e1ca5ba6059a", "address": "fa:16:3e:0b:7e:19", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape597fbea-47", "ovs_interfaceid": "e597fbea-47fd-4bc6-b92e-e1ca5ba6059a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:51:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f9f85ce2-450a-4b97-ac8f-4902b7240098 req-f7bfdaab-73b1-40de-b8b7-471d1ff56a6c service nova] Releasing lock "refresh_cache-b16a3439-f343-4fae-9a5e-e07d8c84b955" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:51:31 user nova-compute[74342]: DEBUG nova.compute.manager [req-f9f85ce2-450a-4b97-ac8f-4902b7240098 req-f7bfdaab-73b1-40de-b8b7-471d1ff56a6c service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Received event network-vif-plugged-2f21663b-c324-4ed7-80ff-fedf6e5631c8 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:51:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f9f85ce2-450a-4b97-ac8f-4902b7240098 req-f7bfdaab-73b1-40de-b8b7-471d1ff56a6c service nova] Acquiring lock "eeee39f2-9728-4114-8bd3-1d05f69a1215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f9f85ce2-450a-4b97-ac8f-4902b7240098 req-f7bfdaab-73b1-40de-b8b7-471d1ff56a6c service nova] Lock "eeee39f2-9728-4114-8bd3-1d05f69a1215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f9f85ce2-450a-4b97-ac8f-4902b7240098 req-f7bfdaab-73b1-40de-b8b7-471d1ff56a6c service nova] Lock "eeee39f2-9728-4114-8bd3-1d05f69a1215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:31 user nova-compute[74342]: DEBUG nova.compute.manager [req-f9f85ce2-450a-4b97-ac8f-4902b7240098 req-f7bfdaab-73b1-40de-b8b7-471d1ff56a6c service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] No waiting events found dispatching network-vif-plugged-2f21663b-c324-4ed7-80ff-fedf6e5631c8 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:51:31 user nova-compute[74342]: WARNING nova.compute.manager [req-f9f85ce2-450a-4b97-ac8f-4902b7240098 req-f7bfdaab-73b1-40de-b8b7-471d1ff56a6c service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Received unexpected event network-vif-plugged-2f21663b-c324-4ed7-80ff-fedf6e5631c8 for instance with vm_state building and task_state spawning.
Oct 16 09:51:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:32 user nova-compute[74342]: DEBUG nova.compute.manager [req-14402ff7-1737-4b0e-a66e-af2185e5e285 req-6b3284b8-7ebc-4c97-ba8b-4d867701c7bb service nova] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Received event network-vif-plugged-e597fbea-47fd-4bc6-b92e-e1ca5ba6059a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:51:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-14402ff7-1737-4b0e-a66e-af2185e5e285 req-6b3284b8-7ebc-4c97-ba8b-4d867701c7bb service nova] Acquiring lock "b16a3439-f343-4fae-9a5e-e07d8c84b955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-14402ff7-1737-4b0e-a66e-af2185e5e285 req-6b3284b8-7ebc-4c97-ba8b-4d867701c7bb service nova] Lock "b16a3439-f343-4fae-9a5e-e07d8c84b955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-14402ff7-1737-4b0e-a66e-af2185e5e285 req-6b3284b8-7ebc-4c97-ba8b-4d867701c7bb service nova] Lock "b16a3439-f343-4fae-9a5e-e07d8c84b955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:32 user nova-compute[74342]: DEBUG nova.compute.manager [req-14402ff7-1737-4b0e-a66e-af2185e5e285 req-6b3284b8-7ebc-4c97-ba8b-4d867701c7bb service nova] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] No waiting events found dispatching network-vif-plugged-e597fbea-47fd-4bc6-b92e-e1ca5ba6059a {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:51:32 user nova-compute[74342]: WARNING nova.compute.manager [req-14402ff7-1737-4b0e-a66e-af2185e5e285 req-6b3284b8-7ebc-4c97-ba8b-4d867701c7bb service nova] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Received unexpected event network-vif-plugged-e597fbea-47fd-4bc6-b92e-e1ca5ba6059a for instance with vm_state building and task_state spawning.
Oct 16 09:51:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUtsWFpE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:51:33 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:51:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:51:33 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:51:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:51:33 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e3d145-c007-4c99-be81-c6091979d47c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 09:51:33 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.031s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b50e76da-1ad6-4ab2-ab92-7308c2fa57e2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449] added
Oct 16 09:51:33 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[741555a1-2fd2-4a00-a0f2-d7b56f41e118]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd364ef5-941e-4c79-b72d-c6edb113a635]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qUtsWFpE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qUtsWFpE" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d4af26-8bc0-4658-9db9-d8257a868712]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qUtsWFpE'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bf09f9-8ff5-42c9-9488-cae80eeab39a]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec20750-e984-4043-b743-7c2d9da1fd3e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:51:33 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:51:33 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:51:33 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:51:33 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:51:33 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:51:33 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e050d998-7152-48d9-a001-a41e5462cd66]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449, portal: 172.16.0.220,3260]
Oct 16 09:51:33 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449, portal: 172.16.0.220,3260] successful.
Oct 16 09:51:33 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8130c7f-7bb0-4b39-9d4f-0eaa057e7055]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[47fae548-f9f0-4a03-be92-efb7fe085eb7]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:51:33 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:51:33 user nova-compute[74342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)
Oct 16 09:51:33 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:51:33 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:51:33 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:51:33 user nova-compute[74342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)
Oct 16 09:51:33 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:51:33 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] HCTL ('36', '-', '-', 0) found on session 12 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fb7305-e063-4a60-be28-10a66250533b]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:33 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Searching for a device in session 12 and hctl ['36', '*', '*', 0] yield: None {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:51:34 user nova-compute[74342]: DEBUG nova.compute.manager [req-5d9a4a82-3d5d-4097-9680-ecd7b44dc174 req-3bae765e-f607-4582-ba3a-05546b3f9e37 service nova] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Received event network-vif-plugged-e597fbea-47fd-4bc6-b92e-e1ca5ba6059a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:51:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5d9a4a82-3d5d-4097-9680-ecd7b44dc174 req-3bae765e-f607-4582-ba3a-05546b3f9e37 service nova] Acquiring lock "b16a3439-f343-4fae-9a5e-e07d8c84b955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5d9a4a82-3d5d-4097-9680-ecd7b44dc174 req-3bae765e-f607-4582-ba3a-05546b3f9e37 service nova] Lock "b16a3439-f343-4fae-9a5e-e07d8c84b955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5d9a4a82-3d5d-4097-9680-ecd7b44dc174 req-3bae765e-f607-4582-ba3a-05546b3f9e37 service nova] Lock "b16a3439-f343-4fae-9a5e-e07d8c84b955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:34 user nova-compute[74342]: DEBUG nova.compute.manager [req-5d9a4a82-3d5d-4097-9680-ecd7b44dc174 req-3bae765e-f607-4582-ba3a-05546b3f9e37 service nova] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] No waiting events found dispatching network-vif-plugged-e597fbea-47fd-4bc6-b92e-e1ca5ba6059a {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:51:34 user nova-compute[74342]: WARNING nova.compute.manager [req-5d9a4a82-3d5d-4097-9680-ecd7b44dc174 req-3bae765e-f607-4582-ba3a-05546b3f9e37 service nova] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Received unexpected event network-vif-plugged-e597fbea-47fd-4bc6-b92e-e1ca5ba6059a for instance with vm_state building and task_state spawning.
Oct 16 09:51:34 user nova-compute[74342]: DEBUG nova.compute.manager [req-5d9a4a82-3d5d-4097-9680-ecd7b44dc174 req-3bae765e-f607-4582-ba3a-05546b3f9e37 service nova] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Received event network-changed-725894e9-c57a-469c-a85c-d5d9aabb805a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:51:34 user nova-compute[74342]: DEBUG nova.compute.manager [req-5d9a4a82-3d5d-4097-9680-ecd7b44dc174 req-3bae765e-f607-4582-ba3a-05546b3f9e37 service nova] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Refreshing instance network info cache due to event network-changed-725894e9-c57a-469c-a85c-d5d9aabb805a. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:51:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5d9a4a82-3d5d-4097-9680-ecd7b44dc174 req-3bae765e-f607-4582-ba3a-05546b3f9e37 service nova] Acquiring lock "refresh_cache-f3c66abd-af75-4b48-9e29-ab4335f229f3" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:51:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5d9a4a82-3d5d-4097-9680-ecd7b44dc174 req-3bae765e-f607-4582-ba3a-05546b3f9e37 service nova] Acquired lock "refresh_cache-f3c66abd-af75-4b48-9e29-ab4335f229f3" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:51:34 user nova-compute[74342]: DEBUG nova.network.neutron [req-5d9a4a82-3d5d-4097-9680-ecd7b44dc174 req-3bae765e-f607-4582-ba3a-05546b3f9e37 service nova] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Refreshing network info cache for port 725894e9-c57a-469c-a85c-d5d9aabb805a {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:51:34 user nova-compute[74342]: DEBUG nova.compute.manager [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:51:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:51:34 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Instance spawned successfully.
Oct 16 09:51:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:51:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:51:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:51:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:51:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:51:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:51:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:51:34 user nova-compute[74342]: INFO nova.compute.manager [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Took 6.73 seconds to spawn the instance on the hypervisor.
Oct 16 09:51:34 user nova-compute[74342]: DEBUG nova.compute.manager [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:51:34 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Searching for a device in session 12 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:51:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUtsWFpE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 09:51:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.404s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:51:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] <== connect_volume: return (1405ms) {'type': 'block', 'scsi_wwn': '23733356635623865', 'path': '/dev/sde'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:51:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23733356635623865', 'path': '/dev/sde'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 09:51:34 user nova-compute[74342]: INFO nova.compute.manager [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Took 7.74 seconds to build instance.
Oct 16 09:51:34 user nova-compute[74342]: DEBUG nova.objects.instance [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lazy-loading 'flavor' on Instance uuid a9acd5f6-12e3-488b-b6c6-e4b81f5fc897 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:51:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-281f3d21-afae-482e-8418-437bb0221a4d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "b16a3439-f343-4fae-9a5e-e07d8c84b955" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.874s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 09:51:34 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:51:34 user nova-compute[74342]:   <source dev="/dev/sde"/>
Oct 16 09:51:34 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:51:34 user nova-compute[74342]:   <serial>ed3c06eb-8a87-4939-b3f5-28aecc6c0449</serial>
Oct 16 09:51:34 user nova-compute[74342]: </disk>
Oct 16 09:51:34 user nova-compute[74342]:  {{(pid=74342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 09:51:34 user nova-compute[74342]: DEBUG nova.network.neutron [req-5d9a4a82-3d5d-4097-9680-ecd7b44dc174 req-3bae765e-f607-4582-ba3a-05546b3f9e37 service nova] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Updated VIF entry in instance network info cache for port 725894e9-c57a-469c-a85c-d5d9aabb805a. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:51:34 user nova-compute[74342]: DEBUG nova.network.neutron [req-5d9a4a82-3d5d-4097-9680-ecd7b44dc174 req-3bae765e-f607-4582-ba3a-05546b3f9e37 service nova] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Updating instance_info_cache with network_info: [{"id": "725894e9-c57a-469c-a85c-d5d9aabb805a", "address": "fa:16:3e:fe:a5:67", "network": {"id": "7bc80f1e-0315-4a4e-bc89-2ad397451db6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1430189260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afd0e8f0d424fe393636bbcd26eed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725894e9-c5", "ovs_interfaceid": "725894e9-c57a-469c-a85c-d5d9aabb805a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:51:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5d9a4a82-3d5d-4097-9680-ecd7b44dc174 req-3bae765e-f607-4582-ba3a-05546b3f9e37 service nova] Releasing lock "refresh_cache-f3c66abd-af75-4b48-9e29-ab4335f229f3" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:51:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:51:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:51:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] No VIF found with MAC fa:16:3e:5a:fd:10, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:51:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0e2161b4-a28d-4779-a902-28c90ad336f3 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.439s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Acquiring lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:39 user nova-compute[74342]: DEBUG nova.objects.instance [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lazy-loading 'flavor' on Instance uuid a9acd5f6-12e3-488b-b6c6-e4b81f5fc897 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:51:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Acquiring lock "f3c66abd-af75-4b48-9e29-ab4335f229f3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "f3c66abd-af75-4b48-9e29-ab4335f229f3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Acquiring lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:39 user nova-compute[74342]: INFO nova.compute.manager [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Attaching volume d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 to /dev/vdc
Oct 16 09:51:39 user nova-compute[74342]: DEBUG nova.objects.instance [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lazy-loading 'flavor' on Instance uuid f3c66abd-af75-4b48-9e29-ab4335f229f3 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:51:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "f3c66abd-af75-4b48-9e29-ab4335f229f3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG os_brick.utils [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b2f96e-7875-450f-911d-2ed61649e0b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[73e79ca7-c11e-4686-af25-dfb0c9b50939]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.029s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[616b2151-9278-43ad-b38e-8a4286392823]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[380e08b7-c5e1-48b7-b9ee-d9c9ad09ecea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:51:40 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7063cbf-a313-46e1-afeb-66bc37813dba]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG os_brick.utils [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Updating existing volume attachment record: 6c5179ba-75f7-4d4e-bee0-c3e1d8174526 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Acquiring lock "f3c66abd-af75-4b48-9e29-ab4335f229f3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "f3c66abd-af75-4b48-9e29-ab4335f229f3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:40 user nova-compute[74342]: INFO nova.compute.manager [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Attaching volume 9ee09392-ed74-408a-be8a-a219ba46dcaa to /dev/vdb
Oct 16 09:51:40 user nova-compute[74342]: DEBUG os_brick.utils [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eb0fc59-dc11-496d-a19f-5b7195c98434]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[efaef1a0-37a0-44c2-afac-ecc12597aed5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb4d2c3b-e615-4266-a8d0-870d9ed2f85d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88814cd-f077-44a7-9ed1-9466ce939aff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:51:40 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:51:40 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[332663a0-d596-410d-ae13-a28dd5d11190]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG os_brick.utils [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Updating existing volume attachment record: 768000a2-f5b9-41a7-929d-1de4c5850284 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 09:51:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:47 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:51:47 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:47 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:47 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:47 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 09:51:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9acd5f6-12e3-488b-b6c6-e4b81f5fc897/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9acd5f6-12e3-488b-b6c6-e4b81f5fc897/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9acd5f6-12e3-488b-b6c6-e4b81f5fc897/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9acd5f6-12e3-488b-b6c6-e4b81f5fc897/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:48 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:51:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:51:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e6e026-f958-40c4-ab99-19deaaa1590d/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e6e026-f958-40c4-ab99-19deaaa1590d/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e6e026-f958-40c4-ab99-19deaaa1590d/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e6e026-f958-40c4-ab99-19deaaa1590d/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a7676e-87d8-4e8a-832a-67a5470f16a1/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a7676e-87d8-4e8a-832a-67a5470f16a1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a7676e-87d8-4e8a-832a-67a5470f16a1/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a7676e-87d8-4e8a-832a-67a5470f16a1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:51 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:51:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:51 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:51:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b16a3439-f343-4fae-9a5e-e07d8c84b955/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b16a3439-f343-4fae-9a5e-e07d8c84b955/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b16a3439-f343-4fae-9a5e-e07d8c84b955/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b16a3439-f343-4fae-9a5e-e07d8c84b955/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:52 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:51:52 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:51:52 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=6927MB free_disk=25.18470001220703GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 09:51:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:51:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:51:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance d45abd20-3a58-4657-8f4c-a426d8e39be3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:51:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 98367a96-22f0-4edb-ab03-a8eb286b437b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:51:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 017caffb-5be2-4e78-ab48-a8091c5c00f4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:51:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 5dc86029-dcbf-4886-bdc9-7d4413059c96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:51:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance edcefbe0-e89f-4496-9032-f9431d9d5c53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:51:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance c5e44d3b-ed41-4920-825f-e1d283caecfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:51:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:51:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance a9acd5f6-12e3-488b-b6c6-e4b81f5fc897 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:51:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance f3c66abd-af75-4b48-9e29-ab4335f229f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:51:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 2522364c-36c7-446d-87e7-113632ceeab6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:51:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 68e6e026-f958-40c4-ab99-19deaaa1590d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:51:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance a9a7676e-87d8-4e8a-832a-67a5470f16a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:51:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance eeee39f2-9728-4114-8bd3-1d05f69a1215 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:51:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance b16a3439-f343-4fae-9a5e-e07d8c84b955 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:51:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 09:51:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 09:51:53 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:51:53 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:51:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 09:51:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.650s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:51:54 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:51:54 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:51:54 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 09:51:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-5dc86029-dcbf-4886-bdc9-7d4413059c96" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:51:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-5dc86029-dcbf-4886-bdc9-7d4413059c96" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:51:54 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 09:51:54 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Updating instance_info_cache with network_info: [{"id": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "address": "fa:16:3e:72:e1:f9", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951f9dec-9a", "ovs_interfaceid": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:51:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-5dc86029-dcbf-4886-bdc9-7d4413059c96" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:51:54 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 09:51:54 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:51:54 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:51:54 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:51:55 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:51:55 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:51:55 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 09:51:55 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sTBILSdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:51:57 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:51:57 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:51:57 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:51:57 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:51:57 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 09:51:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddb6d8a-5bfe-43c7-b87f-09e2a95a8161]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 09:51:57 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2efaac48-17d0-46e6-aeec-c6814f484b4f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9] added
Oct 16 09:51:57 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d908406-994b-4512-9a5b-8f05a9e2f673]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bba3496-cdaf-4199-8ffd-8cac725ad35e]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sTBILSdV {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sTBILSdV" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d57b41-25eb-49ca-b11f-57713b8c8db8]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sTBILSdV'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1709c2e4-9c8b-4fe0-b3da-a2a3f9b3ebae]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:58 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6536df-4a36-4899-948b-2ba845504f2d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:58 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:51:58 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:51:58 user nova-compute[74342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)
Oct 16 09:51:58 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:51:58 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:51:58 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:51:58 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:51:58 user nova-compute[74342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)
Oct 16 09:51:58 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:51:58 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:51:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:58 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb429bfd-ba7a-487d-ba38-4e30f0298c73]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:58 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9, portal: 172.16.0.220,3260]
Oct 16 09:51:58 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9, portal: 172.16.0.220,3260] successful.
Oct 16 09:51:58 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:58 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[122f966a-0e45-4edc-bd5f-e8cfc9a1aa76]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:58 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:58 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c6506d-5618-40e9-875e-8979a972a11e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:58 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:51:58 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:51:58 user nova-compute[74342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)
Oct 16 09:51:58 user nova-compute[74342]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 (non-flash)
Oct 16 09:51:58 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:51:58 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:51:58 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:51:58 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:51:58 user nova-compute[74342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)
Oct 16 09:51:58 user nova-compute[74342]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 (non-flash)
Oct 16 09:51:58 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:51:58 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:51:58 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.276s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:51:58 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 09:51:58 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] HCTL ('37', '-', '-', 0) found on session 13 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 09:51:58 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 09:51:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.026s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:58 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6024d1a6-0296-4fff-adab-1923283ab989]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:58 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Searching for a device in session 13 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:51:58 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sTBILSdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 09:51:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 09:51:58 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSwFEMar', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:51:58 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:51:58 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.320s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '23033303334616132', 'path': '/dev/sdf'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23033303334616132', 'path': '/dev/sdf'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.789s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:51:59 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:51:59 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:51:59 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG nova.objects.instance [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lazy-loading 'flavor' on Instance uuid a9acd5f6-12e3-488b-b6c6-e4b81f5fc897 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f773ce06-bfb1-4d94-9e1b-8faff59ae9b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 09:51:59 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 09:51:59 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:51:59 user nova-compute[74342]:   <source dev="/dev/sdf"/>
Oct 16 09:51:59 user nova-compute[74342]:   <target dev="vdc" bus="virtio"/>
Oct 16 09:51:59 user nova-compute[74342]:   <serial>d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9</serial>
Oct 16 09:51:59 user nova-compute[74342]: </disk>
Oct 16 09:51:59 user nova-compute[74342]:  {{(pid=74342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[396ec7a6-a299-4212-b1ae-7618d44bcf26]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa] added
Oct 16 09:51:59 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[173d5ee4-7794-4a51-b633-17c41af6132c]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bece1e02-98a8-464a-8f97-5e053915e09b]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uSwFEMar {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uSwFEMar" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dfd3d75-e5c1-4a81-aa1c-781862565f08]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uSwFEMar'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f553bc5-9795-43c1-991f-84eef49f1880]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b9a6366-67cf-4e1d-99d4-5bf11a48add0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:51:59 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:51:59 user nova-compute[74342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)
Oct 16 09:51:59 user nova-compute[74342]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 (non-flash)
Oct 16 09:51:59 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:51:59 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:51:59 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:51:59 user nova-compute[74342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)
Oct 16 09:51:59 user nova-compute[74342]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 (non-flash)
Oct 16 09:51:59 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:51:59 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa -p 172.16.0.220:3260 --login" returned: 0 in 0.082s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[96648368-eb6c-40e7-b591-b00d33b0794b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa, portal: 172.16.0.220,3260]
Oct 16 09:51:59 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa, portal: 172.16.0.220,3260] successful.
Oct 16 09:51:59 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cf0b73-1146-4d4e-9471-bccfe9f82bd8]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[22368c15-4250-4b46-9ef5-27c1ed8818d9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:51:59 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:51:59 user nova-compute[74342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)
Oct 16 09:51:59 user nova-compute[74342]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 (non-flash)
Oct 16 09:51:59 user nova-compute[74342]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa (non-flash)
Oct 16 09:51:59 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:51:59 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:51:59 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:51:59 user nova-compute[74342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)
Oct 16 09:51:59 user nova-compute[74342]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 (non-flash)
Oct 16 09:51:59 user nova-compute[74342]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa (non-flash)
Oct 16 09:51:59 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:51:59 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.309s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] HCTL ('38', '-', '-', 0) found on session 14 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9767b4af-b5dc-43ef-816d-78461542c8d8]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Searching for a device in session 14 and hctl ['38', '*', '*', 0] yield: None {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] No VIF found with MAC fa:16:3e:5a:fd:10, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:51:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0a16dd6f-995a-4d6c-8279-7bd85f1301ed tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.970s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:00 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Searching for a device in session 14 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:52:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSwFEMar', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 09:52:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:52:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] <== connect_volume: return (2128ms) {'type': 'block', 'scsi_wwn': '23831633564363532', 'path': '/dev/sdg'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:52:00 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23831633564363532', 'path': '/dev/sdg'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 09:52:00 user nova-compute[74342]: DEBUG nova.objects.instance [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lazy-loading 'flavor' on Instance uuid f3c66abd-af75-4b48-9e29-ab4335f229f3 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:52:00 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 09:52:00 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:52:00 user nova-compute[74342]:   <source dev="/dev/sdg"/>
Oct 16 09:52:00 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:52:00 user nova-compute[74342]:   <serial>9ee09392-ed74-408a-be8a-a219ba46dcaa</serial>
Oct 16 09:52:00 user nova-compute[74342]: </disk>
Oct 16 09:52:00 user nova-compute[74342]:  {{(pid=74342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 09:52:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Acquiring lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:00 user nova-compute[74342]: INFO nova.compute.manager [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Detaching volume d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9
Oct 16 09:52:00 user nova-compute[74342]: INFO nova.virt.block_device [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Attempting to driver detach volume d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 from mountpoint /dev/vdc
Oct 16 09:52:00 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Attempting to detach device vdc from instance a9acd5f6-12e3-488b-b6c6-e4b81f5fc897 from the persistent domain config. {{(pid=74342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 09:52:00 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 09:52:00 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:52:00 user nova-compute[74342]:   <source dev="/dev/sdf"/>
Oct 16 09:52:00 user nova-compute[74342]:   <target dev="vdc" bus="virtio"/>
Oct 16 09:52:00 user nova-compute[74342]:   <serial>d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9</serial>
Oct 16 09:52:00 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 16 09:52:00 user nova-compute[74342]: </disk>
Oct 16 09:52:00 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 09:52:00 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Successfully detached device vdc from instance a9acd5f6-12e3-488b-b6c6-e4b81f5fc897 from the persistent domain config.
Oct 16 09:52:00 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance a9acd5f6-12e3-488b-b6c6-e4b81f5fc897 from the live domain config. {{(pid=74342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 09:52:00 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 09:52:00 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:52:00 user nova-compute[74342]:   <source dev="/dev/sdf"/>
Oct 16 09:52:00 user nova-compute[74342]:   <target dev="vdc" bus="virtio"/>
Oct 16 09:52:00 user nova-compute[74342]:   <serial>d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9</serial>
Oct 16 09:52:00 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 16 09:52:00 user nova-compute[74342]: </disk>
Oct 16 09:52:00 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 09:52:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:00 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:52:00 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:52:00 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] No VIF found with MAC fa:16:3e:fe:a5:67, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:52:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-494eaa40-0332-40c2-851d-8dfb4e932a4c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "f3c66abd-af75-4b48-9e29-ab4335f229f3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.801s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance a9acd5f6-12e3-488b-b6c6-e4b81f5fc897 {{(pid=74342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 09:52:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Acquiring lock "f3c66abd-af75-4b48-9e29-ab4335f229f3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "f3c66abd-af75-4b48-9e29-ab4335f229f3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:02 user nova-compute[74342]: INFO nova.compute.manager [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Detaching volume 9ee09392-ed74-408a-be8a-a219ba46dcaa
Oct 16 09:52:02 user nova-compute[74342]: INFO nova.virt.block_device [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Attempting to driver detach volume 9ee09392-ed74-408a-be8a-a219ba46dcaa from mountpoint /dev/vdb
Oct 16 09:52:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Attempting to detach device vdb from instance f3c66abd-af75-4b48-9e29-ab4335f229f3 from the persistent domain config. {{(pid=74342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 09:52:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 09:52:02 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:52:02 user nova-compute[74342]:   <source dev="/dev/sdg"/>
Oct 16 09:52:02 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:52:02 user nova-compute[74342]:   <serial>9ee09392-ed74-408a-be8a-a219ba46dcaa</serial>
Oct 16 09:52:02 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 09:52:02 user nova-compute[74342]: </disk>
Oct 16 09:52:02 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 09:52:02 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Successfully detached device vdb from instance f3c66abd-af75-4b48-9e29-ab4335f229f3 from the persistent domain config.
Oct 16 09:52:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance f3c66abd-af75-4b48-9e29-ab4335f229f3 from the live domain config. {{(pid=74342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 09:52:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 09:52:02 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:52:02 user nova-compute[74342]:   <source dev="/dev/sdg"/>
Oct 16 09:52:02 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:52:02 user nova-compute[74342]:   <serial>9ee09392-ed74-408a-be8a-a219ba46dcaa</serial>
Oct 16 09:52:02 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 09:52:02 user nova-compute[74342]: </disk>
Oct 16 09:52:02 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 09:52:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance f3c66abd-af75-4b48-9e29-ab4335f229f3 {{(pid=74342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 09:52:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:52:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 09:52:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 09:52:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 09:52:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:21 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance a9acd5f6-12e3-488b-b6c6-e4b81f5fc897 is timed out.
Oct 16 09:52:21 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Successfully detached device vdc from instance a9acd5f6-12e3-488b-b6c6-e4b81f5fc897 from the live domain config.
Oct 16 09:52:21 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sTBILSdV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:52:21 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:52:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9a5417d-6283-4839-8662-097676df574d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 09:52:21 user nova-compute[74342]: No targets found.
Oct 16 09:52:21 user nova-compute[74342]: iSNS:
Oct 16 09:52:21 user nova-compute[74342]: No targets found.
Oct 16 09:52:21 user nova-compute[74342]: STATIC:
Oct 16 09:52:21 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea
Oct 16 09:52:21 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:52:21 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:52:21 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192
Oct 16 09:52:21 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:52:21 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:52:21 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84
Oct 16 09:52:21 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:52:21 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:52:21 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449
Oct 16 09:52:21 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:52:21 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:52:21 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9
Oct 16 09:52:21 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:52:21 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:52:21 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa
Oct 16 09:52:21 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:52:21 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:52:21 user nova-compute[74342]: FIRMWARE:
Oct 16 09:52:21 user nova-compute[74342]: No targets found.
Oct 16 09:52:21 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 09:52:21 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 09:52:21 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2a1d4c-14c2-40ee-871e-aeaa9775866c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6e0b88-e86c-4309-b194-b697c2c5f610]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:52:21 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:52:21 user nova-compute[74342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)
Oct 16 09:52:21 user nova-compute[74342]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 (non-flash)
Oct 16 09:52:21 user nova-compute[74342]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa (non-flash)
Oct 16 09:52:21 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:52:21 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:52:21 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:52:21 user nova-compute[74342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)
Oct 16 09:52:21 user nova-compute[74342]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 (non-flash)
Oct 16 09:52:21 user nova-compute[74342]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa (non-flash)
Oct 16 09:52:21 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:52:21 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b804b4a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9'): ({'sdf'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Removing single pathed devices sdf {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36ac838-2e67-4af7-aaee-74d25dd8e8b7]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[371f2b98-0c88-43a9-84ea-cf4c2f399eb9]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Flushing IO for device /dev/sdf {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b4ba2c7-b3d4-4b82-b96e-c597ffa4466e]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebf316e5-e24b-49de-a03c-9dce3416748e]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] SCSI volumes sdf have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[680b352b-6eb5-4673-9aa7-1bc2df7f8c1d]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf9e839-2810-49a9-8468-6de6efbb676a]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9, portal: 172.16.0.220,3260]
Oct 16 09:52:21 user nova-compute[74342]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9, portal: 172.16.0.220,3260] successful.
Oct 16 09:52:21 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d97e6f6f-ddfa-446b-bfe6-853f82d9e3f9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[88f55d1c-6929-4733-bdda-e7a5471ed60d]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] <== disconnect_volume: return (319ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:52:21 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG nova.objects.instance [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lazy-loading 'flavor' on Instance uuid a9acd5f6-12e3-488b-b6c6-e4b81f5fc897 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0688af9e-a6b8-41bc-b108-8153e496d342 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.694s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:22 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance f3c66abd-af75-4b48-9e29-ab4335f229f3 is timed out.
Oct 16 09:52:22 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Successfully detached device vdb from instance f3c66abd-af75-4b48-9e29-ab4335f229f3 from the live domain config.
Oct 16 09:52:22 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSwFEMar', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:52:22 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:52:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a00fb5-bef9-41bd-8ce1-d96a31df81ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 09:52:22 user nova-compute[74342]: No targets found.
Oct 16 09:52:22 user nova-compute[74342]: iSNS:
Oct 16 09:52:22 user nova-compute[74342]: No targets found.
Oct 16 09:52:22 user nova-compute[74342]: STATIC:
Oct 16 09:52:22 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea
Oct 16 09:52:22 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:52:22 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:52:22 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192
Oct 16 09:52:22 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:52:22 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:52:22 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84
Oct 16 09:52:22 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:52:22 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:52:22 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449
Oct 16 09:52:22 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:52:22 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:52:22 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa
Oct 16 09:52:22 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:52:22 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:52:22 user nova-compute[74342]: FIRMWARE:
Oct 16 09:52:22 user nova-compute[74342]: No targets found.
Oct 16 09:52:22 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 09:52:22 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 09:52:22 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86e49dc-fc28-4f58-81b4-0e57ebb5b6aa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcbe710-c9a7-4bc5-bb8b-1ba38a2f0420]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:52:22 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:52:22 user nova-compute[74342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)
Oct 16 09:52:22 user nova-compute[74342]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa (non-flash)
Oct 16 09:52:22 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:52:22 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:52:22 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:52:22 user nova-compute[74342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)
Oct 16 09:52:22 user nova-compute[74342]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa (non-flash)
Oct 16 09:52:22 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:52:22 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b602908b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa'): ({'sdg'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Removing single pathed devices sdg {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[983ed506-50c6-489b-b763-9ffa0cdb8c20]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd5d37cc-514c-4710-8067-57f5e557127b]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Flushing IO for device /dev/sdg {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4e6b9b-8133-4b59-b202-a13ee49cea07]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 09:52:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.040s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:23 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5567f53d-ab73-46d0-b717-5359a76d59ab]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:23 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 09:52:23 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] SCSI volumes sdg have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 09:52:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 09:52:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:23 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f77e28f-5d5b-47d8-af95-d11751bd865e]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:52:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:23 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2312ee-8ba3-4b7b-9054-f6b8426b2a46]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa, portal: 172.16.0.220,3260]
Oct 16 09:52:23 user nova-compute[74342]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa, portal: 172.16.0.220,3260] successful.
Oct 16 09:52:23 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:52:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ee09392-ed74-408a-be8a-a219ba46dcaa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:23 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[39984dbd-af3e-4596-9bda-d3b238c33930]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:52:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:52:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] <== disconnect_volume: return (317ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:52:23 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 09:52:23 user nova-compute[74342]: DEBUG nova.objects.instance [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lazy-loading 'flavor' on Instance uuid f3c66abd-af75-4b48-9e29-ab4335f229f3 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:52:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a2fff8ee-cf95-4a06-8302-b76217cfe33d tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "f3c66abd-af75-4b48-9e29-ab4335f229f3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.746s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "4f3aa905-8eae-45cb-8019-0b991286fe42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:34 user nova-compute[74342]: DEBUG nova.compute.manager [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:52:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:34 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:52:34 user nova-compute[74342]: INFO nova.compute.claims [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Claim successful on node user
Oct 16 09:52:34 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:52:34 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:52:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.591s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:34 user nova-compute[74342]: DEBUG nova.compute.manager [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:52:35 user nova-compute[74342]: DEBUG nova.compute.manager [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:52:35 user nova-compute[74342]: DEBUG nova.network.neutron [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:52:35 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:52:35 user nova-compute[74342]: DEBUG nova.compute.manager [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:52:35 user nova-compute[74342]: DEBUG nova.policy [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc0dfbfdb77347cda95ba991d37c311d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c28511c6c42147db9a0992cf40e044bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:52:35 user nova-compute[74342]: DEBUG nova.compute.manager [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 09:52:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:52:35 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Creating image(s)
Oct 16 09:52:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "/opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "/opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "/opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.200s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.184s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk 1073741824" returned: 0 in 0.048s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:35 user nova-compute[74342]: DEBUG nova.network.neutron [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Successfully created port: 0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:52:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.185s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:35 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 09:52:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Cannot resize image /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Ensure instance console log exists: /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.network.neutron [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Successfully updated port: 0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "refresh_cache-4f3aa905-8eae-45cb-8019-0b991286fe42" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquired lock "refresh_cache-4f3aa905-8eae-45cb-8019-0b991286fe42" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.network.neutron [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.compute.manager [req-748330c8-d0f6-4a66-8ce3-1b5f857a9751 req-0adff3a5-5ad4-480c-b0a9-e1a2312ee899 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Received event network-changed-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.compute.manager [req-748330c8-d0f6-4a66-8ce3-1b5f857a9751 req-0adff3a5-5ad4-480c-b0a9-e1a2312ee899 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Refreshing instance network info cache due to event network-changed-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-748330c8-d0f6-4a66-8ce3-1b5f857a9751 req-0adff3a5-5ad4-480c-b0a9-e1a2312ee899 service nova] Acquiring lock "refresh_cache-4f3aa905-8eae-45cb-8019-0b991286fe42" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.network.neutron [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.network.neutron [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Updating instance_info_cache with network_info: [{"id": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "address": "fa:16:3e:82:00:ac", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4258aa-96", "ovs_interfaceid": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Releasing lock "refresh_cache-4f3aa905-8eae-45cb-8019-0b991286fe42" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.compute.manager [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Instance network_info: |[{"id": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "address": "fa:16:3e:82:00:ac", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4258aa-96", "ovs_interfaceid": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-748330c8-d0f6-4a66-8ce3-1b5f857a9751 req-0adff3a5-5ad4-480c-b0a9-e1a2312ee899 service nova] Acquired lock "refresh_cache-4f3aa905-8eae-45cb-8019-0b991286fe42" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.network.neutron [req-748330c8-d0f6-4a66-8ce3-1b5f857a9751 req-0adff3a5-5ad4-480c-b0a9-e1a2312ee899 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Refreshing network info cache for port 0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Start _get_guest_xml network_info=[{"id": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "address": "fa:16:3e:82:00:ac", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4258aa-96", "ovs_interfaceid": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:52:36 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:52:36 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1589424972',display_name='tempest-AttachVolumeTestJSON-server-1589424972',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1589424972',id=24,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBO8M7UyZeyQg1aYm+ByuTDEoeaBTTsQAFljuagcRlcGDhfx2FLzwqTOwmYqO1+0IHWLuSXoneV6tc1mCRPSiL9W+Jq0YYyfdyDE26TRgq7GChyXwYOsK9694M/+yJ6Kw==',key_name='tempest-keypair-1616245480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c28511c6c42147db9a0992cf40e044bb',ramdisk_id='',reservation_id='r-tipl03lh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-965713551',owner_user_name='tempest-AttachVolumeTestJSON-965713551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:52:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc0dfbfdb77347cda95ba991d37c311d',uuid=4f3aa905-8eae-45cb-8019-0b991286fe42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "address": "fa:16:3e:82:00:ac", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4258aa-96", "ovs_interfaceid": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Converting VIF {"id": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "address": "fa:16:3e:82:00:ac", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4258aa-96", "ovs_interfaceid": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:00:ac,bridge_name='br-int',has_traffic_filtering=True,id=0e4258aa-9686-4cf1-9d1a-5bf61e7ba193,network=Network(54ba0b2e-1a1f-44a4-ba26-8a96960d4165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e4258aa-96') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.objects.instance [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f3aa905-8eae-45cb-8019-0b991286fe42 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:52:36 user nova-compute[74342]:   <uuid>4f3aa905-8eae-45cb-8019-0b991286fe42</uuid>
Oct 16 09:52:36 user nova-compute[74342]:   <name>instance-00000018</name>
Oct 16 09:52:36 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:52:36 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:52:36 user nova-compute[74342]:   <metadata>
Oct 16 09:52:36 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:52:36 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:52:36 user nova-compute[74342]:       <nova:name>tempest-AttachVolumeTestJSON-server-1589424972</nova:name>
Oct 16 09:52:36 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:52:36</nova:creationTime>
Oct 16 09:52:36 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:52:36 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:52:36 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:52:36 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:52:36 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:52:36 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:52:36 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:52:36 user nova-compute[74342]:       <nova:owner>
Oct 16 09:52:36 user nova-compute[74342]:         <nova:user uuid="bc0dfbfdb77347cda95ba991d37c311d">tempest-AttachVolumeTestJSON-965713551-project-member</nova:user>
Oct 16 09:52:36 user nova-compute[74342]:         <nova:project uuid="c28511c6c42147db9a0992cf40e044bb">tempest-AttachVolumeTestJSON-965713551</nova:project>
Oct 16 09:52:36 user nova-compute[74342]:       </nova:owner>
Oct 16 09:52:36 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:52:36 user nova-compute[74342]:       <nova:ports>
Oct 16 09:52:36 user nova-compute[74342]:         <nova:port uuid="0e4258aa-9686-4cf1-9d1a-5bf61e7ba193">
Oct 16 09:52:36 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 16 09:52:36 user nova-compute[74342]:         </nova:port>
Oct 16 09:52:36 user nova-compute[74342]:       </nova:ports>
Oct 16 09:52:36 user nova-compute[74342]:     </nova:instance>
Oct 16 09:52:36 user nova-compute[74342]:   </metadata>
Oct 16 09:52:36 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:52:36 user nova-compute[74342]:     <system>
Oct 16 09:52:36 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:52:36 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:52:36 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:52:36 user nova-compute[74342]:       <entry name="serial">4f3aa905-8eae-45cb-8019-0b991286fe42</entry>
Oct 16 09:52:36 user nova-compute[74342]:       <entry name="uuid">4f3aa905-8eae-45cb-8019-0b991286fe42</entry>
Oct 16 09:52:36 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:52:36 user nova-compute[74342]:     </system>
Oct 16 09:52:36 user nova-compute[74342]:   </sysinfo>
Oct 16 09:52:36 user nova-compute[74342]:   <os>
Oct 16 09:52:36 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:52:36 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:52:36 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:52:36 user nova-compute[74342]:   </os>
Oct 16 09:52:36 user nova-compute[74342]:   <features>
Oct 16 09:52:36 user nova-compute[74342]:     <acpi/>
Oct 16 09:52:36 user nova-compute[74342]:     <apic/>
Oct 16 09:52:36 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:52:36 user nova-compute[74342]:   </features>
Oct 16 09:52:36 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:52:36 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:52:36 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:52:36 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:52:36 user nova-compute[74342]:   </clock>
Oct 16 09:52:36 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:52:36 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:52:36 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:52:36 user nova-compute[74342]:   </cpu>
Oct 16 09:52:36 user nova-compute[74342]:   <devices>
Oct 16 09:52:36 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 09:52:36 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 09:52:36 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk"/>
Oct 16 09:52:36 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:52:36 user nova-compute[74342]:     </disk>
Oct 16 09:52:36 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:52:36 user nova-compute[74342]:       <mac address="fa:16:3e:82:00:ac"/>
Oct 16 09:52:36 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:52:36 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:52:36 user nova-compute[74342]:       <target dev="tap0e4258aa-96"/>
Oct 16 09:52:36 user nova-compute[74342]:     </interface>
Oct 16 09:52:36 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:52:36 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/console.log" append="off"/>
Oct 16 09:52:36 user nova-compute[74342]:     </serial>
Oct 16 09:52:36 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:52:36 user nova-compute[74342]:     <video>
Oct 16 09:52:36 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:52:36 user nova-compute[74342]:     </video>
Oct 16 09:52:36 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:52:36 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:52:36 user nova-compute[74342]:     </rng>
Oct 16 09:52:36 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:52:36 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:52:36 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:52:36 user nova-compute[74342]:     </memballoon>
Oct 16 09:52:36 user nova-compute[74342]:   </devices>
Oct 16 09:52:36 user nova-compute[74342]: </domain>
Oct 16 09:52:36 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1589424972',display_name='tempest-AttachVolumeTestJSON-server-1589424972',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1589424972',id=24,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBO8M7UyZeyQg1aYm+ByuTDEoeaBTTsQAFljuagcRlcGDhfx2FLzwqTOwmYqO1+0IHWLuSXoneV6tc1mCRPSiL9W+Jq0YYyfdyDE26TRgq7GChyXwYOsK9694M/+yJ6Kw==',key_name='tempest-keypair-1616245480',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c28511c6c42147db9a0992cf40e044bb',ramdisk_id='',reservation_id='r-tipl03lh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-965713551',owner_user_name='tempest-AttachVolumeTestJSON-965713551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:52:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc0dfbfdb77347cda95ba991d37c311d',uuid=4f3aa905-8eae-45cb-8019-0b991286fe42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "address": "fa:16:3e:82:00:ac", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4258aa-96", "ovs_interfaceid": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Converting VIF {"id": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "address": "fa:16:3e:82:00:ac", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4258aa-96", "ovs_interfaceid": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:00:ac,bridge_name='br-int',has_traffic_filtering=True,id=0e4258aa-9686-4cf1-9d1a-5bf61e7ba193,network=Network(54ba0b2e-1a1f-44a4-ba26-8a96960d4165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e4258aa-96') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG os_vif [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:00:ac,bridge_name='br-int',has_traffic_filtering=True,id=0e4258aa-9686-4cf1-9d1a-5bf61e7ba193,network=Network(54ba0b2e-1a1f-44a4-ba26-8a96960d4165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e4258aa-96') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f6e4084-f495-51ae-9896-e97b4ee7087d', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e4258aa-96, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0e4258aa-96, col_values=(('qos', UUID('c216aee6-ff27-4894-bbd7-58535246840d')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0e4258aa-96, col_values=(('external_ids', {'iface-id': '0e4258aa-9686-4cf1-9d1a-5bf61e7ba193', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:00:ac', 'vm-uuid': '4f3aa905-8eae-45cb-8019-0b991286fe42'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:36 user nova-compute[74342]: INFO os_vif [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:00:ac,bridge_name='br-int',has_traffic_filtering=True,id=0e4258aa-9686-4cf1-9d1a-5bf61e7ba193,network=Network(54ba0b2e-1a1f-44a4-ba26-8a96960d4165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e4258aa-96')
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:52:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] No VIF found with MAC fa:16:3e:82:00:ac, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:52:37 user nova-compute[74342]: DEBUG nova.network.neutron [req-748330c8-d0f6-4a66-8ce3-1b5f857a9751 req-0adff3a5-5ad4-480c-b0a9-e1a2312ee899 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Updated VIF entry in instance network info cache for port 0e4258aa-9686-4cf1-9d1a-5bf61e7ba193. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:52:37 user nova-compute[74342]: DEBUG nova.network.neutron [req-748330c8-d0f6-4a66-8ce3-1b5f857a9751 req-0adff3a5-5ad4-480c-b0a9-e1a2312ee899 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Updating instance_info_cache with network_info: [{"id": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "address": "fa:16:3e:82:00:ac", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4258aa-96", "ovs_interfaceid": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:52:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-748330c8-d0f6-4a66-8ce3-1b5f857a9751 req-0adff3a5-5ad4-480c-b0a9-e1a2312ee899 service nova] Releasing lock "refresh_cache-4f3aa905-8eae-45cb-8019-0b991286fe42" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:52:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Acquiring lock "c5e44d3b-ed41-4920-825f-e1d283caecfd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "c5e44d3b-ed41-4920-825f-e1d283caecfd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:37 user nova-compute[74342]: DEBUG nova.objects.instance [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lazy-loading 'flavor' on Instance uuid c5e44d3b-ed41-4920-825f-e1d283caecfd {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:52:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "c5e44d3b-ed41-4920-825f-e1d283caecfd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Acquiring lock "c5e44d3b-ed41-4920-825f-e1d283caecfd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "c5e44d3b-ed41-4920-825f-e1d283caecfd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:37 user nova-compute[74342]: INFO nova.compute.manager [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Attaching volume 281894b3-f5a9-4b38-842f-ab4e3d550a02 to /dev/vdb
Oct 16 09:52:37 user nova-compute[74342]: DEBUG os_brick.utils [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:52:37 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:37 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:37 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc8a687d-131b-4454-909c-afe12418c995]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:37 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:37 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:37 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4823e9be-b3b0-46f0-85eb-1955f71641f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:37 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:37 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:37 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[05456c83-3090-48b7-aeac-1465f5671938]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:37 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03f0cbe-2d77-47bc-b72e-b405ba163bee]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:37 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:37 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:52:37 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:52:37 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:37 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:52:37 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:52:37 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8412cf9-1f16-41f1-bab5-0fd7533698ab]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:37 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:52:37 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:52:37 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:52:37 user nova-compute[74342]: DEBUG os_brick.utils [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:52:37 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Updating existing volume attachment record: 73cb55d8-cd2e-4784-abdd-02833ac3d5b3 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 09:52:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:38 user nova-compute[74342]: INFO nova.compute.manager [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Rescuing
Oct 16 09:52:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "refresh_cache-2522364c-36c7-446d-87e7-113632ceeab6" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:52:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquired lock "refresh_cache-2522364c-36c7-446d-87e7-113632ceeab6" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:52:38 user nova-compute[74342]: DEBUG nova.network.neutron [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:52:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:38 user nova-compute[74342]: DEBUG nova.compute.manager [req-898e80d0-0dab-4702-a1d8-ed6fc88efe6d req-6d3690d5-5c97-407e-9512-f78997893b96 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Received event network-vif-plugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:52:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-898e80d0-0dab-4702-a1d8-ed6fc88efe6d req-6d3690d5-5c97-407e-9512-f78997893b96 service nova] Acquiring lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-898e80d0-0dab-4702-a1d8-ed6fc88efe6d req-6d3690d5-5c97-407e-9512-f78997893b96 service nova] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-898e80d0-0dab-4702-a1d8-ed6fc88efe6d req-6d3690d5-5c97-407e-9512-f78997893b96 service nova] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:38 user nova-compute[74342]: DEBUG nova.compute.manager [req-898e80d0-0dab-4702-a1d8-ed6fc88efe6d req-6d3690d5-5c97-407e-9512-f78997893b96 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] No waiting events found dispatching network-vif-plugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:52:38 user nova-compute[74342]: WARNING nova.compute.manager [req-898e80d0-0dab-4702-a1d8-ed6fc88efe6d req-6d3690d5-5c97-407e-9512-f78997893b96 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Received unexpected event network-vif-plugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 for instance with vm_state building and task_state spawning.
Oct 16 09:52:38 user nova-compute[74342]: DEBUG nova.network.neutron [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Updating instance_info_cache with network_info: [{"id": "975f1cad-dbc7-462f-9702-55567afd639b", "address": "fa:16:3e:18:9d:9a", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap975f1cad-db", "ovs_interfaceid": "975f1cad-dbc7-462f-9702-55567afd639b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:52:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Releasing lock "refresh_cache-2522364c-36c7-446d-87e7-113632ceeab6" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:52:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:38 user nova-compute[74342]: DEBUG nova.compute.manager [req-0258d3e8-718c-4389-8aef-584ca446c43c req-28a5c39b-4a74-49bc-8659-5101b0278565 service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Received event network-vif-unplugged-975f1cad-dbc7-462f-9702-55567afd639b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:52:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0258d3e8-718c-4389-8aef-584ca446c43c req-28a5c39b-4a74-49bc-8659-5101b0278565 service nova] Acquiring lock "2522364c-36c7-446d-87e7-113632ceeab6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0258d3e8-718c-4389-8aef-584ca446c43c req-28a5c39b-4a74-49bc-8659-5101b0278565 service nova] Lock "2522364c-36c7-446d-87e7-113632ceeab6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0258d3e8-718c-4389-8aef-584ca446c43c req-28a5c39b-4a74-49bc-8659-5101b0278565 service nova] Lock "2522364c-36c7-446d-87e7-113632ceeab6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:38 user nova-compute[74342]: DEBUG nova.compute.manager [req-0258d3e8-718c-4389-8aef-584ca446c43c req-28a5c39b-4a74-49bc-8659-5101b0278565 service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] No waiting events found dispatching network-vif-unplugged-975f1cad-dbc7-462f-9702-55567afd639b {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:52:38 user nova-compute[74342]: WARNING nova.compute.manager [req-0258d3e8-718c-4389-8aef-584ca446c43c req-28a5c39b-4a74-49bc-8659-5101b0278565 service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Received unexpected event network-vif-unplugged-975f1cad-dbc7-462f-9702-55567afd639b for instance with vm_state active and task_state rescuing.
Oct 16 09:52:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:39 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Instance destroyed successfully.
Oct 16 09:52:39 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Attempting a stable device rescue
Oct 16 09:52:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74342) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 16 09:52:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Instance directory exists: not creating {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 16 09:52:39 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Creating image(s)
Oct 16 09:52:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "/opt/stack/data/nova/instances/2522364c-36c7-446d-87e7-113632ceeab6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "/opt/stack/data/nova/instances/2522364c-36c7-446d-87e7-113632ceeab6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "/opt/stack/data/nova/instances/2522364c-36c7-446d-87e7-113632ceeab6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:39 user nova-compute[74342]: DEBUG nova.objects.instance [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2522364c-36c7-446d-87e7-113632ceeab6 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:52:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "a54828bc6b400d4c9912ebff5c81c0606e8de36b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "a54828bc6b400d4c9912ebff5c81c0606e8de36b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a54828bc6b400d4c9912ebff5c81c0606e8de36b.part --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:40 user nova-compute[74342]: DEBUG nova.compute.manager [req-47c6a5e7-9c62-430a-a582-a3a09f768b7e req-03910b9a-bb54-46ec-b539-85698ba891f6 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Received event network-vif-plugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:52:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-47c6a5e7-9c62-430a-a582-a3a09f768b7e req-03910b9a-bb54-46ec-b539-85698ba891f6 service nova] Acquiring lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-47c6a5e7-9c62-430a-a582-a3a09f768b7e req-03910b9a-bb54-46ec-b539-85698ba891f6 service nova] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-47c6a5e7-9c62-430a-a582-a3a09f768b7e req-03910b9a-bb54-46ec-b539-85698ba891f6 service nova] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:40 user nova-compute[74342]: DEBUG nova.compute.manager [req-47c6a5e7-9c62-430a-a582-a3a09f768b7e req-03910b9a-bb54-46ec-b539-85698ba891f6 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] No waiting events found dispatching network-vif-plugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:52:40 user nova-compute[74342]: WARNING nova.compute.manager [req-47c6a5e7-9c62-430a-a582-a3a09f768b7e req-03910b9a-bb54-46ec-b539-85698ba891f6 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Received unexpected event network-vif-plugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 for instance with vm_state building and task_state spawning.
Oct 16 09:52:40 user nova-compute[74342]: DEBUG nova.compute.manager [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:52:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:52:40 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Instance spawned successfully.
Oct 16 09:52:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:52:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:52:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:52:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:52:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:52:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:52:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:52:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a54828bc6b400d4c9912ebff5c81c0606e8de36b.part --force-share --output=json" returned: 0 in 0.179s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:40 user nova-compute[74342]: DEBUG nova.virt.images [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] ff0cd828-331f-4d85-b53c-027be1fe5542 was qcow2, converting to raw {{(pid=74342) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 09:52:40 user nova-compute[74342]: DEBUG nova.privsep.utils [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 09:52:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a54828bc6b400d4c9912ebff5c81c0606e8de36b.part /opt/stack/data/nova/instances/_base/a54828bc6b400d4c9912ebff5c81c0606e8de36b.converted {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:40 user nova-compute[74342]: INFO nova.compute.manager [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Took 5.57 seconds to spawn the instance on the hypervisor.
Oct 16 09:52:40 user nova-compute[74342]: DEBUG nova.compute.manager [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:52:40 user nova-compute[74342]: INFO nova.compute.manager [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Took 6.52 seconds to build instance.
Oct 16 09:52:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-94384e91-a0ff-4fe0-924d-a148abaefe64 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.628s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a54828bc6b400d4c9912ebff5c81c0606e8de36b.part /opt/stack/data/nova/instances/_base/a54828bc6b400d4c9912ebff5c81c0606e8de36b.converted" returned: 0 in 0.226s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a54828bc6b400d4c9912ebff5c81c0606e8de36b.converted --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.compute.manager [req-b991cd1c-7c2c-417b-ab35-7429aa95d891 req-8bfffa82-8383-49b4-83a8-5f33f0223e0c service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Received event network-vif-plugged-975f1cad-dbc7-462f-9702-55567afd639b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b991cd1c-7c2c-417b-ab35-7429aa95d891 req-8bfffa82-8383-49b4-83a8-5f33f0223e0c service nova] Acquiring lock "2522364c-36c7-446d-87e7-113632ceeab6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b991cd1c-7c2c-417b-ab35-7429aa95d891 req-8bfffa82-8383-49b4-83a8-5f33f0223e0c service nova] Lock "2522364c-36c7-446d-87e7-113632ceeab6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b991cd1c-7c2c-417b-ab35-7429aa95d891 req-8bfffa82-8383-49b4-83a8-5f33f0223e0c service nova] Lock "2522364c-36c7-446d-87e7-113632ceeab6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.compute.manager [req-b991cd1c-7c2c-417b-ab35-7429aa95d891 req-8bfffa82-8383-49b4-83a8-5f33f0223e0c service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] No waiting events found dispatching network-vif-plugged-975f1cad-dbc7-462f-9702-55567afd639b {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:52:41 user nova-compute[74342]: WARNING nova.compute.manager [req-b991cd1c-7c2c-417b-ab35-7429aa95d891 req-8bfffa82-8383-49b4-83a8-5f33f0223e0c service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Received unexpected event network-vif-plugged-975f1cad-dbc7-462f-9702-55567afd639b for instance with vm_state active and task_state rescuing.
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a54828bc6b400d4c9912ebff5c81c0606e8de36b.converted --force-share --output=json" returned: 0 in 0.197s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "a54828bc6b400d4c9912ebff5c81c0606e8de36b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.621s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "a54828bc6b400d4c9912ebff5c81c0606e8de36b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "a54828bc6b400d4c9912ebff5c81c0606e8de36b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a54828bc6b400d4c9912ebff5c81c0606e8de36b --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a54828bc6b400d4c9912ebff5c81c0606e8de36b --force-share --output=json" returned: 0 in 0.225s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a54828bc6b400d4c9912ebff5c81c0606e8de36b,backing_fmt=raw /opt/stack/data/nova/instances/2522364c-36c7-446d-87e7-113632ceeab6/disk.rescue {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a54828bc6b400d4c9912ebff5c81c0606e8de36b,backing_fmt=raw /opt/stack/data/nova/instances/2522364c-36c7-446d-87e7-113632ceeab6/disk.rescue" returned: 0 in 0.050s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "a54828bc6b400d4c9912ebff5c81c0606e8de36b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.285s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.objects.instance [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lazy-loading 'migration_context' on Instance uuid 2522364c-36c7-446d-87e7-113632ceeab6 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.objects.base [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Object Instance<2522364c-36c7-446d-87e7-113632ceeab6> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Start _get_guest_xml network_info=[{"id": "975f1cad-dbc7-462f-9702-55567afd639b", "address": "fa:16:3e:18:9d:9a", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "vif_mac": "fa:16:3e:18:9d:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap975f1cad-db", "ovs_interfaceid": "975f1cad-dbc7-462f-9702-55567afd639b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'ff0cd828-331f-4d85-b53c-027be1fe5542', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'e840c3ff-ad61-4697-bec2-fcdd9b215066', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xSlhtdYW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '2522364c-36c7-446d-87e7-113632ceeab6', 'attached_at': '', 'detached_at': '', 'volume_id': '4bffc475-b62a-4b57-ab2c-1d23cf21e1ea', 'serial': '4bffc475-b62a-4b57-ab2c-1d23cf21e1ea'}, 'volume_type': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.objects.instance [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lazy-loading 'resources' on Instance uuid 2522364c-36c7-446d-87e7-113632ceeab6 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.objects.base [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Object Instance<2522364c-36c7-446d-87e7-113632ceeab6> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.objects.instance [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lazy-loading 'numa_topology' on Instance uuid 2522364c-36c7-446d-87e7-113632ceeab6 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.objects.base [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Object Instance<2522364c-36c7-446d-87e7-113632ceeab6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 09:52:41 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:52:41 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.objects.instance [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2522364c-36c7-446d-87e7-113632ceeab6 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.objects.base [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Object Instance<2522364c-36c7-446d-87e7-113632ceeab6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xSlhtdYW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:52:41 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:52:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:52:41 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:52:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:52:41 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0120a29c-2436-4386-9bed-efd68fab9180]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = xSlhtdYW\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Oct 16 09:52:41 user nova-compute[74342]: node.name = iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea
Oct 16 09:52:41 user nova-compute[74342]: node.tpgt = -1
Oct 16 09:52:41 user nova-compute[74342]: node.startup = automatic
Oct 16 09:52:41 user nova-compute[74342]: node.leading_login = No
Oct 16 09:52:41 user nova-compute[74342]: iface.iscsi_ifacename = default
Oct 16 09:52:41 user nova-compute[74342]: iface.net_ifacename = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.ipaddress = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.prefix_len = 0
Oct 16 09:52:41 user nova-compute[74342]: iface.hwaddress = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.transport_name = tcp
Oct 16 09:52:41 user nova-compute[74342]: iface.initiatorname = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.state = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.vlan_id = 0
Oct 16 09:52:41 user nova-compute[74342]: iface.vlan_priority = 0
Oct 16 09:52:41 user nova-compute[74342]: iface.vlan_state = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.iface_num = 0
Oct 16 09:52:41 user nova-compute[74342]: iface.mtu = 0
Oct 16 09:52:41 user nova-compute[74342]: iface.port = 0
Oct 16 09:52:41 user nova-compute[74342]: iface.bootproto = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.subnet_mask = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.gateway = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.dhcp_alt_client_id_state = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.dhcp_alt_client_id = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.dhcp_dns = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.dhcp_learn_iqn = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.dhcp_req_vendor_id_state = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.dhcp_vendor_id_state = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.dhcp_vendor_id = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.dhcp_slp_da = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.fragmentation = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.gratuitous_arp = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.incoming_forwarding = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.tos_state = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.tos = 0
Oct 16 09:52:41 user nova-compute[74342]: iface.ttl = 0
Oct 16 09:52:41 user nova-compute[74342]: iface.delayed_ack = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.tcp_nagle = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.tcp_wsf_state = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.tcp_wsf = 0
Oct 16 09:52:41 user nova-compute[74342]: iface.tcp_timer_scale = 0
Oct 16 09:52:41 user nova-compute[74342]: iface.tcp_timestamp = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.redirect = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.def_task_mgmt_timeout = 0
Oct 16 09:52:41 user nova-compute[74342]: iface.header_digest = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.data_digest = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.immediate_data = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.initial_r2t = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.data_seq_inorder = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.data_pdu_inorder = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.erl = 0
Oct 16 09:52:41 user nova-compute[74342]: iface.max_receive_data_len = 0
Oct 16 09:52:41 user nova-compute[74342]: iface.first_burst_len = 0
Oct 16 09:52:41 user nova-compute[74342]: iface.max_outstanding_r2t = 0
Oct 16 09:52:41 user nova-compute[74342]: iface.max_burst_len = 0
Oct 16 09:52:41 user nova-compute[74342]: iface.chap_auth = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.bidi_chap = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.strict_login_compliance = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.discovery_auth = <empty>
Oct 16 09:52:41 user nova-compute[74342]: iface.discovery_logout = <empty>
Oct 16 09:52:41 user nova-compute[74342]: node.discovery_address = <empty>
Oct 16 09:52:41 user nova-compute[74342]: node.discovery_port = 0
Oct 16 09:52:41 user nova-compute[74342]: node.discovery_type = static
Oct 16 09:52:41 user nova-compute[74342]: node.session.initial_cmdsn = 0
Oct 16 09:52:41 user nova-compute[74342]: node.session.initial_login_retry_max = 8
Oct 16 09:52:41 user nova-compute[74342]: node.session.xmit_thread_priority = -20
Oct 16 09:52:41 user nova-compute[74342]: node.session.cmds_max = 128
Oct 16 09:52:41 user nova-compute[74342]: node.session.queue_depth = 32
Oct 16 09:52:41 user nova-compute[74342]: node.session.nr_sessions = 1
Oct 16 09:52:41 user nova-compute[74342]: node.session.auth.authmethod = CHAP
Oct 16 09:52:41 user nova-compute[74342]: node.session.auth.username = xSlhtdYW
Oct 16 09:52:41 user nova-compute[74342]: node.session.auth.password = ***
Oct 16 09:52:41 user nova-compute[74342]: node.session.auth.username_in = <empty>
Oct 16 09:52:41 user nova-compute[74342]: node.session.auth.password_in = <empty>
Oct 16 09:52:41 user nova-compute[74342]: node.session.auth.chap_algs = MD5
Oct 16 09:52:41 user nova-compute[74342]: node.session.timeo.replacement_timeout = 120
Oct 16 09:52:41 user nova-compute[74342]: node.session.err_timeo.abort_timeout = 15
Oct 16 09:52:41 user nova-compute[74342]: node.session.err_timeo.lu_reset_timeout = 30
Oct 16 09:52:41 user nova-compute[74342]: node.session.err_timeo.tgt_reset_timeout = 30
Oct 16 09:52:41 user nova-compute[74342]: node.session.err_timeo.host_reset_timeout = 60
Oct 16 09:52:41 user nova-compute[74342]: node.session.iscsi.FastAbort = Yes
Oct 16 09:52:41 user nova-compute[74342]: node.session.iscsi.InitialR2T = No
Oct 16 09:52:41 user nova-compute[74342]: node.session.iscsi.ImmediateData = Yes
Oct 16 09:52:41 user nova-compute[74342]: node.session.iscsi.FirstBurstLength = 262144
Oct 16 09:52:41 user nova-compute[74342]: node.session.iscsi.MaxBurstLength = 16776192
Oct 16 09:52:41 user nova-compute[74342]: node.session.iscsi.DefaultTime2Retain = 0
Oct 16 09:52:41 user nova-compute[74342]: node.session.iscsi.DefaultTime2Wait = 2
Oct 16 09:52:41 user nova-compute[74342]: node.session.iscsi.MaxConnections = 1
Oct 16 09:52:41 user nova-compute[74342]: node.session.iscsi.MaxOutstandingR2T = 1
Oct 16 09:52:41 user nova-compute[74342]: node.session.iscsi.ERL = 0
Oct 16 09:52:41 user nova-compute[74342]: node.session.scan = manual
Oct 16 09:52:41 user nova-compute[74342]: node.session.reopen_max = 0
Oct 16 09:52:41 user nova-compute[74342]: node.conn[0].address = 172.16.0.220
Oct 16 09:52:41 user nova-compute[74342]: node.conn[0].port = 3260
Oct 16 09:52:41 user nova-compute[74342]: node.conn[0].startup = manual
Oct 16 09:52:41 user nova-compute[74342]: node.conn[0].tcp.window_size = 524288
Oct 16 09:52:41 user nova-compute[74342]: node.conn[0].tcp.type_of_service = 0
Oct 16 09:52:41 user nova-compute[74342]: node.conn[0].timeo.logout_timeout = 15
Oct 16 09:52:41 user nova-compute[74342]: node.conn[0].timeo.login_timeout = 15
Oct 16 09:52:41 user nova-compute[74342]: node.conn[0].timeo.auth_timeout = 45
Oct 16 09:52:41 user nova-compute[74342]: node.conn[0].timeo.noop_out_interval = 5
Oct 16 09:52:41 user nova-compute[74342]: node.conn[0].timeo.noop_out_timeout = 5
Oct 16 09:52:41 user nova-compute[74342]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Oct 16 09:52:41 user nova-compute[74342]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Oct 16 09:52:41 user nova-compute[74342]: node.conn[0].iscsi.HeaderDigest = None
Oct 16 09:52:41 user nova-compute[74342]: node.conn[0].iscsi.DataDigest = None
Oct 16 09:52:41 user nova-compute[74342]: node.conn[0].iscsi.IFMarker = No
Oct 16 09:52:41 user nova-compute[74342]: node.conn[0].iscsi.OFMarker = No
Oct 16 09:52:41 user nova-compute[74342]: # END RECORD
Oct 16 09:52:41 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e8d3ac-9348-4b09-b093-ad332b6926f0]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f5a949-cbcb-4728-aa3e-da916c6d7fca]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xSlhtdYW {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xSlhtdYW" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0563bd-7b43-4331-9857-12186553370a]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xSlhtdYW'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3102ef15-c4a9-4231-910b-15bcf4f90c10]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbcc71c6-5263-4c32-949c-2ca65da7ad6f]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:52:41 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:52:41 user nova-compute[74342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)
Oct 16 09:52:41 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:52:41 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:52:41 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:52:41 user nova-compute[74342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)
Oct 16 09:52:41 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:52:41 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.156s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] HCTL ('35', '0', '0', 0) found on session 11 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[453783a0-8775-4bc6-b7a2-89e7758350b3]: (4, ('0 0 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Searching for a device in session 11 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xSlhtdYW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.183s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] <== connect_volume: return (185ms) {'type': 'block', 'scsi_wwn': '23865643861623364', 'path': '/dev/sdd'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865643861623364', 'path': '/dev/sdd'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:50:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1187825465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1187825465',id=19,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:51:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4fcf2437a2d413ea584d0cc2508bed3',ramdisk_id='',reservation_id='r-cy1bowxe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-476995503',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:51:31Z,user_data=None,user_id='f90f091b76254a13957807feaeaef3fc',uuid=2522364c-36c7-446d-87e7-113632ceeab6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "975f1cad-dbc7-462f-9702-55567afd639b", "address": "fa:16:3e:18:9d:9a", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "vif_mac": "fa:16:3e:18:9d:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap975f1cad-db", "ovs_interfaceid": "975f1cad-dbc7-462f-9702-55567afd639b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Converting VIF {"id": "975f1cad-dbc7-462f-9702-55567afd639b", "address": "fa:16:3e:18:9d:9a", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "vif_mac": "fa:16:3e:18:9d:9a"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap975f1cad-db", "ovs_interfaceid": "975f1cad-dbc7-462f-9702-55567afd639b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:9d:9a,bridge_name='br-int',has_traffic_filtering=True,id=975f1cad-dbc7-462f-9702-55567afd639b,network=Network(a571ad70-6f8b-4b02-86b9-df50290509f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap975f1cad-db') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.objects.instance [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lazy-loading 'pci_devices' on Instance uuid 2522364c-36c7-446d-87e7-113632ceeab6 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.objects.base [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Object Instance<2522364c-36c7-446d-87e7-113632ceeab6> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:52:41 user nova-compute[74342]:   <uuid>2522364c-36c7-446d-87e7-113632ceeab6</uuid>
Oct 16 09:52:41 user nova-compute[74342]:   <name>instance-00000013</name>
Oct 16 09:52:41 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:52:41 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:52:41 user nova-compute[74342]:   <metadata>
Oct 16 09:52:41 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:52:41 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:52:41 user nova-compute[74342]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1187825465</nova:name>
Oct 16 09:52:41 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:52:41</nova:creationTime>
Oct 16 09:52:41 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:52:41 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:52:41 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:52:41 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:52:41 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:52:41 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:52:41 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:52:41 user nova-compute[74342]:       <nova:owner>
Oct 16 09:52:41 user nova-compute[74342]:         <nova:user uuid="f90f091b76254a13957807feaeaef3fc">tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member</nova:user>
Oct 16 09:52:41 user nova-compute[74342]:         <nova:project uuid="a4fcf2437a2d413ea584d0cc2508bed3">tempest-ServerBootFromVolumeStableRescueTest-476995503</nova:project>
Oct 16 09:52:41 user nova-compute[74342]:       </nova:owner>
Oct 16 09:52:41 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:52:41 user nova-compute[74342]:       <nova:ports>
Oct 16 09:52:41 user nova-compute[74342]:         <nova:port uuid="975f1cad-dbc7-462f-9702-55567afd639b">
Oct 16 09:52:41 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Oct 16 09:52:41 user nova-compute[74342]:         </nova:port>
Oct 16 09:52:41 user nova-compute[74342]:       </nova:ports>
Oct 16 09:52:41 user nova-compute[74342]:     </nova:instance>
Oct 16 09:52:41 user nova-compute[74342]:   </metadata>
Oct 16 09:52:41 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:52:41 user nova-compute[74342]:     <system>
Oct 16 09:52:41 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:52:41 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:52:41 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:52:41 user nova-compute[74342]:       <entry name="serial">2522364c-36c7-446d-87e7-113632ceeab6</entry>
Oct 16 09:52:41 user nova-compute[74342]:       <entry name="uuid">2522364c-36c7-446d-87e7-113632ceeab6</entry>
Oct 16 09:52:41 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:52:41 user nova-compute[74342]:     </system>
Oct 16 09:52:41 user nova-compute[74342]:   </sysinfo>
Oct 16 09:52:41 user nova-compute[74342]:   <os>
Oct 16 09:52:41 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:52:41 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:52:41 user nova-compute[74342]:   </os>
Oct 16 09:52:41 user nova-compute[74342]:   <features>
Oct 16 09:52:41 user nova-compute[74342]:     <acpi/>
Oct 16 09:52:41 user nova-compute[74342]:     <apic/>
Oct 16 09:52:41 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:52:41 user nova-compute[74342]:   </features>
Oct 16 09:52:41 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:52:41 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:52:41 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:52:41 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:52:41 user nova-compute[74342]:   </clock>
Oct 16 09:52:41 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:52:41 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:52:41 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:52:41 user nova-compute[74342]:   </cpu>
Oct 16 09:52:41 user nova-compute[74342]:   <devices>
Oct 16 09:52:41 user nova-compute[74342]:     <disk type="block" device="disk">
Oct 16 09:52:41 user nova-compute[74342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:52:41 user nova-compute[74342]:       <source dev="/dev/sdd"/>
Oct 16 09:52:41 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:52:41 user nova-compute[74342]:       <serial>4bffc475-b62a-4b57-ab2c-1d23cf21e1ea</serial>
Oct 16 09:52:41 user nova-compute[74342]:     </disk>
Oct 16 09:52:41 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 09:52:41 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 09:52:41 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/2522364c-36c7-446d-87e7-113632ceeab6/disk.rescue"/>
Oct 16 09:52:41 user nova-compute[74342]:       <target dev="vdb" bus="virtio"/>
Oct 16 09:52:41 user nova-compute[74342]:       <boot order="1"/>
Oct 16 09:52:41 user nova-compute[74342]:     </disk>
Oct 16 09:52:41 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:52:41 user nova-compute[74342]:       <mac address="fa:16:3e:18:9d:9a"/>
Oct 16 09:52:41 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:52:41 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:52:41 user nova-compute[74342]:       <target dev="tap975f1cad-db"/>
Oct 16 09:52:41 user nova-compute[74342]:     </interface>
Oct 16 09:52:41 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:52:41 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/2522364c-36c7-446d-87e7-113632ceeab6/console.log" append="off"/>
Oct 16 09:52:41 user nova-compute[74342]:     </serial>
Oct 16 09:52:41 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:52:41 user nova-compute[74342]:     <video>
Oct 16 09:52:41 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:52:41 user nova-compute[74342]:     </video>
Oct 16 09:52:41 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:52:41 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:52:41 user nova-compute[74342]:     </rng>
Oct 16 09:52:41 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:52:41 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:52:41 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:52:41 user nova-compute[74342]:     </memballoon>
Oct 16 09:52:41 user nova-compute[74342]:   </devices>
Oct 16 09:52:41 user nova-compute[74342]: </domain>
Oct 16 09:52:41 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:52:41 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Instance destroyed successfully.
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:52:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] No VIF found with MAC fa:16:3e:18:9d:9a, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:52:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:43 user nova-compute[74342]: DEBUG nova.compute.manager [req-8ad647a1-4fb5-4b22-ba3d-69ec71b73f4d req-2a814793-8bfc-4c38-84d4-62bf3aa5f6e4 service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Received event network-vif-plugged-975f1cad-dbc7-462f-9702-55567afd639b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:52:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8ad647a1-4fb5-4b22-ba3d-69ec71b73f4d req-2a814793-8bfc-4c38-84d4-62bf3aa5f6e4 service nova] Acquiring lock "2522364c-36c7-446d-87e7-113632ceeab6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8ad647a1-4fb5-4b22-ba3d-69ec71b73f4d req-2a814793-8bfc-4c38-84d4-62bf3aa5f6e4 service nova] Lock "2522364c-36c7-446d-87e7-113632ceeab6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8ad647a1-4fb5-4b22-ba3d-69ec71b73f4d req-2a814793-8bfc-4c38-84d4-62bf3aa5f6e4 service nova] Lock "2522364c-36c7-446d-87e7-113632ceeab6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:43 user nova-compute[74342]: DEBUG nova.compute.manager [req-8ad647a1-4fb5-4b22-ba3d-69ec71b73f4d req-2a814793-8bfc-4c38-84d4-62bf3aa5f6e4 service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] No waiting events found dispatching network-vif-plugged-975f1cad-dbc7-462f-9702-55567afd639b {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:52:43 user nova-compute[74342]: WARNING nova.compute.manager [req-8ad647a1-4fb5-4b22-ba3d-69ec71b73f4d req-2a814793-8bfc-4c38-84d4-62bf3aa5f6e4 service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Received unexpected event network-vif-plugged-975f1cad-dbc7-462f-9702-55567afd639b for instance with vm_state active and task_state rescuing.
Oct 16 09:52:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:45 user nova-compute[74342]: DEBUG nova.compute.manager [None req-615a69b8-c147-4ebd-bec0-303e10118a74 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:52:45 user nova-compute[74342]: DEBUG nova.compute.manager [req-06051aa1-b65f-4b16-9a99-d7003c2bf507 req-856e0917-bd13-4d36-a6c9-c85bd9f19287 service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Received event network-vif-plugged-975f1cad-dbc7-462f-9702-55567afd639b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:52:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-06051aa1-b65f-4b16-9a99-d7003c2bf507 req-856e0917-bd13-4d36-a6c9-c85bd9f19287 service nova] Acquiring lock "2522364c-36c7-446d-87e7-113632ceeab6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-06051aa1-b65f-4b16-9a99-d7003c2bf507 req-856e0917-bd13-4d36-a6c9-c85bd9f19287 service nova] Lock "2522364c-36c7-446d-87e7-113632ceeab6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-06051aa1-b65f-4b16-9a99-d7003c2bf507 req-856e0917-bd13-4d36-a6c9-c85bd9f19287 service nova] Lock "2522364c-36c7-446d-87e7-113632ceeab6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:45 user nova-compute[74342]: DEBUG nova.compute.manager [req-06051aa1-b65f-4b16-9a99-d7003c2bf507 req-856e0917-bd13-4d36-a6c9-c85bd9f19287 service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] No waiting events found dispatching network-vif-plugged-975f1cad-dbc7-462f-9702-55567afd639b {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:52:45 user nova-compute[74342]: WARNING nova.compute.manager [req-06051aa1-b65f-4b16-9a99-d7003c2bf507 req-856e0917-bd13-4d36-a6c9-c85bd9f19287 service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Received unexpected event network-vif-plugged-975f1cad-dbc7-462f-9702-55567afd639b for instance with vm_state active and task_state rescuing.
Oct 16 09:52:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:48 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:52:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:48 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 09:52:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:49 user nova-compute[74342]: DEBUG nova.compute.manager [req-672d6610-771a-47cf-8c4c-d30dd3df6e09 req-b9903121-e157-432b-b691-872120734723 service nova] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Received event network-changed-4cea4774-6a45-4adc-8019-ffda4c7253cb {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:52:49 user nova-compute[74342]: DEBUG nova.compute.manager [req-672d6610-771a-47cf-8c4c-d30dd3df6e09 req-b9903121-e157-432b-b691-872120734723 service nova] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Refreshing instance network info cache due to event network-changed-4cea4774-6a45-4adc-8019-ffda4c7253cb. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:52:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-672d6610-771a-47cf-8c4c-d30dd3df6e09 req-b9903121-e157-432b-b691-872120734723 service nova] Acquiring lock "refresh_cache-a9a7676e-87d8-4e8a-832a-67a5470f16a1" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:52:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-672d6610-771a-47cf-8c4c-d30dd3df6e09 req-b9903121-e157-432b-b691-872120734723 service nova] Acquired lock "refresh_cache-a9a7676e-87d8-4e8a-832a-67a5470f16a1" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:52:49 user nova-compute[74342]: DEBUG nova.network.neutron [req-672d6610-771a-47cf-8c4c-d30dd3df6e09 req-b9903121-e157-432b-b691-872120734723 service nova] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Refreshing network info cache for port 4cea4774-6a45-4adc-8019-ffda4c7253cb {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:52:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "5dc86029-dcbf-4886-bdc9-7d4413059c96" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "5dc86029-dcbf-4886-bdc9-7d4413059c96" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:49 user nova-compute[74342]: INFO nova.compute.manager [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Detaching volume c8c6991f-abcd-4da9-b892-764e07129192
Oct 16 09:52:49 user nova-compute[74342]: INFO nova.virt.block_device [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Attempting to driver detach volume c8c6991f-abcd-4da9-b892-764e07129192 from mountpoint /dev/vdb
Oct 16 09:52:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Attempting to detach device vdb from instance 5dc86029-dcbf-4886-bdc9-7d4413059c96 from the persistent domain config. {{(pid=74342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 09:52:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 09:52:49 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:52:49 user nova-compute[74342]:   <source dev="/dev/sdc"/>
Oct 16 09:52:49 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:52:49 user nova-compute[74342]:   <serial>c8c6991f-abcd-4da9-b892-764e07129192</serial>
Oct 16 09:52:49 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 09:52:49 user nova-compute[74342]: </disk>
Oct 16 09:52:49 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 09:52:49 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Successfully detached device vdb from instance 5dc86029-dcbf-4886-bdc9-7d4413059c96 from the persistent domain config.
Oct 16 09:52:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5dc86029-dcbf-4886-bdc9-7d4413059c96 from the live domain config. {{(pid=74342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 09:52:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 09:52:49 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:52:49 user nova-compute[74342]:   <source dev="/dev/sdc"/>
Oct 16 09:52:49 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:52:49 user nova-compute[74342]:   <serial>c8c6991f-abcd-4da9-b892-764e07129192</serial>
Oct 16 09:52:49 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 09:52:49 user nova-compute[74342]: </disk>
Oct 16 09:52:49 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 09:52:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9acd5f6-12e3-488b-b6c6-e4b81f5fc897/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:49 user nova-compute[74342]: DEBUG nova.network.neutron [req-672d6610-771a-47cf-8c4c-d30dd3df6e09 req-b9903121-e157-432b-b691-872120734723 service nova] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Updated VIF entry in instance network info cache for port 4cea4774-6a45-4adc-8019-ffda4c7253cb. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:52:49 user nova-compute[74342]: DEBUG nova.network.neutron [req-672d6610-771a-47cf-8c4c-d30dd3df6e09 req-b9903121-e157-432b-b691-872120734723 service nova] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Updating instance_info_cache with network_info: [{"id": "4cea4774-6a45-4adc-8019-ffda4c7253cb", "address": "fa:16:3e:cc:84:df", "network": {"id": "0b3a3bbd-b156-44ad-bffa-4248d61babfe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-567602513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c305573fde27434282f0e3098415298d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cea4774-6a", "ovs_interfaceid": "4cea4774-6a45-4adc-8019-ffda4c7253cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:52:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9acd5f6-12e3-488b-b6c6-e4b81f5fc897/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9acd5f6-12e3-488b-b6c6-e4b81f5fc897/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:50 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5dc86029-dcbf-4886-bdc9-7d4413059c96 {{(pid=74342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 09:52:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-672d6610-771a-47cf-8c4c-d30dd3df6e09 req-b9903121-e157-432b-b691-872120734723 service nova] Releasing lock "refresh_cache-a9a7676e-87d8-4e8a-832a-67a5470f16a1" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:52:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9acd5f6-12e3-488b-b6c6-e4b81f5fc897/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:50 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:52:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e6e026-f958-40c4-ab99-19deaaa1590d/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Acquiring lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:51 user nova-compute[74342]: INFO nova.compute.manager [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Detaching volume ed3c06eb-8a87-4939-b3f5-28aecc6c0449
Oct 16 09:52:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e6e026-f958-40c4-ab99-19deaaa1590d/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e6e026-f958-40c4-ab99-19deaaa1590d/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:51 user nova-compute[74342]: INFO nova.virt.block_device [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Attempting to driver detach volume ed3c06eb-8a87-4939-b3f5-28aecc6c0449 from mountpoint /dev/vdb
Oct 16 09:52:51 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Attempting to detach device vdb from instance a9acd5f6-12e3-488b-b6c6-e4b81f5fc897 from the persistent domain config. {{(pid=74342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 09:52:51 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 09:52:51 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:52:51 user nova-compute[74342]:   <source dev="/dev/sde"/>
Oct 16 09:52:51 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:52:51 user nova-compute[74342]:   <serial>ed3c06eb-8a87-4939-b3f5-28aecc6c0449</serial>
Oct 16 09:52:51 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 09:52:51 user nova-compute[74342]: </disk>
Oct 16 09:52:51 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 09:52:51 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Successfully detached device vdb from instance a9acd5f6-12e3-488b-b6c6-e4b81f5fc897 from the persistent domain config.
Oct 16 09:52:51 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a9acd5f6-12e3-488b-b6c6-e4b81f5fc897 from the live domain config. {{(pid=74342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 09:52:51 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 09:52:51 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:52:51 user nova-compute[74342]:   <source dev="/dev/sde"/>
Oct 16 09:52:51 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:52:51 user nova-compute[74342]:   <serial>ed3c06eb-8a87-4939-b3f5-28aecc6c0449</serial>
Oct 16 09:52:51 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 09:52:51 user nova-compute[74342]: </disk>
Oct 16 09:52:51 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 09:52:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e6e026-f958-40c4-ab99-19deaaa1590d/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:51 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a9acd5f6-12e3-488b-b6c6-e4b81f5fc897 {{(pid=74342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 09:52:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a7676e-87d8-4e8a-832a-67a5470f16a1/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a7676e-87d8-4e8a-832a-67a5470f16a1/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a7676e-87d8-4e8a-832a-67a5470f16a1/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a7676e-87d8-4e8a-832a-67a5470f16a1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:53 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:52:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Acquiring lock "ea57d655-a24f-4a1c-bb1c-45e1dfc848c1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "ea57d655-a24f-4a1c-bb1c-45e1dfc848c1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:53 user nova-compute[74342]: DEBUG nova.compute.manager [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:52:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:54 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:52:54 user nova-compute[74342]: INFO nova.compute.claims [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Claim successful on node user
Oct 16 09:52:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:54 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:52:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2522364c-36c7-446d-87e7-113632ceeab6/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2522364c-36c7-446d-87e7-113632ceeab6/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2522364c-36c7-446d-87e7-113632ceeab6/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2522364c-36c7-446d-87e7-113632ceeab6/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b16a3439-f343-4fae-9a5e-e07d8c84b955/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:54 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:52:54 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:52:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b16a3439-f343-4fae-9a5e-e07d8c84b955/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b16a3439-f343-4fae-9a5e-e07d8c84b955/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.897s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:54 user nova-compute[74342]: DEBUG nova.compute.manager [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:52:54 user nova-compute[74342]: DEBUG nova.compute.manager [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:52:54 user nova-compute[74342]: DEBUG nova.network.neutron [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:52:54 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:52:54 user nova-compute[74342]: DEBUG nova.compute.manager [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:52:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b16a3439-f343-4fae-9a5e-e07d8c84b955/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG nova.policy [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '353ec67aa4b84aa7b6992ccb49423ca6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0afd0e8f0d424fe393636bbcd26eed42', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG nova.compute.manager [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:52:55 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Creating image(s)
Oct 16 09:52:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Acquiring lock "/opt/stack/data/nova/instances/ea57d655-a24f-4a1c-bb1c-45e1dfc848c1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "/opt/stack/data/nova/instances/ea57d655-a24f-4a1c-bb1c-45e1dfc848c1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "/opt/stack/data/nova/instances/ea57d655-a24f-4a1c-bb1c-45e1dfc848c1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:55 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:52:55 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:52:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=7023MB free_disk=25.04840850830078GB free_vcpus=-2 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.232s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bXSmTrFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:52:55 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:52:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:52:55 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:52:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:52:55 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 09:52:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02 -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[16788604-1bd8-4352-8697-0daf383a535a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 09:52:55 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance d45abd20-3a58-4657-8f4c-a426d8e39be3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 98367a96-22f0-4edb-ab03-a8eb286b437b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 017caffb-5be2-4e78-ab48-a8091c5c00f4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 5dc86029-dcbf-4886-bdc9-7d4413059c96 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance edcefbe0-e89f-4496-9032-f9431d9d5c53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance c5e44d3b-ed41-4920-825f-e1d283caecfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance a9acd5f6-12e3-488b-b6c6-e4b81f5fc897 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance f3c66abd-af75-4b48-9e29-ab4335f229f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 2522364c-36c7-446d-87e7-113632ceeab6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 68e6e026-f958-40c4-ab99-19deaaa1590d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance a9a7676e-87d8-4e8a-832a-67a5470f16a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance eeee39f2-9728-4114-8bd3-1d05f69a1215 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance b16a3439-f343-4fae-9a5e-e07d8c84b955 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 4f3aa905-8eae-45cb-8019-0b991286fe42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance ea57d655-a24f-4a1c-bb1c-45e1dfc848c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 16 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=14GB total_vcpus=12 used_vcpus=16 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02 -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[790c3147-87ed-4d0f-92f7-a6b2fc7afae5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02] added
Oct 16 09:52:55 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Acquiring lock "a9a7676e-87d8-4e8a-832a-67a5470f16a1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lock "a9a7676e-87d8-4e8a-832a-67a5470f16a1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG nova.objects.instance [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lazy-loading 'flavor' on Instance uuid a9a7676e-87d8-4e8a-832a-67a5470f16a1 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7b3ad0-d98f-44ae-9b8a-08002104ddb2]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[17719709-87e0-4239-aa08-bbaf5095e593]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.204s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/ea57d655-a24f-4a1c-bb1c-45e1dfc848c1/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bXSmTrFc {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bXSmTrFc" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b282af5-7ea2-4a19-a27d-ca5ad59ea526]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lock "a9a7676e-87d8-4e8a-832a-67a5470f16a1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.130s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bXSmTrFc'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/ea57d655-a24f-4a1c-bb1c-45e1dfc848c1/disk 1073741824" returned: 0 in 0.070s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa803489-6439-45dd-a14b-36c3124ed7e8]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa13edd-b577-4c7b-91c1-73883cf20ec2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:52:56 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:52:56 user nova-compute[74342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)
Oct 16 09:52:56 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:52:56 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:52:56 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:52:56 user nova-compute[74342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)
Oct 16 09:52:56 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:52:56 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02 -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02 -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1f986f-2671-40c3-b5f2-adaef34a3153]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02, portal: 172.16.0.220,3260]
Oct 16 09:52:56 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02, portal: 172.16.0.220,3260] successful.
Oct 16 09:52:56 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c625046b-9b24-4dfb-90f5-a19d41fa6064]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Acquiring lock "a9a7676e-87d8-4e8a-832a-67a5470f16a1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lock "a9a7676e-87d8-4e8a-832a-67a5470f16a1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:56 user nova-compute[74342]: INFO nova.compute.manager [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Attaching volume 3d1e1812-5021-4a60-8fbf-fe06ec4f7f05 to /dev/vdb
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae99a952-e4c9-49df-8d73-f68a52535082]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:52:56 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:52:56 user nova-compute[74342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)
Oct 16 09:52:56 user nova-compute[74342]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02 (non-flash)
Oct 16 09:52:56 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:52:56 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:52:56 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:52:56 user nova-compute[74342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)
Oct 16 09:52:56 user nova-compute[74342]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02 (non-flash)
Oct 16 09:52:56 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:52:56 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.461s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] HCTL ('37', '-', '-', 0) found on session 15 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.257s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ea57d655-a24f-4a1c-bb1c-45e1dfc848c1/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea57d655-a24f-4a1c-bb1c-45e1dfc848c1/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG os_brick.utils [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[667c3eba-e2f8-4c49-b694-7376f888ba1f]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Searching for a device in session 15 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bXSmTrFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a58a409-ffa2-4e27-bce5-844b061d3ca9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d13ea3c-2959-4310-b932-d353bdfa990b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8346a5e7-2cbe-4e59-b754-9af74bdfee13 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Acquiring lock "68e6e026-f958-40c4-ab99-19deaaa1590d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8346a5e7-2cbe-4e59-b754-9af74bdfee13 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Lock "68e6e026-f958-40c4-ab99-19deaaa1590d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8346a5e7-2cbe-4e59-b754-9af74bdfee13 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Acquiring lock "68e6e026-f958-40c4-ab99-19deaaa1590d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8346a5e7-2cbe-4e59-b754-9af74bdfee13 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Lock "68e6e026-f958-40c4-ab99-19deaaa1590d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8346a5e7-2cbe-4e59-b754-9af74bdfee13 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Lock "68e6e026-f958-40c4-ab99-19deaaa1590d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:56 user nova-compute[74342]: INFO nova.compute.manager [None req-8346a5e7-2cbe-4e59-b754-9af74bdfee13 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Terminating instance
Oct 16 09:52:56 user nova-compute[74342]: DEBUG nova.compute.manager [None req-8346a5e7-2cbe-4e59-b754-9af74bdfee13 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b6a0bdb-ad8f-4699-85dd-6dab0161d185]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[73648f95-45f7-4abc-a149-a38029dac5f6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea57d655-a24f-4a1c-bb1c-45e1dfc848c1/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Cannot resize image /opt/stack/data/nova/instances/ea57d655-a24f-4a1c-bb1c-45e1dfc848c1/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Ensure instance console log exists: /opt/stack/data/nova/instances/ea57d655-a24f-4a1c-bb1c-45e1dfc848c1/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:52:56 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1caebef-c39e-4a9b-bfb9-e86ea929bb0c]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG os_brick.utils [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] <== get_connector_properties: return (192ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Updating existing volume attachment record: e056bc95-33c8-4c3d-b242-85018ce95f5e {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.169s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG nova.network.neutron [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Successfully created port: d1d868a0-b6c1-456b-8a9c-fe78d9168ef4 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG nova.compute.manager [req-6f82fe20-cd04-47cb-9e52-83a4cdb97b1b req-06a8a180-2c7b-4c75-bdf0-7acf78285c44 service nova] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Received event network-vif-unplugged-131daf10-9476-45b2-b7cc-4a0c345200c6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-6f82fe20-cd04-47cb-9e52-83a4cdb97b1b req-06a8a180-2c7b-4c75-bdf0-7acf78285c44 service nova] Acquiring lock "68e6e026-f958-40c4-ab99-19deaaa1590d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-6f82fe20-cd04-47cb-9e52-83a4cdb97b1b req-06a8a180-2c7b-4c75-bdf0-7acf78285c44 service nova] Lock "68e6e026-f958-40c4-ab99-19deaaa1590d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-6f82fe20-cd04-47cb-9e52-83a4cdb97b1b req-06a8a180-2c7b-4c75-bdf0-7acf78285c44 service nova] Lock "68e6e026-f958-40c4-ab99-19deaaa1590d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG nova.compute.manager [req-6f82fe20-cd04-47cb-9e52-83a4cdb97b1b req-06a8a180-2c7b-4c75-bdf0-7acf78285c44 service nova] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] No waiting events found dispatching network-vif-unplugged-131daf10-9476-45b2-b7cc-4a0c345200c6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:52:56 user nova-compute[74342]: DEBUG nova.compute.manager [req-6f82fe20-cd04-47cb-9e52-83a4cdb97b1b req-06a8a180-2c7b-4c75-bdf0-7acf78285c44 service nova] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Received event network-vif-unplugged-131daf10-9476-45b2-b7cc-4a0c345200c6 for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 09:52:57 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Instance destroyed successfully.
Oct 16 09:52:57 user nova-compute[74342]: DEBUG nova.objects.instance [None req-8346a5e7-2cbe-4e59-b754-9af74bdfee13 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Lazy-loading 'resources' on Instance uuid 68e6e026-f958-40c4-ab99-19deaaa1590d {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-8346a5e7-2cbe-4e59-b754-9af74bdfee13 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:50:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1104153645',display_name='tempest-VolumesActionsTest-instance-1104153645',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1104153645',id=20,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:50:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4171b62daa60407f8e53376cf27928a2',ramdisk_id='',reservation_id='r-ldh07k9e',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-903466454',owner_user_name='tempest-VolumesActionsTest-903466454-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:50:58Z,user_data=None,user_id='b737bb80f17840b3a6eb803bfc4966be',uuid=68e6e026-f958-40c4-ab99-19deaaa1590d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "131daf10-9476-45b2-b7cc-4a0c345200c6", "address": "fa:16:3e:1a:68:d9", "network": {"id": "9353d3f4-c47f-4475-b7f1-5dce1d6e742c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-464040346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4171b62daa60407f8e53376cf27928a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131daf10-94", "ovs_interfaceid": "131daf10-9476-45b2-b7cc-4a0c345200c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-8346a5e7-2cbe-4e59-b754-9af74bdfee13 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Converting VIF {"id": "131daf10-9476-45b2-b7cc-4a0c345200c6", "address": "fa:16:3e:1a:68:d9", "network": {"id": "9353d3f4-c47f-4475-b7f1-5dce1d6e742c", "bridge": "br-int", "label": "tempest-VolumesActionsTest-464040346-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4171b62daa60407f8e53376cf27928a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap131daf10-94", "ovs_interfaceid": "131daf10-9476-45b2-b7cc-4a0c345200c6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-8346a5e7-2cbe-4e59-b754-9af74bdfee13 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1a:68:d9,bridge_name='br-int',has_traffic_filtering=True,id=131daf10-9476-45b2-b7cc-4a0c345200c6,network=Network(9353d3f4-c47f-4475-b7f1-5dce1d6e742c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap131daf10-94') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG os_vif [None req-8346a5e7-2cbe-4e59-b754-9af74bdfee13 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:68:d9,bridge_name='br-int',has_traffic_filtering=True,id=131daf10-9476-45b2-b7cc-4a0c345200c6,network=Network(9353d3f4-c47f-4475-b7f1-5dce1d6e742c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap131daf10-94') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap131daf10-94, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=08f5e6a5-f196-4733-b20e-bc0e1595af09) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:57 user nova-compute[74342]: INFO os_vif [None req-8346a5e7-2cbe-4e59-b754-9af74bdfee13 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1a:68:d9,bridge_name='br-int',has_traffic_filtering=True,id=131daf10-9476-45b2-b7cc-4a0c345200c6,network=Network(9353d3f4-c47f-4475-b7f1-5dce1d6e742c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap131daf10-94')
Oct 16 09:52:57 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-8346a5e7-2cbe-4e59-b754-9af74bdfee13 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Deleting instance files /opt/stack/data/nova/instances/68e6e026-f958-40c4-ab99-19deaaa1590d_del
Oct 16 09:52:57 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-8346a5e7-2cbe-4e59-b754-9af74bdfee13 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Deletion of /opt/stack/data/nova/instances/68e6e026-f958-40c4-ab99-19deaaa1590d_del complete
Oct 16 09:52:57 user nova-compute[74342]: INFO nova.compute.manager [None req-8346a5e7-2cbe-4e59-b754-9af74bdfee13 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 16 09:52:57 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-8346a5e7-2cbe-4e59-b754-9af74bdfee13 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.550s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] <== connect_volume: return (1553ms) {'type': 'block', 'scsi_wwn': '23232353030346238', 'path': '/dev/sdf'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232353030346238', 'path': '/dev/sdf'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG nova.objects.instance [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lazy-loading 'flavor' on Instance uuid c5e44d3b-ed41-4920-825f-e1d283caecfd {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 09:52:57 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:52:57 user nova-compute[74342]:   <source dev="/dev/sdf"/>
Oct 16 09:52:57 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:52:57 user nova-compute[74342]:   <serial>281894b3-f5a9-4b38-842f-ab4e3d550a02</serial>
Oct 16 09:52:57 user nova-compute[74342]: </disk>
Oct 16 09:52:57 user nova-compute[74342]:  {{(pid=74342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG nova.network.neutron [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Successfully updated port: d1d868a0-b6c1-456b-8a9c-fe78d9168ef4 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Acquiring lock "refresh_cache-ea57d655-a24f-4a1c-bb1c-45e1dfc848c1" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Acquired lock "refresh_cache-ea57d655-a24f-4a1c-bb1c-45e1dfc848c1" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG nova.network.neutron [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] No VIF found with MAC fa:16:3e:21:83:11, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG nova.compute.manager [req-efdf6a59-5962-4450-9d1a-133c74542b98 req-7ea0a432-2776-48ba-94a1-cdf45c2dbfe9 service nova] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Received event network-changed-d1d868a0-b6c1-456b-8a9c-fe78d9168ef4 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG nova.compute.manager [req-efdf6a59-5962-4450-9d1a-133c74542b98 req-7ea0a432-2776-48ba-94a1-cdf45c2dbfe9 service nova] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Refreshing instance network info cache due to event network-changed-d1d868a0-b6c1-456b-8a9c-fe78d9168ef4. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-efdf6a59-5962-4450-9d1a-133c74542b98 req-7ea0a432-2776-48ba-94a1-cdf45c2dbfe9 service nova] Acquiring lock "refresh_cache-ea57d655-a24f-4a1c-bb1c-45e1dfc848c1" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-edcefbe0-e89f-4496-9032-f9431d9d5c53" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-edcefbe0-e89f-4496-9032-f9431d9d5c53" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 09:52:57 user nova-compute[74342]: DEBUG nova.network.neutron [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9d435264-b300-49c9-b94c-f1a98509e624 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "c5e44d3b-ed41-4920-825f-e1d283caecfd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.711s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:52:58 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Took 0.75 seconds to deallocate network for instance.
Oct 16 09:52:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8346a5e7-2cbe-4e59-b754-9af74bdfee13 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8346a5e7-2cbe-4e59-b754-9af74bdfee13 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.network.neutron [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Updating instance_info_cache with network_info: [{"id": "d1d868a0-b6c1-456b-8a9c-fe78d9168ef4", "address": "fa:16:3e:8d:27:8f", "network": {"id": "7bc80f1e-0315-4a4e-bc89-2ad397451db6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1430189260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afd0e8f0d424fe393636bbcd26eed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d868a0-b6", "ovs_interfaceid": "d1d868a0-b6c1-456b-8a9c-fe78d9168ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Releasing lock "refresh_cache-ea57d655-a24f-4a1c-bb1c-45e1dfc848c1" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.compute.manager [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Instance network_info: |[{"id": "d1d868a0-b6c1-456b-8a9c-fe78d9168ef4", "address": "fa:16:3e:8d:27:8f", "network": {"id": "7bc80f1e-0315-4a4e-bc89-2ad397451db6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1430189260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afd0e8f0d424fe393636bbcd26eed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d868a0-b6", "ovs_interfaceid": "d1d868a0-b6c1-456b-8a9c-fe78d9168ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-efdf6a59-5962-4450-9d1a-133c74542b98 req-7ea0a432-2776-48ba-94a1-cdf45c2dbfe9 service nova] Acquired lock "refresh_cache-ea57d655-a24f-4a1c-bb1c-45e1dfc848c1" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.network.neutron [req-efdf6a59-5962-4450-9d1a-133c74542b98 req-7ea0a432-2776-48ba-94a1-cdf45c2dbfe9 service nova] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Refreshing network info cache for port d1d868a0-b6c1-456b-8a9c-fe78d9168ef4 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Start _get_guest_xml network_info=[{"id": "d1d868a0-b6c1-456b-8a9c-fe78d9168ef4", "address": "fa:16:3e:8d:27:8f", "network": {"id": "7bc80f1e-0315-4a4e-bc89-2ad397451db6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1430189260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afd0e8f0d424fe393636bbcd26eed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d868a0-b6", "ovs_interfaceid": "d1d868a0-b6c1-456b-8a9c-fe78d9168ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:52:58 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:52:58 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:52:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-232934220',display_name='tempest-VolumesAdminNegativeTest-server-232934220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-232934220',id=25,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0afd0e8f0d424fe393636bbcd26eed42',ramdisk_id='',reservation_id='r-yel98z7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1903882113',owner_user_name='tempest-VolumesAdminNegativeTest-1903882113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:52:55Z,user_data=None,user_id='353ec67aa4b84aa7b6992ccb49423ca6',uuid=ea57d655-a24f-4a1c-bb1c-45e1dfc848c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1d868a0-b6c1-456b-8a9c-fe78d9168ef4", "address": "fa:16:3e:8d:27:8f", "network": {"id": "7bc80f1e-0315-4a4e-bc89-2ad397451db6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1430189260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afd0e8f0d424fe393636bbcd26eed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d868a0-b6", "ovs_interfaceid": "d1d868a0-b6c1-456b-8a9c-fe78d9168ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Converting VIF {"id": "d1d868a0-b6c1-456b-8a9c-fe78d9168ef4", "address": "fa:16:3e:8d:27:8f", "network": {"id": "7bc80f1e-0315-4a4e-bc89-2ad397451db6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1430189260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afd0e8f0d424fe393636bbcd26eed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d868a0-b6", "ovs_interfaceid": "d1d868a0-b6c1-456b-8a9c-fe78d9168ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:27:8f,bridge_name='br-int',has_traffic_filtering=True,id=d1d868a0-b6c1-456b-8a9c-fe78d9168ef4,network=Network(7bc80f1e-0315-4a4e-bc89-2ad397451db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d868a0-b6') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.objects.instance [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lazy-loading 'pci_devices' on Instance uuid ea57d655-a24f-4a1c-bb1c-45e1dfc848c1 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:52:58 user nova-compute[74342]:   <uuid>ea57d655-a24f-4a1c-bb1c-45e1dfc848c1</uuid>
Oct 16 09:52:58 user nova-compute[74342]:   <name>instance-00000019</name>
Oct 16 09:52:58 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:52:58 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:52:58 user nova-compute[74342]:   <metadata>
Oct 16 09:52:58 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:52:58 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:52:58 user nova-compute[74342]:       <nova:name>tempest-VolumesAdminNegativeTest-server-232934220</nova:name>
Oct 16 09:52:58 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:52:58</nova:creationTime>
Oct 16 09:52:58 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:52:58 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:52:58 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:52:58 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:52:58 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:52:58 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:52:58 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:52:58 user nova-compute[74342]:       <nova:owner>
Oct 16 09:52:58 user nova-compute[74342]:         <nova:user uuid="353ec67aa4b84aa7b6992ccb49423ca6">tempest-VolumesAdminNegativeTest-1903882113-project-member</nova:user>
Oct 16 09:52:58 user nova-compute[74342]:         <nova:project uuid="0afd0e8f0d424fe393636bbcd26eed42">tempest-VolumesAdminNegativeTest-1903882113</nova:project>
Oct 16 09:52:58 user nova-compute[74342]:       </nova:owner>
Oct 16 09:52:58 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:52:58 user nova-compute[74342]:       <nova:ports>
Oct 16 09:52:58 user nova-compute[74342]:         <nova:port uuid="d1d868a0-b6c1-456b-8a9c-fe78d9168ef4">
Oct 16 09:52:58 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 16 09:52:58 user nova-compute[74342]:         </nova:port>
Oct 16 09:52:58 user nova-compute[74342]:       </nova:ports>
Oct 16 09:52:58 user nova-compute[74342]:     </nova:instance>
Oct 16 09:52:58 user nova-compute[74342]:   </metadata>
Oct 16 09:52:58 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:52:58 user nova-compute[74342]:     <system>
Oct 16 09:52:58 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:52:58 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:52:58 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:52:58 user nova-compute[74342]:       <entry name="serial">ea57d655-a24f-4a1c-bb1c-45e1dfc848c1</entry>
Oct 16 09:52:58 user nova-compute[74342]:       <entry name="uuid">ea57d655-a24f-4a1c-bb1c-45e1dfc848c1</entry>
Oct 16 09:52:58 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:52:58 user nova-compute[74342]:     </system>
Oct 16 09:52:58 user nova-compute[74342]:   </sysinfo>
Oct 16 09:52:58 user nova-compute[74342]:   <os>
Oct 16 09:52:58 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:52:58 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:52:58 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:52:58 user nova-compute[74342]:   </os>
Oct 16 09:52:58 user nova-compute[74342]:   <features>
Oct 16 09:52:58 user nova-compute[74342]:     <acpi/>
Oct 16 09:52:58 user nova-compute[74342]:     <apic/>
Oct 16 09:52:58 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:52:58 user nova-compute[74342]:   </features>
Oct 16 09:52:58 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:52:58 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:52:58 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:52:58 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:52:58 user nova-compute[74342]:   </clock>
Oct 16 09:52:58 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:52:58 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:52:58 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:52:58 user nova-compute[74342]:   </cpu>
Oct 16 09:52:58 user nova-compute[74342]:   <devices>
Oct 16 09:52:58 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 09:52:58 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 09:52:58 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/ea57d655-a24f-4a1c-bb1c-45e1dfc848c1/disk"/>
Oct 16 09:52:58 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:52:58 user nova-compute[74342]:     </disk>
Oct 16 09:52:58 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:52:58 user nova-compute[74342]:       <mac address="fa:16:3e:8d:27:8f"/>
Oct 16 09:52:58 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:52:58 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:52:58 user nova-compute[74342]:       <target dev="tapd1d868a0-b6"/>
Oct 16 09:52:58 user nova-compute[74342]:     </interface>
Oct 16 09:52:58 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:52:58 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/ea57d655-a24f-4a1c-bb1c-45e1dfc848c1/console.log" append="off"/>
Oct 16 09:52:58 user nova-compute[74342]:     </serial>
Oct 16 09:52:58 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:52:58 user nova-compute[74342]:     <video>
Oct 16 09:52:58 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:52:58 user nova-compute[74342]:     </video>
Oct 16 09:52:58 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:52:58 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:52:58 user nova-compute[74342]:     </rng>
Oct 16 09:52:58 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:52:58 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:52:58 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:52:58 user nova-compute[74342]:     </memballoon>
Oct 16 09:52:58 user nova-compute[74342]:   </devices>
Oct 16 09:52:58 user nova-compute[74342]: </domain>
Oct 16 09:52:58 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:52:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-232934220',display_name='tempest-VolumesAdminNegativeTest-server-232934220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-232934220',id=25,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0afd0e8f0d424fe393636bbcd26eed42',ramdisk_id='',reservation_id='r-yel98z7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1903882113',owner_user_name='tempest-VolumesAdminNegativeTest-1903882113-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:52:55Z,user_data=None,user_id='353ec67aa4b84aa7b6992ccb49423ca6',uuid=ea57d655-a24f-4a1c-bb1c-45e1dfc848c1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1d868a0-b6c1-456b-8a9c-fe78d9168ef4", "address": "fa:16:3e:8d:27:8f", "network": {"id": "7bc80f1e-0315-4a4e-bc89-2ad397451db6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1430189260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afd0e8f0d424fe393636bbcd26eed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d868a0-b6", "ovs_interfaceid": "d1d868a0-b6c1-456b-8a9c-fe78d9168ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Converting VIF {"id": "d1d868a0-b6c1-456b-8a9c-fe78d9168ef4", "address": "fa:16:3e:8d:27:8f", "network": {"id": "7bc80f1e-0315-4a4e-bc89-2ad397451db6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1430189260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afd0e8f0d424fe393636bbcd26eed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d868a0-b6", "ovs_interfaceid": "d1d868a0-b6c1-456b-8a9c-fe78d9168ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:27:8f,bridge_name='br-int',has_traffic_filtering=True,id=d1d868a0-b6c1-456b-8a9c-fe78d9168ef4,network=Network(7bc80f1e-0315-4a4e-bc89-2ad397451db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d868a0-b6') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG os_vif [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:27:8f,bridge_name='br-int',has_traffic_filtering=True,id=d1d868a0-b6c1-456b-8a9c-fe78d9168ef4,network=Network(7bc80f1e-0315-4a4e-bc89-2ad397451db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d868a0-b6') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ce2f213b-df6e-5890-91e3-48f74f6dab6f', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1d868a0-b6, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd1d868a0-b6, col_values=(('qos', UUID('0668a65b-7af4-4f6f-a69e-1cacdd397a4c')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd1d868a0-b6, col_values=(('external_ids', {'iface-id': 'd1d868a0-b6c1-456b-8a9c-fe78d9168ef4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:27:8f', 'vm-uuid': 'ea57d655-a24f-4a1c-bb1c-45e1dfc848c1'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:58 user nova-compute[74342]: INFO os_vif [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:27:8f,bridge_name='br-int',has_traffic_filtering=True,id=d1d868a0-b6c1-456b-8a9c-fe78d9168ef4,network=Network(7bc80f1e-0315-4a4e-bc89-2ad397451db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d868a0-b6')
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Updating instance_info_cache with network_info: [{"id": "5a9f3200-5a15-4afa-b812-7b68e3130d6d", "address": "fa:16:3e:df:2e:36", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a9f3200-5a", "ovs_interfaceid": "5a9f3200-5a15-4afa-b812-7b68e3130d6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] No VIF found with MAC fa:16:3e:8d:27:8f, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-edcefbe0-e89f-4496-9032-f9431d9d5c53" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.network.neutron [req-efdf6a59-5962-4450-9d1a-133c74542b98 req-7ea0a432-2776-48ba-94a1-cdf45c2dbfe9 service nova] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Updated VIF entry in instance network info cache for port d1d868a0-b6c1-456b-8a9c-fe78d9168ef4. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.network.neutron [req-efdf6a59-5962-4450-9d1a-133c74542b98 req-7ea0a432-2776-48ba-94a1-cdf45c2dbfe9 service nova] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Updating instance_info_cache with network_info: [{"id": "d1d868a0-b6c1-456b-8a9c-fe78d9168ef4", "address": "fa:16:3e:8d:27:8f", "network": {"id": "7bc80f1e-0315-4a4e-bc89-2ad397451db6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1430189260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afd0e8f0d424fe393636bbcd26eed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d868a0-b6", "ovs_interfaceid": "d1d868a0-b6c1-456b-8a9c-fe78d9168ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-efdf6a59-5962-4450-9d1a-133c74542b98 req-7ea0a432-2776-48ba-94a1-cdf45c2dbfe9 service nova] Releasing lock "refresh_cache-ea57d655-a24f-4a1c-bb1c-45e1dfc848c1" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-8346a5e7-2cbe-4e59-b754-9af74bdfee13 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-8346a5e7-2cbe-4e59-b754-9af74bdfee13 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8346a5e7-2cbe-4e59-b754-9af74bdfee13 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.597s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:58 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-8346a5e7-2cbe-4e59-b754-9af74bdfee13 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Deleted allocations for instance 68e6e026-f958-40c4-ab99-19deaaa1590d
Oct 16 09:52:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8346a5e7-2cbe-4e59-b754-9af74bdfee13 tempest-VolumesActionsTest-903466454 tempest-VolumesActionsTest-903466454-project-member] Lock "68e6e026-f958-40c4-ab99-19deaaa1590d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.471s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.compute.manager [req-d96f5f45-2b97-409a-b241-889d039d957d req-9d8a90fe-64dd-4893-be1e-a1071f19c3d7 service nova] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Received event network-vif-plugged-131daf10-9476-45b2-b7cc-4a0c345200c6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d96f5f45-2b97-409a-b241-889d039d957d req-9d8a90fe-64dd-4893-be1e-a1071f19c3d7 service nova] Acquiring lock "68e6e026-f958-40c4-ab99-19deaaa1590d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d96f5f45-2b97-409a-b241-889d039d957d req-9d8a90fe-64dd-4893-be1e-a1071f19c3d7 service nova] Lock "68e6e026-f958-40c4-ab99-19deaaa1590d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d96f5f45-2b97-409a-b241-889d039d957d req-9d8a90fe-64dd-4893-be1e-a1071f19c3d7 service nova] Lock "68e6e026-f958-40c4-ab99-19deaaa1590d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:52:58 user nova-compute[74342]: DEBUG nova.compute.manager [req-d96f5f45-2b97-409a-b241-889d039d957d req-9d8a90fe-64dd-4893-be1e-a1071f19c3d7 service nova] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] No waiting events found dispatching network-vif-plugged-131daf10-9476-45b2-b7cc-4a0c345200c6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:52:58 user nova-compute[74342]: WARNING nova.compute.manager [req-d96f5f45-2b97-409a-b241-889d039d957d req-9d8a90fe-64dd-4893-be1e-a1071f19c3d7 service nova] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Received unexpected event network-vif-plugged-131daf10-9476-45b2-b7cc-4a0c345200c6 for instance with vm_state deleted and task_state None.
Oct 16 09:52:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:52:59 user nova-compute[74342]: DEBUG nova.compute.manager [req-b0a29158-864a-4abe-8b9c-a24a2260784f req-7553f972-e36a-486d-8d1d-88466aed159f service nova] [instance: 68e6e026-f958-40c4-ab99-19deaaa1590d] Received event network-vif-deleted-131daf10-9476-45b2-b7cc-4a0c345200c6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:53:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:00 user nova-compute[74342]: DEBUG nova.compute.manager [req-18a68363-5ff9-4b33-a0dc-3fd323ebd995 req-9ee84ab3-0182-43da-8c4a-32b99ba81a82 service nova] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Received event network-vif-plugged-d1d868a0-b6c1-456b-8a9c-fe78d9168ef4 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:53:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-18a68363-5ff9-4b33-a0dc-3fd323ebd995 req-9ee84ab3-0182-43da-8c4a-32b99ba81a82 service nova] Acquiring lock "ea57d655-a24f-4a1c-bb1c-45e1dfc848c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:53:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-18a68363-5ff9-4b33-a0dc-3fd323ebd995 req-9ee84ab3-0182-43da-8c4a-32b99ba81a82 service nova] Lock "ea57d655-a24f-4a1c-bb1c-45e1dfc848c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:53:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-18a68363-5ff9-4b33-a0dc-3fd323ebd995 req-9ee84ab3-0182-43da-8c4a-32b99ba81a82 service nova] Lock "ea57d655-a24f-4a1c-bb1c-45e1dfc848c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:00 user nova-compute[74342]: DEBUG nova.compute.manager [req-18a68363-5ff9-4b33-a0dc-3fd323ebd995 req-9ee84ab3-0182-43da-8c4a-32b99ba81a82 service nova] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] No waiting events found dispatching network-vif-plugged-d1d868a0-b6c1-456b-8a9c-fe78d9168ef4 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:53:00 user nova-compute[74342]: WARNING nova.compute.manager [req-18a68363-5ff9-4b33-a0dc-3fd323ebd995 req-9ee84ab3-0182-43da-8c4a-32b99ba81a82 service nova] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Received unexpected event network-vif-plugged-d1d868a0-b6c1-456b-8a9c-fe78d9168ef4 for instance with vm_state building and task_state spawning.
Oct 16 09:53:00 user nova-compute[74342]: DEBUG nova.compute.manager [req-18a68363-5ff9-4b33-a0dc-3fd323ebd995 req-9ee84ab3-0182-43da-8c4a-32b99ba81a82 service nova] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Received event network-vif-plugged-d1d868a0-b6c1-456b-8a9c-fe78d9168ef4 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:53:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-18a68363-5ff9-4b33-a0dc-3fd323ebd995 req-9ee84ab3-0182-43da-8c4a-32b99ba81a82 service nova] Acquiring lock "ea57d655-a24f-4a1c-bb1c-45e1dfc848c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:53:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-18a68363-5ff9-4b33-a0dc-3fd323ebd995 req-9ee84ab3-0182-43da-8c4a-32b99ba81a82 service nova] Lock "ea57d655-a24f-4a1c-bb1c-45e1dfc848c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:53:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-18a68363-5ff9-4b33-a0dc-3fd323ebd995 req-9ee84ab3-0182-43da-8c4a-32b99ba81a82 service nova] Lock "ea57d655-a24f-4a1c-bb1c-45e1dfc848c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:00 user nova-compute[74342]: DEBUG nova.compute.manager [req-18a68363-5ff9-4b33-a0dc-3fd323ebd995 req-9ee84ab3-0182-43da-8c4a-32b99ba81a82 service nova] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] No waiting events found dispatching network-vif-plugged-d1d868a0-b6c1-456b-8a9c-fe78d9168ef4 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:53:00 user nova-compute[74342]: WARNING nova.compute.manager [req-18a68363-5ff9-4b33-a0dc-3fd323ebd995 req-9ee84ab3-0182-43da-8c4a-32b99ba81a82 service nova] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Received unexpected event network-vif-plugged-d1d868a0-b6c1-456b-8a9c-fe78d9168ef4 for instance with vm_state building and task_state spawning.
Oct 16 09:53:01 user nova-compute[74342]: DEBUG nova.compute.manager [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Stashing vm_state: active {{(pid=74342) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 16 09:53:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:53:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:53:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:53:01 user nova-compute[74342]: INFO nova.compute.claims [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Claim successful on node user
Oct 16 09:53:01 user nova-compute[74342]: INFO nova.compute.resource_tracker [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Updating resource usage from migration 8d9d989b-4b6c-4305-8176-e71adfb7315d
Oct 16 09:53:01 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:53:01 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:53:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.593s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:01 user nova-compute[74342]: INFO nova.compute.manager [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Migrating
Oct 16 09:53:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:53:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Acquired lock "compute-rpcapi-router" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:53:01 user nova-compute[74342]: INFO nova.compute.rpcapi [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Oct 16 09:53:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Releasing lock "compute-rpcapi-router" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:53:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Acquiring lock "refresh_cache-c5e44d3b-ed41-4920-825f-e1d283caecfd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:53:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Acquired lock "refresh_cache-c5e44d3b-ed41-4920-825f-e1d283caecfd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:53:01 user nova-compute[74342]: DEBUG nova.network.neutron [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:53:02 user nova-compute[74342]: DEBUG nova.compute.manager [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:53:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:53:02 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Instance spawned successfully.
Oct 16 09:53:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:53:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:53:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:53:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:53:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:53:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:53:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:53:02 user nova-compute[74342]: INFO nova.compute.manager [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Took 7.03 seconds to spawn the instance on the hypervisor.
Oct 16 09:53:02 user nova-compute[74342]: DEBUG nova.compute.manager [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:53:02 user nova-compute[74342]: DEBUG nova.network.neutron [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Updating instance_info_cache with network_info: [{"id": "6c307712-877a-44b9-9a89-ffad24cadbc4", "address": "fa:16:3e:21:83:11", "network": {"id": "7bf142ea-2d65-4e3e-95f4-691e535078c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409249207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81481518f90a4d99abd102ab65d54caa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c307712-87", "ovs_interfaceid": "6c307712-877a-44b9-9a89-ffad24cadbc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:53:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Releasing lock "refresh_cache-c5e44d3b-ed41-4920-825f-e1d283caecfd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:53:02 user nova-compute[74342]: INFO nova.compute.manager [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Took 8.79 seconds to build instance.
Oct 16 09:53:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-573548e3-6ae7-4ce0-80f3-423820741a5f tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "ea57d655-a24f-4a1c-bb1c-45e1dfc848c1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.912s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Starting migrate_disk_and_power_off {{(pid=74342) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 16 09:53:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG nova.compute.manager [req-7dfd97e9-2679-4088-a456-79e5020e5fbe req-9d8e2500-d2fd-486e-842d-cb5e6cffc8d3 service nova] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Received event network-vif-unplugged-6c307712-877a-44b9-9a89-ffad24cadbc4 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-7dfd97e9-2679-4088-a456-79e5020e5fbe req-9d8e2500-d2fd-486e-842d-cb5e6cffc8d3 service nova] Acquiring lock "c5e44d3b-ed41-4920-825f-e1d283caecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-7dfd97e9-2679-4088-a456-79e5020e5fbe req-9d8e2500-d2fd-486e-842d-cb5e6cffc8d3 service nova] Lock "c5e44d3b-ed41-4920-825f-e1d283caecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-7dfd97e9-2679-4088-a456-79e5020e5fbe req-9d8e2500-d2fd-486e-842d-cb5e6cffc8d3 service nova] Lock "c5e44d3b-ed41-4920-825f-e1d283caecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG nova.compute.manager [req-7dfd97e9-2679-4088-a456-79e5020e5fbe req-9d8e2500-d2fd-486e-842d-cb5e6cffc8d3 service nova] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] No waiting events found dispatching network-vif-unplugged-6c307712-877a-44b9-9a89-ffad24cadbc4 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:53:03 user nova-compute[74342]: WARNING nova.compute.manager [req-7dfd97e9-2679-4088-a456-79e5020e5fbe req-9d8e2500-d2fd-486e-842d-cb5e6cffc8d3 service nova] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Received unexpected event network-vif-unplugged-6c307712-877a-44b9-9a89-ffad24cadbc4 for instance with vm_state active and task_state resize_migrating.
Oct 16 09:53:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:03 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Instance destroyed successfully.
Oct 16 09:53:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:48:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-13118212',display_name='tempest-ServerActionsTestOtherB-server-13118212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-13118212',id=15,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFyI0lKp1ntOYPGityGnnSBavRl0hSeYQxboJuGTBYyIPdaJHX27900OLhX0GU91RcLxOgMFJOVCotJNi9ZnC1rWux5jCR//n+7EdDi2c7USVCSopq2ZuImlyPrRPszQA==',key_name='tempest-keypair-1671594657',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:48:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='81481518f90a4d99abd102ab65d54caa',ramdisk_id='',reservation_id='r-p5fny93p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1418473661',owner_user_name='tempest-ServerActionsTestOtherB-1418473661-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:53:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afbe4a406e6a43309a197e2a209c7554',uuid=c5e44d3b-ed41-4920-825f-e1d283caecfd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6c307712-877a-44b9-9a89-ffad24cadbc4", "address": "fa:16:3e:21:83:11", "network": {"id": "7bf142ea-2d65-4e3e-95f4-691e535078c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409249207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-409249207-network", "vif_mac": "fa:16:3e:21:83:11"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81481518f90a4d99abd102ab65d54caa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c307712-87", "ovs_interfaceid": "6c307712-877a-44b9-9a89-ffad24cadbc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Converting VIF {"id": "6c307712-877a-44b9-9a89-ffad24cadbc4", "address": "fa:16:3e:21:83:11", "network": {"id": "7bf142ea-2d65-4e3e-95f4-691e535078c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409249207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-409249207-network", "vif_mac": "fa:16:3e:21:83:11"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81481518f90a4d99abd102ab65d54caa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c307712-87", "ovs_interfaceid": "6c307712-877a-44b9-9a89-ffad24cadbc4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:21:83:11,bridge_name='br-int',has_traffic_filtering=True,id=6c307712-877a-44b9-9a89-ffad24cadbc4,network=Network(7bf142ea-2d65-4e3e-95f4-691e535078c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c307712-87') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG os_vif [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:83:11,bridge_name='br-int',has_traffic_filtering=True,id=6c307712-877a-44b9-9a89-ffad24cadbc4,network=Network(7bf142ea-2d65-4e3e-95f4-691e535078c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c307712-87') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c307712-87, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ca88ee3-53f2-4207-be27-9d02dc8fe63c) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:03 user nova-compute[74342]: INFO os_vif [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:21:83:11,bridge_name='br-int',has_traffic_filtering=True,id=6c307712-877a-44b9-9a89-ffad24cadbc4,network=Network(7bf142ea-2d65-4e3e-95f4-691e535078c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c307712-87')
Oct 16 09:53:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bXSmTrFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:53:03 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:53:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[248750e4-1605-46fd-9348-72439f659fd0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 09:53:03 user nova-compute[74342]: No targets found.
Oct 16 09:53:03 user nova-compute[74342]: iSNS:
Oct 16 09:53:03 user nova-compute[74342]: No targets found.
Oct 16 09:53:03 user nova-compute[74342]: STATIC:
Oct 16 09:53:03 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea
Oct 16 09:53:03 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:53:03 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:53:03 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192
Oct 16 09:53:03 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:53:03 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:53:03 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84
Oct 16 09:53:03 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:53:03 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:53:03 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02
Oct 16 09:53:03 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:53:03 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:53:03 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449
Oct 16 09:53:03 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:53:03 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:53:03 user nova-compute[74342]: FIRMWARE:
Oct 16 09:53:03 user nova-compute[74342]: No targets found.
Oct 16 09:53:03 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 09:53:03 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 09:53:03 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a23e80f-a5e1-4d07-9adc-0ad0eda1650a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9377cb69-24d4-4684-92c5-48eb552aadba]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:53:03 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:53:03 user nova-compute[74342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)
Oct 16 09:53:03 user nova-compute[74342]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02 (non-flash)
Oct 16 09:53:03 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:53:03 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:53:03 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:53:03 user nova-compute[74342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)
Oct 16 09:53:03 user nova-compute[74342]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02 (non-flash)
Oct 16 09:53:03 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:53:03 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b801bd870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02'): ({'sdf'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Removing single pathed devices sdf {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[aed0a727-8303-43e3-bcc8-ec4af9633fe5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0bd753-e77a-49d2-a752-fd43ce082d8d]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Flushing IO for device /dev/sdf {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8480361-e51f-45db-b653-44a62d02b71e]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.062s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[469f49b3-3667-4389-8d69-016e6fdff114]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] SCSI volumes sdf have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 09:53:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:04 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1724278-eb1d-4ac1-a813-3308ad88fba0]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:53:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02 -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:04 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[321a14ba-10ad-4c94-9001-906ff88e41ed]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02, portal: 172.16.0.220,3260]
Oct 16 09:53:04 user nova-compute[74342]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02, portal: 172.16.0.220,3260] successful.
Oct 16 09:53:04 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:53:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02 -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:04 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc9a2e5-3285-4c8f-92c4-a945a8c1c36c]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:53:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.356s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:53:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] <== disconnect_volume: return (357ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:53:04 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 09:53:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:04 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:53:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd_resize/disk /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] CMD "cp -r /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd_resize/disk /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk" returned: 0 in 0.317s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd_resize/disk.info /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk.info {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] CMD "cp -r /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd_resize/disk.info /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk.info" returned: 0 in 0.040s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:05 user nova-compute[74342]: DEBUG nova.compute.manager [req-8d46bdf5-326b-43ed-81cd-e6f825a589af req-98b54e7e-362b-49db-9785-394394c61d8b service nova] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Received event network-vif-plugged-6c307712-877a-44b9-9a89-ffad24cadbc4 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:53:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8d46bdf5-326b-43ed-81cd-e6f825a589af req-98b54e7e-362b-49db-9785-394394c61d8b service nova] Acquiring lock "c5e44d3b-ed41-4920-825f-e1d283caecfd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:53:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8d46bdf5-326b-43ed-81cd-e6f825a589af req-98b54e7e-362b-49db-9785-394394c61d8b service nova] Lock "c5e44d3b-ed41-4920-825f-e1d283caecfd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:53:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8d46bdf5-326b-43ed-81cd-e6f825a589af req-98b54e7e-362b-49db-9785-394394c61d8b service nova] Lock "c5e44d3b-ed41-4920-825f-e1d283caecfd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:05 user nova-compute[74342]: DEBUG nova.compute.manager [req-8d46bdf5-326b-43ed-81cd-e6f825a589af req-98b54e7e-362b-49db-9785-394394c61d8b service nova] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] No waiting events found dispatching network-vif-plugged-6c307712-877a-44b9-9a89-ffad24cadbc4 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:53:05 user nova-compute[74342]: WARNING nova.compute.manager [req-8d46bdf5-326b-43ed-81cd-e6f825a589af req-98b54e7e-362b-49db-9785-394394c61d8b service nova] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Received unexpected event network-vif-plugged-6c307712-877a-44b9-9a89-ffad24cadbc4 for instance with vm_state active and task_state resize_migrating.
Oct 16 09:53:06 user nova-compute[74342]: DEBUG nova.network.neutron [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Port 6c307712-877a-44b9-9a89-ffad24cadbc4 binding to destination host user is already ACTIVE {{(pid=74342) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 16 09:53:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Acquiring lock "c5e44d3b-ed41-4920-825f-e1d283caecfd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:53:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "c5e44d3b-ed41-4920-825f-e1d283caecfd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:53:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "c5e44d3b-ed41-4920-825f-e1d283caecfd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Acquiring lock "refresh_cache-c5e44d3b-ed41-4920-825f-e1d283caecfd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:53:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Acquired lock "refresh_cache-c5e44d3b-ed41-4920-825f-e1d283caecfd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:53:06 user nova-compute[74342]: DEBUG nova.network.neutron [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:53:06 user nova-compute[74342]: DEBUG nova.network.neutron [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Updating instance_info_cache with network_info: [{"id": "6c307712-877a-44b9-9a89-ffad24cadbc4", "address": "fa:16:3e:21:83:11", "network": {"id": "7bf142ea-2d65-4e3e-95f4-691e535078c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409249207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81481518f90a4d99abd102ab65d54caa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c307712-87", "ovs_interfaceid": "6c307712-877a-44b9-9a89-ffad24cadbc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:53:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Releasing lock "refresh_cache-c5e44d3b-ed41-4920-825f-e1d283caecfd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:53:07 user nova-compute[74342]: DEBUG os_brick.utils [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:53:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:07 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e108249-7005-428d-bf98-154be5cf52bc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:07 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[abe3a7c0-24b7-418a-8f20-24e31680e533]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:07 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a90317-8491-47cb-b41c-9d85adedf374]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:07 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e185ffc9-2562-449b-af93-cab403125150]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:53:07 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:53:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:53:07 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:53:07 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8276f53f-15ab-4847-a7fb-d7a9e9b63b53]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:07 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:53:07 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:53:07 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:53:07 user nova-compute[74342]: DEBUG os_brick.utils [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:53:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:10 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5dc86029-dcbf-4886-bdc9-7d4413059c96 is timed out.
Oct 16 09:53:10 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Successfully detached device vdb from instance 5dc86029-dcbf-4886-bdc9-7d4413059c96 from the live domain config.
Oct 16 09:53:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tAupThgs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:53:10 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:53:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c660dfa-046c-41a7-8db3-2ebde38c35fe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 09:53:10 user nova-compute[74342]: No targets found.
Oct 16 09:53:10 user nova-compute[74342]: iSNS:
Oct 16 09:53:10 user nova-compute[74342]: No targets found.
Oct 16 09:53:10 user nova-compute[74342]: STATIC:
Oct 16 09:53:10 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea
Oct 16 09:53:10 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:53:10 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:53:10 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192
Oct 16 09:53:10 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:53:10 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:53:10 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84
Oct 16 09:53:10 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:53:10 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:53:10 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449
Oct 16 09:53:10 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:53:10 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:53:10 user nova-compute[74342]: FIRMWARE:
Oct 16 09:53:10 user nova-compute[74342]: No targets found.
Oct 16 09:53:10 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 09:53:10 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 09:53:10 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a51d62-da58-4d87-81e8-4ec9c6fb2fc7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6220d6d-43df-40b1-9fa7-3309ffafb41c]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:53:10 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:53:10 user nova-compute[74342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)
Oct 16 09:53:10 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:53:10 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:53:10 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:53:10 user nova-compute[74342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)
Oct 16 09:53:10 user nova-compute[74342]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 (non-flash)
Oct 16 09:53:10 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b801efeb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192'): ({'sdc'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Removing single pathed devices sdc {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[44954db4-f590-4db5-a1c8-e0d721e9916f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea3319b6-68a6-4ccb-a999-6f95722b1fbe]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Flushing IO for device /dev/sdc {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e59ebd88-1f39-4943-874e-d5f85bb64225]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.051s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e9f0fd-d7cc-4107-9d35-cf22649d28f3]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] SCSI volumes sdc have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9bcb8c-fd79-4701-baaf-c3d40e482ecd]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3a5494e-1bef-45c3-bab4-06f6ddc35caf]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192, portal: 172.16.0.220,3260]
Oct 16 09:53:10 user nova-compute[74342]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192, portal: 172.16.0.220,3260] successful.
Oct 16 09:53:10 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c8c6991f-abcd-4da9-b892-764e07129192 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb31451-261a-4ba8-8d79-0681e98f240b]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] <== disconnect_volume: return (320ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:53:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 09:53:11 user nova-compute[74342]: DEBUG nova.objects.instance [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lazy-loading 'flavor' on Instance uuid 5dc86029-dcbf-4886-bdc9-7d4413059c96 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:53:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a571b664-3dc2-4c77-b197-e7becbe909f4 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "5dc86029-dcbf-4886-bdc9-7d4413059c96" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.036s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:11 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a9acd5f6-12e3-488b-b6c6-e4b81f5fc897 is timed out.
Oct 16 09:53:11 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Successfully detached device vdb from instance a9acd5f6-12e3-488b-b6c6-e4b81f5fc897 from the live domain config.
Oct 16 09:53:11 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 09:53:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qUtsWFpE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:53:11 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:53:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:53:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:53:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[db03ef69-2270-4feb-b5d0-c80394969107]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 09:53:12 user nova-compute[74342]: No targets found.
Oct 16 09:53:12 user nova-compute[74342]: iSNS:
Oct 16 09:53:12 user nova-compute[74342]: No targets found.
Oct 16 09:53:12 user nova-compute[74342]: STATIC:
Oct 16 09:53:12 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea
Oct 16 09:53:12 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:53:12 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:53:12 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84
Oct 16 09:53:12 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:53:12 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:53:12 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449
Oct 16 09:53:12 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:53:12 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:53:12 user nova-compute[74342]: FIRMWARE:
Oct 16 09:53:12 user nova-compute[74342]: No targets found.
Oct 16 09:53:12 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 09:53:12 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 09:53:12 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d805bfb-0932-4eba-8f62-25b7e48d52e4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23cbd3d-28b1-4b55-b914-a47a9f3df7ad]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:53:12 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:53:12 user nova-compute[74342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)
Oct 16 09:53:12 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:53:12 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:53:12 user nova-compute[74342]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 (non-flash)
Oct 16 09:53:12 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b601c4b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449'): ({'sde'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Removing single pathed devices sde {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6d3399-3365-4de7-84ba-d888e3e90df9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad5f735-bf42-41e4-9681-b76089ad460e]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Flushing IO for device /dev/sde {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cf4c444-89ad-4d63-a500-f5fafc60196d]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a545cd3-faa3-435d-b0e0-9d90ed1ba085]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] SCSI volumes sde have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[612dd6f6-32d4-4f1d-b2dc-ae535e9ad8ab]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75bb846-a97a-436e-b4fa-dc0012fe15e0]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449, portal: 172.16.0.220,3260]
Oct 16 09:53:12 user nova-compute[74342]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449, portal: 172.16.0.220,3260] successful.
Oct 16 09:53:12 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ed3c06eb-8a87-4939-b3f5-28aecc6c0449 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab476048-f5cd-47cd-af10-34d43e344f87]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] <== disconnect_volume: return (325ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 09:53:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:13 user nova-compute[74342]: DEBUG nova.objects.instance [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lazy-loading 'flavor' on Instance uuid a9acd5f6-12e3-488b-b6c6-e4b81f5fc897 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:53:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-56af8ed3-2488-4c1a-8640-7a696958070e tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.812s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.volume.cinder [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Update attachment failed for attachment 9b700544-127c-4fce-9469-42ab96820bce. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ed7a1aef-888d-46dc-8bab-745999bd3a3e) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ed7a1aef-888d-46dc-8bab-745999bd3a3e)
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Setting instance vm_state to ERROR: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ed7a1aef-888d-46dc-8bab-745999bd3a3e)
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Traceback (most recent call last):
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]   File "/opt/stack/nova/nova/compute/manager.py", line 10845, in _error_out_instance_on_exception
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]     yield
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]   File "/opt/stack/nova/nova/compute/manager.py", line 6377, in _finish_resize_helper
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]     network_info = self._finish_resize(context, instance, migration,
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]   File "/opt/stack/nova/nova/compute/manager.py", line 6281, in _finish_resize
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]     self._update_volume_attachments(context, instance, bdms)
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]   File "/opt/stack/nova/nova/compute/manager.py", line 6211, in _update_volume_attachments
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]     self.volume_api.attachment_update(
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]     res = method(self, ctx, *args, **kwargs)
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]     with excutils.save_and_reraise_exception():
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]     self.force_reraise()
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]     raise self.value
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]     context, '3.44', skip_version_check=True).attachments.update(
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]     return method.func(obj, *args, **kwargs)
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]     resp = self._update('/attachments/%s' % id, body)
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]     return self._cs_request(url, 'PUT', **kwargs)
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]     return self.request(url, method, **kwargs)
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd]     raise exceptions.from_response(resp, body)
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ed7a1aef-888d-46dc-8bab-745999bd3a3e)
Oct 16 09:53:13 user nova-compute[74342]: ERROR nova.compute.manager [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] 
Oct 16 09:53:13 user nova-compute[74342]: INFO nova.compute.manager [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Deleting allocations for old flavor on source node user after finish_resize failure. You may be able to recover the instance by hard rebooting it.
Oct 16 09:53:13 user nova-compute[74342]: DEBUG nova.compute.manager [req-5e03944b-4372-403a-9cae-107bad847921 req-c1bea75f-9007-4aad-bd6e-5c6b997aeda7 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Received event network-changed-2f21663b-c324-4ed7-80ff-fedf6e5631c8 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:53:13 user nova-compute[74342]: DEBUG nova.compute.manager [req-5e03944b-4372-403a-9cae-107bad847921 req-c1bea75f-9007-4aad-bd6e-5c6b997aeda7 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Refreshing instance network info cache due to event network-changed-2f21663b-c324-4ed7-80ff-fedf6e5631c8. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:53:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5e03944b-4372-403a-9cae-107bad847921 req-c1bea75f-9007-4aad-bd6e-5c6b997aeda7 service nova] Acquiring lock "refresh_cache-eeee39f2-9728-4114-8bd3-1d05f69a1215" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:53:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5e03944b-4372-403a-9cae-107bad847921 req-c1bea75f-9007-4aad-bd6e-5c6b997aeda7 service nova] Acquired lock "refresh_cache-eeee39f2-9728-4114-8bd3-1d05f69a1215" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:53:13 user nova-compute[74342]: DEBUG nova.network.neutron [req-5e03944b-4372-403a-9cae-107bad847921 req-c1bea75f-9007-4aad-bd6e-5c6b997aeda7 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Refreshing network info cache for port 2f21663b-c324-4ed7-80ff-fedf6e5631c8 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:53:13 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Deleted allocation for migration 8d9d989b-4b6c-4305-8176-e71adfb7315d
Oct 16 09:53:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:53:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:53:14 user nova-compute[74342]: DEBUG nova.network.neutron [req-5e03944b-4372-403a-9cae-107bad847921 req-c1bea75f-9007-4aad-bd6e-5c6b997aeda7 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Updated VIF entry in instance network info cache for port 2f21663b-c324-4ed7-80ff-fedf6e5631c8. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:53:14 user nova-compute[74342]: DEBUG nova.network.neutron [req-5e03944b-4372-403a-9cae-107bad847921 req-c1bea75f-9007-4aad-bd6e-5c6b997aeda7 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Updating instance_info_cache with network_info: [{"id": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "address": "fa:16:3e:7a:a5:ca", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f21663b-c3", "ovs_interfaceid": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:53:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5e03944b-4372-403a-9cae-107bad847921 req-c1bea75f-9007-4aad-bd6e-5c6b997aeda7 service nova] Releasing lock "refresh_cache-eeee39f2-9728-4114-8bd3-1d05f69a1215" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:53:14 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:53:14 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:53:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.483s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:14 user nova-compute[74342]: INFO nova.compute.manager [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Successfully reverted task state from resize_finish on failure for instance.
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server [None req-96ee51f9-f97d-4b5d-a68b-e0feda7fcecc tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ed7a1aef-888d-46dc-8bab-745999bd3a3e)
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 145, in decorated_function
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6347, in finish_resize
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6344, in finish_resize
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self._finish_resize_helper(context, disk_info, image, instance,
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6377, in _finish_resize_helper
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     network_info = self._finish_resize(context, instance, migration,
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6281, in _finish_resize
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self._update_volume_attachments(context, instance, bdms)
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 6211, in _update_volume_attachments
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self.volume_api.attachment_update(
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     raise self.value
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-ed7a1aef-888d-46dc-8bab-745999bd3a3e)
Oct 16 09:53:14 user nova-compute[74342]: ERROR oslo_messaging.rpc.server 
Oct 16 09:53:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 09:53:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'biHyMTtK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:53:14 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:53:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:53:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:53:14 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:53:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:53:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:53:14 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 09:53:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05 -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6248b07-894d-4980-83d9-9639b2e7f93b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 09:53:14 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05 -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[387e17b4-f8bd-42cb-afca-150f0419c9b4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05] added
Oct 16 09:53:15 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[82a7ac06-e59b-42be-b19a-779ac790fdf5]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0046f43-bae4-43ab-be84-123dda74a16a]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v biHyMTtK {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v biHyMTtK" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa34e51-4f10-4fca-9be1-38cfe6a63e30]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'biHyMTtK'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f77a1747-117d-40b1-a163-e918c5f6f807]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[adbfb6a3-754e-4ae8-b2a2-7c3faef46738]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:53:15 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:53:15 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:53:15 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:53:15 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05 -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec17e4f-897c-407f-bcad-c62f250da486]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05, portal: 172.16.0.220,3260]
Oct 16 09:53:15 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05, portal: 172.16.0.220,3260] successful.
Oct 16 09:53:15 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7924443-dd86-4dc3-aefe-47f1213086d9]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e5ef3af-ea48-465e-89b8-a85121b99fa0]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:53:15 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:53:15 user nova-compute[74342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05 (non-flash)
Oct 16 09:53:15 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:53:15 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:53:15 user nova-compute[74342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05 (non-flash)
Oct 16 09:53:15 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bba9b0-b95d-4306-93b7-0ed6a4148660]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:15 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: None {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:53:16 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:53:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'biHyMTtK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 09:53:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:53:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23538353163373465', 'path': '/dev/sdc'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:53:16 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23538353163373465', 'path': '/dev/sdc'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 09:53:16 user nova-compute[74342]: DEBUG nova.objects.instance [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lazy-loading 'flavor' on Instance uuid a9a7676e-87d8-4e8a-832a-67a5470f16a1 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:53:16 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 09:53:16 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:53:16 user nova-compute[74342]:   <source dev="/dev/sdc"/>
Oct 16 09:53:16 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:53:16 user nova-compute[74342]:   <serial>3d1e1812-5021-4a60-8fbf-fe06ec4f7f05</serial>
Oct 16 09:53:16 user nova-compute[74342]: </disk>
Oct 16 09:53:16 user nova-compute[74342]:  {{(pid=74342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 09:53:16 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:53:16 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:53:16 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] No VIF found with MAC fa:16:3e:cc:84:df, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:53:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7cf099a2-fed1-4ee5-85e8-e1863b100f3d tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lock "a9a7676e-87d8-4e8a-832a-67a5470f16a1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 20.633s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:17 user nova-compute[74342]: DEBUG nova.compute.manager [req-c1a63494-a624-495f-b0e9-6e40b59c5a16 req-19488884-e880-41a0-b156-c96bb4a2e2af service nova] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Received event network-changed-e597fbea-47fd-4bc6-b92e-e1ca5ba6059a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:53:17 user nova-compute[74342]: DEBUG nova.compute.manager [req-c1a63494-a624-495f-b0e9-6e40b59c5a16 req-19488884-e880-41a0-b156-c96bb4a2e2af service nova] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Refreshing instance network info cache due to event network-changed-e597fbea-47fd-4bc6-b92e-e1ca5ba6059a. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:53:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c1a63494-a624-495f-b0e9-6e40b59c5a16 req-19488884-e880-41a0-b156-c96bb4a2e2af service nova] Acquiring lock "refresh_cache-b16a3439-f343-4fae-9a5e-e07d8c84b955" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:53:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c1a63494-a624-495f-b0e9-6e40b59c5a16 req-19488884-e880-41a0-b156-c96bb4a2e2af service nova] Acquired lock "refresh_cache-b16a3439-f343-4fae-9a5e-e07d8c84b955" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:53:17 user nova-compute[74342]: DEBUG nova.network.neutron [req-c1a63494-a624-495f-b0e9-6e40b59c5a16 req-19488884-e880-41a0-b156-c96bb4a2e2af service nova] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Refreshing network info cache for port e597fbea-47fd-4bc6-b92e-e1ca5ba6059a {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:53:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Acquiring lock "a9a7676e-87d8-4e8a-832a-67a5470f16a1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:53:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lock "a9a7676e-87d8-4e8a-832a-67a5470f16a1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:53:18 user nova-compute[74342]: INFO nova.compute.manager [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Detaching volume 3d1e1812-5021-4a60-8fbf-fe06ec4f7f05
Oct 16 09:53:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8bb2ace4-3ffd-4200-b30f-ec67da38d378 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "b16a3439-f343-4fae-9a5e-e07d8c84b955" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:53:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8bb2ace4-3ffd-4200-b30f-ec67da38d378 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "b16a3439-f343-4fae-9a5e-e07d8c84b955" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:53:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8bb2ace4-3ffd-4200-b30f-ec67da38d378 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "b16a3439-f343-4fae-9a5e-e07d8c84b955-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:53:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8bb2ace4-3ffd-4200-b30f-ec67da38d378 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "b16a3439-f343-4fae-9a5e-e07d8c84b955-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:53:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8bb2ace4-3ffd-4200-b30f-ec67da38d378 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "b16a3439-f343-4fae-9a5e-e07d8c84b955-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:18 user nova-compute[74342]: INFO nova.compute.manager [None req-8bb2ace4-3ffd-4200-b30f-ec67da38d378 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Terminating instance
Oct 16 09:53:18 user nova-compute[74342]: DEBUG nova.compute.manager [None req-8bb2ace4-3ffd-4200-b30f-ec67da38d378 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 09:53:18 user nova-compute[74342]: DEBUG nova.network.neutron [req-c1a63494-a624-495f-b0e9-6e40b59c5a16 req-19488884-e880-41a0-b156-c96bb4a2e2af service nova] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Updated VIF entry in instance network info cache for port e597fbea-47fd-4bc6-b92e-e1ca5ba6059a. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:53:18 user nova-compute[74342]: DEBUG nova.network.neutron [req-c1a63494-a624-495f-b0e9-6e40b59c5a16 req-19488884-e880-41a0-b156-c96bb4a2e2af service nova] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Updating instance_info_cache with network_info: [{"id": "e597fbea-47fd-4bc6-b92e-e1ca5ba6059a", "address": "fa:16:3e:0b:7e:19", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.92", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape597fbea-47", "ovs_interfaceid": "e597fbea-47fd-4bc6-b92e-e1ca5ba6059a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:53:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c1a63494-a624-495f-b0e9-6e40b59c5a16 req-19488884-e880-41a0-b156-c96bb4a2e2af service nova] Releasing lock "refresh_cache-b16a3439-f343-4fae-9a5e-e07d8c84b955" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:53:18 user nova-compute[74342]: INFO nova.virt.block_device [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Attempting to driver detach volume 3d1e1812-5021-4a60-8fbf-fe06ec4f7f05 from mountpoint /dev/vdb
Oct 16 09:53:18 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Attempting to detach device vdb from instance a9a7676e-87d8-4e8a-832a-67a5470f16a1 from the persistent domain config. {{(pid=74342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 09:53:18 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 09:53:18 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:53:18 user nova-compute[74342]:   <source dev="/dev/sdc"/>
Oct 16 09:53:18 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:53:18 user nova-compute[74342]:   <serial>3d1e1812-5021-4a60-8fbf-fe06ec4f7f05</serial>
Oct 16 09:53:18 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 09:53:18 user nova-compute[74342]: </disk>
Oct 16 09:53:18 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 09:53:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:18 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Successfully detached device vdb from instance a9a7676e-87d8-4e8a-832a-67a5470f16a1 from the persistent domain config.
Oct 16 09:53:18 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a9a7676e-87d8-4e8a-832a-67a5470f16a1 from the live domain config. {{(pid=74342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 09:53:18 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 09:53:18 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:53:18 user nova-compute[74342]:   <source dev="/dev/sdc"/>
Oct 16 09:53:18 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:53:18 user nova-compute[74342]:   <serial>3d1e1812-5021-4a60-8fbf-fe06ec4f7f05</serial>
Oct 16 09:53:18 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 09:53:18 user nova-compute[74342]: </disk>
Oct 16 09:53:18 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 09:53:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:18 user nova-compute[74342]: DEBUG nova.compute.manager [req-07b39ba6-45e0-4272-bd47-1492efa637ea req-2c28b12a-b0ab-4858-9597-4144f0170106 service nova] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Received event network-vif-unplugged-e597fbea-47fd-4bc6-b92e-e1ca5ba6059a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:53:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-07b39ba6-45e0-4272-bd47-1492efa637ea req-2c28b12a-b0ab-4858-9597-4144f0170106 service nova] Acquiring lock "b16a3439-f343-4fae-9a5e-e07d8c84b955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:53:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-07b39ba6-45e0-4272-bd47-1492efa637ea req-2c28b12a-b0ab-4858-9597-4144f0170106 service nova] Lock "b16a3439-f343-4fae-9a5e-e07d8c84b955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:53:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-07b39ba6-45e0-4272-bd47-1492efa637ea req-2c28b12a-b0ab-4858-9597-4144f0170106 service nova] Lock "b16a3439-f343-4fae-9a5e-e07d8c84b955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:18 user nova-compute[74342]: DEBUG nova.compute.manager [req-07b39ba6-45e0-4272-bd47-1492efa637ea req-2c28b12a-b0ab-4858-9597-4144f0170106 service nova] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] No waiting events found dispatching network-vif-unplugged-e597fbea-47fd-4bc6-b92e-e1ca5ba6059a {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:53:18 user nova-compute[74342]: DEBUG nova.compute.manager [req-07b39ba6-45e0-4272-bd47-1492efa637ea req-2c28b12a-b0ab-4858-9597-4144f0170106 service nova] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Received event network-vif-unplugged-e597fbea-47fd-4bc6-b92e-e1ca5ba6059a for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 09:53:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:18 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a9a7676e-87d8-4e8a-832a-67a5470f16a1 {{(pid=74342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 09:53:19 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Instance destroyed successfully.
Oct 16 09:53:19 user nova-compute[74342]: DEBUG nova.objects.instance [None req-8bb2ace4-3ffd-4200-b30f-ec67da38d378 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lazy-loading 'resources' on Instance uuid b16a3439-f343-4fae-9a5e-e07d8c84b955 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:53:19 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-8bb2ace4-3ffd-4200-b30f-ec67da38d378 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:51:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-475402272',display_name='tempest-AttachVolumeNegativeTest-server-475402272',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-475402272',id=23,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMeIPdvex+JZNXj/40qWOU3f3UKPw8zHWUSC188YeGbQLbJ6P0u0Edksw6VipIFuh2or2bSs/2gWMgShxgKAGmFtBRcPIIWfTF3k0vP1ejV46S0PYhHmfblo/iqzFLyGA==',key_name='tempest-keypair-966876636',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:51:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08329cd0ad7d42a1999ca4f407d93245',ramdisk_id='',reservation_id='r-7udztms0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-119585701',owner_user_name='tempest-AttachVolumeNegativeTest-119585701-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:51:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee02f6ad1d9749948f43fb432685d067',uuid=b16a3439-f343-4fae-9a5e-e07d8c84b955,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e597fbea-47fd-4bc6-b92e-e1ca5ba6059a", "address": "fa:16:3e:0b:7e:19", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape597fbea-47", "ovs_interfaceid": "e597fbea-47fd-4bc6-b92e-e1ca5ba6059a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:53:19 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-8bb2ace4-3ffd-4200-b30f-ec67da38d378 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Converting VIF {"id": "e597fbea-47fd-4bc6-b92e-e1ca5ba6059a", "address": "fa:16:3e:0b:7e:19", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape597fbea-47", "ovs_interfaceid": "e597fbea-47fd-4bc6-b92e-e1ca5ba6059a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:53:19 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-8bb2ace4-3ffd-4200-b30f-ec67da38d378 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7e:19,bridge_name='br-int',has_traffic_filtering=True,id=e597fbea-47fd-4bc6-b92e-e1ca5ba6059a,network=Network(023e393d-f8ef-42f1-8879-6259a82218cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape597fbea-47') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:53:19 user nova-compute[74342]: DEBUG os_vif [None req-8bb2ace4-3ffd-4200-b30f-ec67da38d378 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7e:19,bridge_name='br-int',has_traffic_filtering=True,id=e597fbea-47fd-4bc6-b92e-e1ca5ba6059a,network=Network(023e393d-f8ef-42f1-8879-6259a82218cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape597fbea-47') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:53:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape597fbea-47, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:53:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:53:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=02e24948-2651-4ee8-a3a7-c047f3473585) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:53:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:19 user nova-compute[74342]: INFO os_vif [None req-8bb2ace4-3ffd-4200-b30f-ec67da38d378 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:7e:19,bridge_name='br-int',has_traffic_filtering=True,id=e597fbea-47fd-4bc6-b92e-e1ca5ba6059a,network=Network(023e393d-f8ef-42f1-8879-6259a82218cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape597fbea-47')
Oct 16 09:53:19 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-8bb2ace4-3ffd-4200-b30f-ec67da38d378 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Deleting instance files /opt/stack/data/nova/instances/b16a3439-f343-4fae-9a5e-e07d8c84b955_del
Oct 16 09:53:19 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-8bb2ace4-3ffd-4200-b30f-ec67da38d378 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Deletion of /opt/stack/data/nova/instances/b16a3439-f343-4fae-9a5e-e07d8c84b955_del complete
Oct 16 09:53:19 user nova-compute[74342]: INFO nova.compute.manager [None req-8bb2ace4-3ffd-4200-b30f-ec67da38d378 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Took 1.02 seconds to destroy the instance on the hypervisor.
Oct 16 09:53:19 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-8bb2ace4-3ffd-4200-b30f-ec67da38d378 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 09:53:19 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 09:53:19 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 09:53:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "eeee39f2-9728-4114-8bd3-1d05f69a1215" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:53:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "eeee39f2-9728-4114-8bd3-1d05f69a1215" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:53:19 user nova-compute[74342]: INFO nova.compute.manager [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Shelving
Oct 16 09:53:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:19 user nova-compute[74342]: DEBUG nova.compute.manager [req-f65600f8-1420-42a4-89c8-1f50d916777e req-e88e2e98-0585-4e5d-a9bf-d5dde164c6e0 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Received event network-vif-unplugged-2f21663b-c324-4ed7-80ff-fedf6e5631c8 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:53:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f65600f8-1420-42a4-89c8-1f50d916777e req-e88e2e98-0585-4e5d-a9bf-d5dde164c6e0 service nova] Acquiring lock "eeee39f2-9728-4114-8bd3-1d05f69a1215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:53:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f65600f8-1420-42a4-89c8-1f50d916777e req-e88e2e98-0585-4e5d-a9bf-d5dde164c6e0 service nova] Lock "eeee39f2-9728-4114-8bd3-1d05f69a1215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:53:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f65600f8-1420-42a4-89c8-1f50d916777e req-e88e2e98-0585-4e5d-a9bf-d5dde164c6e0 service nova] Lock "eeee39f2-9728-4114-8bd3-1d05f69a1215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:19 user nova-compute[74342]: DEBUG nova.compute.manager [req-f65600f8-1420-42a4-89c8-1f50d916777e req-e88e2e98-0585-4e5d-a9bf-d5dde164c6e0 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] No waiting events found dispatching network-vif-unplugged-2f21663b-c324-4ed7-80ff-fedf6e5631c8 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:53:19 user nova-compute[74342]: WARNING nova.compute.manager [req-f65600f8-1420-42a4-89c8-1f50d916777e req-e88e2e98-0585-4e5d-a9bf-d5dde164c6e0 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Received unexpected event network-vif-unplugged-2f21663b-c324-4ed7-80ff-fedf6e5631c8 for instance with vm_state active and task_state shelving.
Oct 16 09:53:20 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Instance destroyed successfully.
Oct 16 09:53:20 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:53:20 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Beginning cold snapshot process
Oct 16 09:53:20 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Took 0.87 seconds to deallocate network for instance.
Oct 16 09:53:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8bb2ace4-3ffd-4200-b30f-ec67da38d378 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:53:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8bb2ace4-3ffd-4200-b30f-ec67da38d378 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:53:20 user nova-compute[74342]: DEBUG nova.privsep.utils [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 09:53:20 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk /opt/stack/data/nova/instances/snapshots/tmp5ne0h2a8/bc4969786f7a4c85917ca8cf1976b8c9 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:20 user nova-compute[74342]: DEBUG nova.compute.manager [req-35bd8016-f7de-45b3-8c31-5352da8b9911 req-1f6c1e1b-c63a-4e61-9a6b-d397055478d9 service nova] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Received event network-vif-plugged-e597fbea-47fd-4bc6-b92e-e1ca5ba6059a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:53:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-35bd8016-f7de-45b3-8c31-5352da8b9911 req-1f6c1e1b-c63a-4e61-9a6b-d397055478d9 service nova] Acquiring lock "b16a3439-f343-4fae-9a5e-e07d8c84b955-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:53:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-35bd8016-f7de-45b3-8c31-5352da8b9911 req-1f6c1e1b-c63a-4e61-9a6b-d397055478d9 service nova] Lock "b16a3439-f343-4fae-9a5e-e07d8c84b955-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:53:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-35bd8016-f7de-45b3-8c31-5352da8b9911 req-1f6c1e1b-c63a-4e61-9a6b-d397055478d9 service nova] Lock "b16a3439-f343-4fae-9a5e-e07d8c84b955-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:20 user nova-compute[74342]: DEBUG nova.compute.manager [req-35bd8016-f7de-45b3-8c31-5352da8b9911 req-1f6c1e1b-c63a-4e61-9a6b-d397055478d9 service nova] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] No waiting events found dispatching network-vif-plugged-e597fbea-47fd-4bc6-b92e-e1ca5ba6059a {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:53:20 user nova-compute[74342]: WARNING nova.compute.manager [req-35bd8016-f7de-45b3-8c31-5352da8b9911 req-1f6c1e1b-c63a-4e61-9a6b-d397055478d9 service nova] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Received unexpected event network-vif-plugged-e597fbea-47fd-4bc6-b92e-e1ca5ba6059a for instance with vm_state deleted and task_state None.
Oct 16 09:53:20 user nova-compute[74342]: DEBUG nova.compute.manager [req-35bd8016-f7de-45b3-8c31-5352da8b9911 req-1f6c1e1b-c63a-4e61-9a6b-d397055478d9 service nova] [instance: b16a3439-f343-4fae-9a5e-e07d8c84b955] Received event network-vif-deleted-e597fbea-47fd-4bc6-b92e-e1ca5ba6059a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:53:20 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-8bb2ace4-3ffd-4200-b30f-ec67da38d378 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:53:20 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-8bb2ace4-3ffd-4200-b30f-ec67da38d378 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:53:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8bb2ace4-3ffd-4200-b30f-ec67da38d378 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.589s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:20 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-8bb2ace4-3ffd-4200-b30f-ec67da38d378 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Deleted allocations for instance b16a3439-f343-4fae-9a5e-e07d8c84b955
Oct 16 09:53:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8bb2ace4-3ffd-4200-b30f-ec67da38d378 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "b16a3439-f343-4fae-9a5e-e07d8c84b955" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.671s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk /opt/stack/data/nova/instances/snapshots/tmp5ne0h2a8/bc4969786f7a4c85917ca8cf1976b8c9" returned: 0 in 0.680s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:21 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Snapshot extracted, beginning image upload
Oct 16 09:53:21 user nova-compute[74342]: DEBUG nova.compute.manager [req-7dd35035-266c-4927-afd5-cc93edd99f16 req-fadba954-a9ab-4ed7-941e-39f6af5238d4 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Received event network-vif-plugged-2f21663b-c324-4ed7-80ff-fedf6e5631c8 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:53:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-7dd35035-266c-4927-afd5-cc93edd99f16 req-fadba954-a9ab-4ed7-941e-39f6af5238d4 service nova] Acquiring lock "eeee39f2-9728-4114-8bd3-1d05f69a1215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:53:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-7dd35035-266c-4927-afd5-cc93edd99f16 req-fadba954-a9ab-4ed7-941e-39f6af5238d4 service nova] Lock "eeee39f2-9728-4114-8bd3-1d05f69a1215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:53:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-7dd35035-266c-4927-afd5-cc93edd99f16 req-fadba954-a9ab-4ed7-941e-39f6af5238d4 service nova] Lock "eeee39f2-9728-4114-8bd3-1d05f69a1215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:21 user nova-compute[74342]: DEBUG nova.compute.manager [req-7dd35035-266c-4927-afd5-cc93edd99f16 req-fadba954-a9ab-4ed7-941e-39f6af5238d4 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] No waiting events found dispatching network-vif-plugged-2f21663b-c324-4ed7-80ff-fedf6e5631c8 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:53:21 user nova-compute[74342]: WARNING nova.compute.manager [req-7dd35035-266c-4927-afd5-cc93edd99f16 req-fadba954-a9ab-4ed7-941e-39f6af5238d4 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Received unexpected event network-vif-plugged-2f21663b-c324-4ed7-80ff-fedf6e5631c8 for instance with vm_state active and task_state shelving_image_uploading.
Oct 16 09:53:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:23 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Snapshot image upload complete
Oct 16 09:53:23 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:53:23 user nova-compute[74342]: INFO nova.compute.manager [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Shelve offloading
Oct 16 09:53:23 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Instance destroyed successfully.
Oct 16 09:53:23 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:53:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "refresh_cache-eeee39f2-9728-4114-8bd3-1d05f69a1215" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:53:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquired lock "refresh_cache-eeee39f2-9728-4114-8bd3-1d05f69a1215" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:53:23 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:53:24 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Updating instance_info_cache with network_info: [{"id": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "address": "fa:16:3e:7a:a5:ca", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f21663b-c3", "ovs_interfaceid": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:53:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Releasing lock "refresh_cache-eeee39f2-9728-4114-8bd3-1d05f69a1215" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:53:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:24 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Instance destroyed successfully.
Oct 16 09:53:24 user nova-compute[74342]: DEBUG nova.objects.instance [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lazy-loading 'resources' on Instance uuid eeee39f2-9728-4114-8bd3-1d05f69a1215 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:53:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1957313876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1957313876',id=22,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA73VdBJ5ylQREnZzo1DcCKTXomTVssllhy6Bsc/R9T/BngGDJaacG1M/H4yJnuSLGKGGYKR1zjZCaYpdn685spvq9Aw7a1FZR+w5BmYmqQ12LQgzJnL3CoZ3rsf0xXY0A==',key_name='tempest-keypair-1825544135',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:51:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a70b9ea5f3404a5690cd0a73db23f034',ramdisk_id='',reservation_id='r-1dw8qoh2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-939526853',owner_user_name='tempest-AttachVolumeShelveTestJSON-939526853-project-member',shelved_at='2023-10-16T09:53:23.663357',shelved_host='user',shelved_image_id='99afbe16-9947-4ce7-b069-8b63097a58d6'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:53:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8bf8aa8ab2d4105ad0b1fd04247e3a0',uuid=eeee39f2-9728-4114-8bd3-1d05f69a1215,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "address": "fa:16:3e:7a:a5:ca", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f21663b-c3", "ovs_interfaceid": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:53:24 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Converting VIF {"id": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "address": "fa:16:3e:7a:a5:ca", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f21663b-c3", "ovs_interfaceid": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:53:24 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:a5:ca,bridge_name='br-int',has_traffic_filtering=True,id=2f21663b-c324-4ed7-80ff-fedf6e5631c8,network=Network(bbeb1d70-a5dc-46d6-a0dd-240bf3018d31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f21663b-c3') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:53:24 user nova-compute[74342]: DEBUG os_vif [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:a5:ca,bridge_name='br-int',has_traffic_filtering=True,id=2f21663b-c324-4ed7-80ff-fedf6e5631c8,network=Network(bbeb1d70-a5dc-46d6-a0dd-240bf3018d31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f21663b-c3') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:53:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f21663b-c3, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:53:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:53:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97d7fa90-fe0b-4028-8084-1078e55d097f) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:53:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:53:24 user nova-compute[74342]: INFO os_vif [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:a5:ca,bridge_name='br-int',has_traffic_filtering=True,id=2f21663b-c324-4ed7-80ff-fedf6e5631c8,network=Network(bbeb1d70-a5dc-46d6-a0dd-240bf3018d31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f21663b-c3')
Oct 16 09:53:24 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Deleting instance files /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215_del
Oct 16 09:53:24 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Deletion of /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215_del complete
Oct 16 09:53:24 user nova-compute[74342]: DEBUG nova.compute.manager [req-675eea0e-64f8-49af-bbdc-eb2859cbcd9a req-12ef644f-e910-43dc-9434-244e0d006063 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Received event network-changed-2f21663b-c324-4ed7-80ff-fedf6e5631c8 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:53:24 user nova-compute[74342]: DEBUG nova.compute.manager [req-675eea0e-64f8-49af-bbdc-eb2859cbcd9a req-12ef644f-e910-43dc-9434-244e0d006063 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Refreshing instance network info cache due to event network-changed-2f21663b-c324-4ed7-80ff-fedf6e5631c8. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:53:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-675eea0e-64f8-49af-bbdc-eb2859cbcd9a req-12ef644f-e910-43dc-9434-244e0d006063 service nova] Acquiring lock "refresh_cache-eeee39f2-9728-4114-8bd3-1d05f69a1215" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:53:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-675eea0e-64f8-49af-bbdc-eb2859cbcd9a req-12ef644f-e910-43dc-9434-244e0d006063 service nova] Acquired lock "refresh_cache-eeee39f2-9728-4114-8bd3-1d05f69a1215" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:53:24 user nova-compute[74342]: DEBUG nova.network.neutron [req-675eea0e-64f8-49af-bbdc-eb2859cbcd9a req-12ef644f-e910-43dc-9434-244e0d006063 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Refreshing network info cache for port 2f21663b-c324-4ed7-80ff-fedf6e5631c8 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:53:24 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Deleted allocations for instance eeee39f2-9728-4114-8bd3-1d05f69a1215
Oct 16 09:53:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:53:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:53:24 user nova-compute[74342]: DEBUG nova.objects.instance [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lazy-loading 'numa_topology' on Instance uuid eeee39f2-9728-4114-8bd3-1d05f69a1215 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:53:24 user nova-compute[74342]: DEBUG nova.objects.base [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Object Instance<eeee39f2-9728-4114-8bd3-1d05f69a1215> lazy-loaded attributes: resources,numa_topology {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 09:53:25 user nova-compute[74342]: DEBUG nova.network.neutron [req-675eea0e-64f8-49af-bbdc-eb2859cbcd9a req-12ef644f-e910-43dc-9434-244e0d006063 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Updated VIF entry in instance network info cache for port 2f21663b-c324-4ed7-80ff-fedf6e5631c8. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:53:25 user nova-compute[74342]: DEBUG nova.network.neutron [req-675eea0e-64f8-49af-bbdc-eb2859cbcd9a req-12ef644f-e910-43dc-9434-244e0d006063 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Updating instance_info_cache with network_info: [{"id": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "address": "fa:16:3e:7a:a5:ca", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap2f21663b-c3", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:53:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-675eea0e-64f8-49af-bbdc-eb2859cbcd9a req-12ef644f-e910-43dc-9434-244e0d006063 service nova] Releasing lock "refresh_cache-eeee39f2-9728-4114-8bd3-1d05f69a1215" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:53:25 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:53:25 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:53:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.452s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c7b42830-f553-408c-b43c-fbba597d4156 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "eeee39f2-9728-4114-8bd3-1d05f69a1215" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.869s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:38 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a9a7676e-87d8-4e8a-832a-67a5470f16a1 is timed out.
Oct 16 09:53:38 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Successfully detached device vdb from instance a9a7676e-87d8-4e8a-832a-67a5470f16a1 from the live domain config.
Oct 16 09:53:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 09:53:38 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'biHyMTtK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:53:38 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:53:38 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:53:38 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:53:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:38 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b18c546c-9cc4-4cd6-96d6-339c62214e01]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:38 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 09:53:38 user nova-compute[74342]: No targets found.
Oct 16 09:53:38 user nova-compute[74342]: iSNS:
Oct 16 09:53:38 user nova-compute[74342]: No targets found.
Oct 16 09:53:38 user nova-compute[74342]: STATIC:
Oct 16 09:53:38 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea
Oct 16 09:53:38 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:53:38 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:53:38 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84
Oct 16 09:53:38 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:53:38 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:53:38 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05
Oct 16 09:53:38 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:53:38 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:53:38 user nova-compute[74342]: FIRMWARE:
Oct 16 09:53:38 user nova-compute[74342]: No targets found.
Oct 16 09:53:38 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:53:38 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 09:53:38 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 09:53:38 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 09:53:38 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 09:53:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:38 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aeac2bc-d4af-411a-aca6-237fe63220f0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:38 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd8d5c6-c90a-4e56-9a4b-f292b5578513]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:38 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:53:38 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:53:38 user nova-compute[74342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05 (non-flash)
Oct 16 09:53:38 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:53:38 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:53:38 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:53:38 user nova-compute[74342]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05 (non-flash)
Oct 16 09:53:38 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:53:38 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b801344c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05'): ({'sdc'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 09:53:38 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Removing single pathed devices sdc {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[827c7fac-d9e1-42c5-81d2-30766c3ebf2e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a855601a-e80f-4900-af02-a0ce8623c158]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Flushing IO for device /dev/sdc {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[813262c3-cc94-4b81-9a3f-f6adc2787ce2]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd39206-8950-4fe4-b982-3bbb40a1c999]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] SCSI volumes sdc have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8dcf1e0-f58b-42ab-af2d-d270864dc8f0]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05 -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b37ab0f4-5343-4a0b-b596-43f482ce07c3]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05, portal: 172.16.0.220,3260]
Oct 16 09:53:39 user nova-compute[74342]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05, portal: 172.16.0.220,3260] successful.
Oct 16 09:53:39 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05 -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3d1e1812-5021-4a60-8fbf-fe06ec4f7f05 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e138f68-35c6-46b1-9267-842e7b7201a7]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] <== disconnect_volume: return (292ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-21a0490c-4491-4e3b-9be4-82ed507149bc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "5dc86029-dcbf-4886-bdc9-7d4413059c96" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-21a0490c-4491-4e3b-9be4-82ed507149bc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "5dc86029-dcbf-4886-bdc9-7d4413059c96" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-21a0490c-4491-4e3b-9be4-82ed507149bc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "5dc86029-dcbf-4886-bdc9-7d4413059c96-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-21a0490c-4491-4e3b-9be4-82ed507149bc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "5dc86029-dcbf-4886-bdc9-7d4413059c96-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-21a0490c-4491-4e3b-9be4-82ed507149bc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "5dc86029-dcbf-4886-bdc9-7d4413059c96-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:39 user nova-compute[74342]: INFO nova.compute.manager [None req-21a0490c-4491-4e3b-9be4-82ed507149bc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Terminating instance
Oct 16 09:53:39 user nova-compute[74342]: DEBUG nova.compute.manager [None req-21a0490c-4491-4e3b-9be4-82ed507149bc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG nova.compute.manager [req-b5ad1ac9-e541-4e4c-8bb1-2e4f88efa62a req-cebaa774-8747-4682-a1c3-288603a6d66d service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Received event network-vif-unplugged-951f9dec-9a54-4fca-a7d4-c0044b873dbf {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b5ad1ac9-e541-4e4c-8bb1-2e4f88efa62a req-cebaa774-8747-4682-a1c3-288603a6d66d service nova] Acquiring lock "5dc86029-dcbf-4886-bdc9-7d4413059c96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b5ad1ac9-e541-4e4c-8bb1-2e4f88efa62a req-cebaa774-8747-4682-a1c3-288603a6d66d service nova] Lock "5dc86029-dcbf-4886-bdc9-7d4413059c96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b5ad1ac9-e541-4e4c-8bb1-2e4f88efa62a req-cebaa774-8747-4682-a1c3-288603a6d66d service nova] Lock "5dc86029-dcbf-4886-bdc9-7d4413059c96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG nova.compute.manager [req-b5ad1ac9-e541-4e4c-8bb1-2e4f88efa62a req-cebaa774-8747-4682-a1c3-288603a6d66d service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] No waiting events found dispatching network-vif-unplugged-951f9dec-9a54-4fca-a7d4-c0044b873dbf {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:53:39 user nova-compute[74342]: DEBUG nova.compute.manager [req-b5ad1ac9-e541-4e4c-8bb1-2e4f88efa62a req-cebaa774-8747-4682-a1c3-288603a6d66d service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Received event network-vif-unplugged-951f9dec-9a54-4fca-a7d4-c0044b873dbf for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 09:53:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:40 user nova-compute[74342]: DEBUG nova.objects.instance [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lazy-loading 'flavor' on Instance uuid a9a7676e-87d8-4e8a-832a-67a5470f16a1 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:53:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ccf92ce9-0480-4967-93a0-edffc5481464 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lock "a9a7676e-87d8-4e8a-832a-67a5470f16a1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.824s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:40 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Instance destroyed successfully.
Oct 16 09:53:40 user nova-compute[74342]: DEBUG nova.objects.instance [None req-21a0490c-4491-4e3b-9be4-82ed507149bc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lazy-loading 'resources' on Instance uuid 5dc86029-dcbf-4886-bdc9-7d4413059c96 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:53:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-21a0490c-4491-4e3b-9be4-82ed507149bc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T09:47:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1925950729',display_name='tempest-ServerActionsTestOtherA-server-1573235159',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1925950729',id=13,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBENlsyLKWKrYF7OcOeajHHxxGyLS1hP9Z+t1OgPZy4taPt9sKtivrgHdPrFdyhMN0XH93w8AnoJZMLK1ZeOS0cwQwCLjdSdOan0bKTxZLlv4i5AfsZfy9oM6wACrGz48LQ==',key_name='tempest-keypair-501012977',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:50:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='355bac247f9d4ea8b3c2f0d87453f4c1',ramdisk_id='',reservation_id='r-o0rm909r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1004911708',owner_user_name='tempest-ServerActionsTestOtherA-1004911708-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:50:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3c728429a0a42789cfc0f1251d6f623',uuid=5dc86029-dcbf-4886-bdc9-7d4413059c96,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "address": "fa:16:3e:72:e1:f9", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951f9dec-9a", "ovs_interfaceid": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:53:40 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-21a0490c-4491-4e3b-9be4-82ed507149bc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Converting VIF {"id": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "address": "fa:16:3e:72:e1:f9", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.132", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap951f9dec-9a", "ovs_interfaceid": "951f9dec-9a54-4fca-a7d4-c0044b873dbf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:53:40 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-21a0490c-4491-4e3b-9be4-82ed507149bc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:72:e1:f9,bridge_name='br-int',has_traffic_filtering=True,id=951f9dec-9a54-4fca-a7d4-c0044b873dbf,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap951f9dec-9a') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:53:40 user nova-compute[74342]: DEBUG os_vif [None req-21a0490c-4491-4e3b-9be4-82ed507149bc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:e1:f9,bridge_name='br-int',has_traffic_filtering=True,id=951f9dec-9a54-4fca-a7d4-c0044b873dbf,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap951f9dec-9a') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:53:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap951f9dec-9a, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:53:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:53:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=afa2d8d8-4580-42de-a2a8-3fe7b11a1985) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:53:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:40 user nova-compute[74342]: INFO os_vif [None req-21a0490c-4491-4e3b-9be4-82ed507149bc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:72:e1:f9,bridge_name='br-int',has_traffic_filtering=True,id=951f9dec-9a54-4fca-a7d4-c0044b873dbf,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap951f9dec-9a')
Oct 16 09:53:40 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-21a0490c-4491-4e3b-9be4-82ed507149bc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Deleting instance files /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96_del
Oct 16 09:53:40 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-21a0490c-4491-4e3b-9be4-82ed507149bc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Deletion of /opt/stack/data/nova/instances/5dc86029-dcbf-4886-bdc9-7d4413059c96_del complete
Oct 16 09:53:40 user nova-compute[74342]: INFO nova.compute.manager [None req-21a0490c-4491-4e3b-9be4-82ed507149bc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 16 09:53:40 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-21a0490c-4491-4e3b-9be4-82ed507149bc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 09:53:40 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 09:53:40 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 09:53:41 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:53:41 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Took 0.79 seconds to deallocate network for instance.
Oct 16 09:53:41 user nova-compute[74342]: DEBUG nova.compute.manager [req-97f24abc-5faa-4a0b-856e-e1a4ad198382 req-36e30b98-1fb9-42e5-9804-e4726b2310eb service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Received event network-vif-deleted-951f9dec-9a54-4fca-a7d4-c0044b873dbf {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:53:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-21a0490c-4491-4e3b-9be4-82ed507149bc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:53:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-21a0490c-4491-4e3b-9be4-82ed507149bc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:53:41 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-21a0490c-4491-4e3b-9be4-82ed507149bc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:53:41 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-21a0490c-4491-4e3b-9be4-82ed507149bc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:53:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c0edc5c7-b440-4536-98ae-c994431330f4 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Acquiring lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:53:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c0edc5c7-b440-4536-98ae-c994431330f4 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:53:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c0edc5c7-b440-4536-98ae-c994431330f4 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Acquiring lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:53:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c0edc5c7-b440-4536-98ae-c994431330f4 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:53:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c0edc5c7-b440-4536-98ae-c994431330f4 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:41 user nova-compute[74342]: INFO nova.compute.manager [None req-c0edc5c7-b440-4536-98ae-c994431330f4 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Terminating instance
Oct 16 09:53:41 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c0edc5c7-b440-4536-98ae-c994431330f4 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 09:53:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-21a0490c-4491-4e3b-9be4-82ed507149bc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.406s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:41 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-21a0490c-4491-4e3b-9be4-82ed507149bc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Deleted allocations for instance 5dc86029-dcbf-4886-bdc9-7d4413059c96
Oct 16 09:53:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-21a0490c-4491-4e3b-9be4-82ed507149bc tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "5dc86029-dcbf-4886-bdc9-7d4413059c96" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.255s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:42 user nova-compute[74342]: DEBUG nova.compute.manager [req-ce90d2f6-033c-462a-85a9-4ef27b1334cb req-6a8168c1-537c-48d2-b563-cec17d9c6330 service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Received event network-vif-plugged-951f9dec-9a54-4fca-a7d4-c0044b873dbf {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:53:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ce90d2f6-033c-462a-85a9-4ef27b1334cb req-6a8168c1-537c-48d2-b563-cec17d9c6330 service nova] Acquiring lock "5dc86029-dcbf-4886-bdc9-7d4413059c96-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:53:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ce90d2f6-033c-462a-85a9-4ef27b1334cb req-6a8168c1-537c-48d2-b563-cec17d9c6330 service nova] Lock "5dc86029-dcbf-4886-bdc9-7d4413059c96-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:53:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ce90d2f6-033c-462a-85a9-4ef27b1334cb req-6a8168c1-537c-48d2-b563-cec17d9c6330 service nova] Lock "5dc86029-dcbf-4886-bdc9-7d4413059c96-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:42 user nova-compute[74342]: DEBUG nova.compute.manager [req-ce90d2f6-033c-462a-85a9-4ef27b1334cb req-6a8168c1-537c-48d2-b563-cec17d9c6330 service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] No waiting events found dispatching network-vif-plugged-951f9dec-9a54-4fca-a7d4-c0044b873dbf {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:53:42 user nova-compute[74342]: WARNING nova.compute.manager [req-ce90d2f6-033c-462a-85a9-4ef27b1334cb req-6a8168c1-537c-48d2-b563-cec17d9c6330 service nova] [instance: 5dc86029-dcbf-4886-bdc9-7d4413059c96] Received unexpected event network-vif-plugged-951f9dec-9a54-4fca-a7d4-c0044b873dbf for instance with vm_state deleted and task_state None.
Oct 16 09:53:42 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Instance destroyed successfully.
Oct 16 09:53:42 user nova-compute[74342]: DEBUG nova.objects.instance [None req-c0edc5c7-b440-4536-98ae-c994431330f4 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lazy-loading 'resources' on Instance uuid a9acd5f6-12e3-488b-b6c6-e4b81f5fc897 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:53:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-c0edc5c7-b440-4536-98ae-c994431330f4 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:49:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1952933349',display_name='tempest-TestServerVolumeAttachmentScenario-server-1952933349',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1952933349',id=17,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIg1CF/1Uk/w+c+EFhwpCueuNR4kL4fpwsqNe9Rcizbzi2wO4DqRZAGnAn9s6Q8iU73g3QYp0c/1K9KVH05HbyZ+9np9IIVcivVP90LQHXw2dt9hFGIzYT0h/SxU2mPYUQ==',key_name='tempest-keypair-528613319',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:49:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e198c124675940d69559cd3ae04644c3',ramdisk_id='',reservation_id='r-ubjivh6g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-584784491',owner_user_name='tempest-TestServerVolumeAttachmentScenario-584784491-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:49:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='86582c54136d4b07bf02392c984e0e02',uuid=a9acd5f6-12e3-488b-b6c6-e4b81f5fc897,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da49a9b4-9434-45c8-93cd-e7bfb0654d87", "address": "fa:16:3e:5a:fd:10", "network": {"id": "cb593fff-0bec-4f80-8b28-361a9ca3aa47", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-43873371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e198c124675940d69559cd3ae04644c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda49a9b4-94", "ovs_interfaceid": "da49a9b4-9434-45c8-93cd-e7bfb0654d87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:53:42 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-c0edc5c7-b440-4536-98ae-c994431330f4 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Converting VIF {"id": "da49a9b4-9434-45c8-93cd-e7bfb0654d87", "address": "fa:16:3e:5a:fd:10", "network": {"id": "cb593fff-0bec-4f80-8b28-361a9ca3aa47", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-43873371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.154", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e198c124675940d69559cd3ae04644c3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda49a9b4-94", "ovs_interfaceid": "da49a9b4-9434-45c8-93cd-e7bfb0654d87", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:53:42 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-c0edc5c7-b440-4536-98ae-c994431330f4 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:fd:10,bridge_name='br-int',has_traffic_filtering=True,id=da49a9b4-9434-45c8-93cd-e7bfb0654d87,network=Network(cb593fff-0bec-4f80-8b28-361a9ca3aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda49a9b4-94') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:53:42 user nova-compute[74342]: DEBUG os_vif [None req-c0edc5c7-b440-4536-98ae-c994431330f4 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:fd:10,bridge_name='br-int',has_traffic_filtering=True,id=da49a9b4-9434-45c8-93cd-e7bfb0654d87,network=Network(cb593fff-0bec-4f80-8b28-361a9ca3aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda49a9b4-94') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:53:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda49a9b4-94, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:53:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:53:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4a130598-1ad6-4e41-8eec-06806970f9a6) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:53:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:42 user nova-compute[74342]: INFO os_vif [None req-c0edc5c7-b440-4536-98ae-c994431330f4 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5a:fd:10,bridge_name='br-int',has_traffic_filtering=True,id=da49a9b4-9434-45c8-93cd-e7bfb0654d87,network=Network(cb593fff-0bec-4f80-8b28-361a9ca3aa47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda49a9b4-94')
Oct 16 09:53:42 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-c0edc5c7-b440-4536-98ae-c994431330f4 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Deleting instance files /opt/stack/data/nova/instances/a9acd5f6-12e3-488b-b6c6-e4b81f5fc897_del
Oct 16 09:53:42 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-c0edc5c7-b440-4536-98ae-c994431330f4 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Deletion of /opt/stack/data/nova/instances/a9acd5f6-12e3-488b-b6c6-e4b81f5fc897_del complete
Oct 16 09:53:42 user nova-compute[74342]: INFO nova.compute.manager [None req-c0edc5c7-b440-4536-98ae-c994431330f4 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 16 09:53:42 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-c0edc5c7-b440-4536-98ae-c994431330f4 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 09:53:42 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 09:53:42 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 09:53:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:43 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:53:43 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Took 0.67 seconds to deallocate network for instance.
Oct 16 09:53:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c0edc5c7-b440-4536-98ae-c994431330f4 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:53:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c0edc5c7-b440-4536-98ae-c994431330f4 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:53:43 user nova-compute[74342]: DEBUG nova.compute.manager [req-93d213b1-3607-4c65-985b-6ceedeeebd41 req-ed4a124e-f46f-43cc-96db-3b9cf380003f service nova] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Received event network-vif-deleted-da49a9b4-9434-45c8-93cd-e7bfb0654d87 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:53:43 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-c0edc5c7-b440-4536-98ae-c994431330f4 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:53:43 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-c0edc5c7-b440-4536-98ae-c994431330f4 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:53:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c0edc5c7-b440-4536-98ae-c994431330f4 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:43 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-c0edc5c7-b440-4536-98ae-c994431330f4 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Deleted allocations for instance a9acd5f6-12e3-488b-b6c6-e4b81f5fc897
Oct 16 09:53:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c0edc5c7-b440-4536-98ae-c994431330f4 tempest-TestServerVolumeAttachmentScenario-584784491 tempest-TestServerVolumeAttachmentScenario-584784491-project-member] Lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.103s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:44 user nova-compute[74342]: DEBUG nova.compute.manager [req-dc01e370-7892-4b73-bd41-2e8f0447a481 req-aaba4c9a-8007-4dcc-871f-56d9340211d1 service nova] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Received event network-vif-unplugged-da49a9b4-9434-45c8-93cd-e7bfb0654d87 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:53:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-dc01e370-7892-4b73-bd41-2e8f0447a481 req-aaba4c9a-8007-4dcc-871f-56d9340211d1 service nova] Acquiring lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:53:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-dc01e370-7892-4b73-bd41-2e8f0447a481 req-aaba4c9a-8007-4dcc-871f-56d9340211d1 service nova] Lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:53:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-dc01e370-7892-4b73-bd41-2e8f0447a481 req-aaba4c9a-8007-4dcc-871f-56d9340211d1 service nova] Lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:44 user nova-compute[74342]: DEBUG nova.compute.manager [req-dc01e370-7892-4b73-bd41-2e8f0447a481 req-aaba4c9a-8007-4dcc-871f-56d9340211d1 service nova] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] No waiting events found dispatching network-vif-unplugged-da49a9b4-9434-45c8-93cd-e7bfb0654d87 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:53:44 user nova-compute[74342]: WARNING nova.compute.manager [req-dc01e370-7892-4b73-bd41-2e8f0447a481 req-aaba4c9a-8007-4dcc-871f-56d9340211d1 service nova] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Received unexpected event network-vif-unplugged-da49a9b4-9434-45c8-93cd-e7bfb0654d87 for instance with vm_state deleted and task_state None.
Oct 16 09:53:44 user nova-compute[74342]: DEBUG nova.compute.manager [req-dc01e370-7892-4b73-bd41-2e8f0447a481 req-aaba4c9a-8007-4dcc-871f-56d9340211d1 service nova] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Received event network-vif-plugged-da49a9b4-9434-45c8-93cd-e7bfb0654d87 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:53:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-dc01e370-7892-4b73-bd41-2e8f0447a481 req-aaba4c9a-8007-4dcc-871f-56d9340211d1 service nova] Acquiring lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:53:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-dc01e370-7892-4b73-bd41-2e8f0447a481 req-aaba4c9a-8007-4dcc-871f-56d9340211d1 service nova] Lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:53:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-dc01e370-7892-4b73-bd41-2e8f0447a481 req-aaba4c9a-8007-4dcc-871f-56d9340211d1 service nova] Lock "a9acd5f6-12e3-488b-b6c6-e4b81f5fc897-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:44 user nova-compute[74342]: DEBUG nova.compute.manager [req-dc01e370-7892-4b73-bd41-2e8f0447a481 req-aaba4c9a-8007-4dcc-871f-56d9340211d1 service nova] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] No waiting events found dispatching network-vif-plugged-da49a9b4-9434-45c8-93cd-e7bfb0654d87 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:53:44 user nova-compute[74342]: WARNING nova.compute.manager [req-dc01e370-7892-4b73-bd41-2e8f0447a481 req-aaba4c9a-8007-4dcc-871f-56d9340211d1 service nova] [instance: a9acd5f6-12e3-488b-b6c6-e4b81f5fc897] Received unexpected event network-vif-plugged-da49a9b4-9434-45c8-93cd-e7bfb0654d87 for instance with vm_state deleted and task_state None.
Oct 16 09:53:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:49 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:53:49 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:53:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:53:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:53:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:49 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 09:53:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea57d655-a24f-4a1c-bb1c-45e1dfc848c1/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea57d655-a24f-4a1c-bb1c-45e1dfc848c1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea57d655-a24f-4a1c-bb1c-45e1dfc848c1/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea57d655-a24f-4a1c-bb1c-45e1dfc848c1/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:50 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:53:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a7676e-87d8-4e8a-832a-67a5470f16a1/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a7676e-87d8-4e8a-832a-67a5470f16a1/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a7676e-87d8-4e8a-832a-67a5470f16a1/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a9a7676e-87d8-4e8a-832a-67a5470f16a1/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:52 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:53:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:53:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:53 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:53:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2522364c-36c7-446d-87e7-113632ceeab6/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2522364c-36c7-446d-87e7-113632ceeab6/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2522364c-36c7-446d-87e7-113632ceeab6/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:53:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2522364c-36c7-446d-87e7-113632ceeab6/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:53:53 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:53:53 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:53:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=7552MB free_disk=25.049659729003906GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 09:53:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:53:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:53:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Applying migration context for instance c5e44d3b-ed41-4920-825f-e1d283caecfd as it has an incoming, in-progress migration 8d9d989b-4b6c-4305-8176-e71adfb7315d. Migration status is error {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 16 09:53:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Skipping migration as instance is neither resizing nor live-migrating. {{(pid=74342) _update_usage_from_migrations /opt/stack/nova/nova/compute/resource_tracker.py:1563}}
Oct 16 09:53:54 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance d45abd20-3a58-4657-8f4c-a426d8e39be3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:53:54 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 98367a96-22f0-4edb-ab03-a8eb286b437b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:53:54 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 017caffb-5be2-4e78-ab48-a8091c5c00f4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:53:54 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance edcefbe0-e89f-4496-9032-f9431d9d5c53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:53:54 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:53:54 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance f3c66abd-af75-4b48-9e29-ab4335f229f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:53:54 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 2522364c-36c7-446d-87e7-113632ceeab6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:53:54 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance a9a7676e-87d8-4e8a-832a-67a5470f16a1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:53:54 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 4f3aa905-8eae-45cb-8019-0b991286fe42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:53:54 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance ea57d655-a24f-4a1c-bb1c-45e1dfc848c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:53:54 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance c5e44d3b-ed41-4920-825f-e1d283caecfd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:53:54 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 09:53:54 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 09:53:54 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:53:54 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:53:54 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 09:53:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.515s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:53:57 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:53:57 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:53:57 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 09:53:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-c5e44d3b-ed41-4920-825f-e1d283caecfd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:53:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-c5e44d3b-ed41-4920-825f-e1d283caecfd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:53:57 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 09:53:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:53:57 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Updating instance_info_cache with network_info: [{"id": "6c307712-877a-44b9-9a89-ffad24cadbc4", "address": "fa:16:3e:21:83:11", "network": {"id": "7bf142ea-2d65-4e3e-95f4-691e535078c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409249207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81481518f90a4d99abd102ab65d54caa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c307712-87", "ovs_interfaceid": "6c307712-877a-44b9-9a89-ffad24cadbc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:53:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-c5e44d3b-ed41-4920-825f-e1d283caecfd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:53:57 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 09:53:57 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:53:57 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:53:57 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:53:57 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:53:57 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:53:57 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 09:54:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:54:02 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:54:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:08 user nova-compute[74342]: INFO nova.compute.manager [None req-54bd7709-c28f-4241-b9bb-2d8f886830c3 tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Get console output
Oct 16 09:54:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Acquiring lock "017caffb-5be2-4e78-ab48-a8091c5c00f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Lock "017caffb-5be2-4e78-ab48-a8091c5c00f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Acquiring lock "017caffb-5be2-4e78-ab48-a8091c5c00f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Lock "017caffb-5be2-4e78-ab48-a8091c5c00f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Lock "017caffb-5be2-4e78-ab48-a8091c5c00f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG nova.compute.manager [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Events pending at deletion: volume-reimaged-fe2aa7c1-4340-4adb-915f-3be7ae4a985d {{(pid=74342) _delete_instance /opt/stack/nova/nova/compute/manager.py:3257}}
Oct 16 09:54:08 user nova-compute[74342]: INFO nova.compute.manager [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Terminating instance
Oct 16 09:54:08 user nova-compute[74342]: DEBUG nova.compute.manager [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [-] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] During wait destroy, instance disappeared. {{(pid=74342) _wait_for_destroy /opt/stack/nova/nova/virt/libvirt/driver.py:1527}}
Oct 16 09:54:08 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Instance destroyed successfully.
Oct 16 09:54:08 user nova-compute[74342]: DEBUG nova.objects.instance [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Lazy-loading 'resources' on Instance uuid 017caffb-5be2-4e78-ab48-a8091c5c00f4 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T09:45:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-615225718',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-6026343',id=9,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPciwGhgOXmWKxPktygR+HbYTK8AUs1Crujmt54eoK4xAiI8i1PAFebnNjbXBPGkoIS2iiZYgHukiKRdajQWHqMDi5/QPWZiz5/7sETFrH4JlOPioPfUP9OLnmHgasCJMg==',key_name='tempest-keypair-1307970994',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:45:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=0,progress=0,project_id='cbba73e7218148b492aca0b1c2673b85',ramdisk_id='',reservation_id='r-pg3x8ny5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1575697015',owner_user_name='tempest-ServerActionsV293TestJSON-1575697015-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:49:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='596268e3d8b7413ba90094ae370971f9',uuid=017caffb-5be2-4e78-ab48-a8091c5c00f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6", "address": "fa:16:3e:56:bd:70", "network": {"id": "9c306d1c-3407-47dd-a04f-e185b1d1788a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1404292047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbba73e7218148b492aca0b1c2673b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad97513-e2", "ovs_interfaceid": "0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Converting VIF {"id": "0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6", "address": "fa:16:3e:56:bd:70", "network": {"id": "9c306d1c-3407-47dd-a04f-e185b1d1788a", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1404292047-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.122", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cbba73e7218148b492aca0b1c2673b85", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0ad97513-e2", "ovs_interfaceid": "0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:bd:70,bridge_name='br-int',has_traffic_filtering=True,id=0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6,network=Network(9c306d1c-3407-47dd-a04f-e185b1d1788a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad97513-e2') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG os_vif [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:bd:70,bridge_name='br-int',has_traffic_filtering=True,id=0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6,network=Network(9c306d1c-3407-47dd-a04f-e185b1d1788a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad97513-e2') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0ad97513-e2, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:54:08 user nova-compute[74342]: INFO os_vif [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:bd:70,bridge_name='br-int',has_traffic_filtering=True,id=0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6,network=Network(9c306d1c-3407-47dd-a04f-e185b1d1788a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0ad97513-e2')
Oct 16 09:54:08 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QSPrXWFi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:54:08 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:54:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[df9ecffa-06ed-42f0-bb99-6a731d228002]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 09:54:08 user nova-compute[74342]: No targets found.
Oct 16 09:54:08 user nova-compute[74342]: iSNS:
Oct 16 09:54:08 user nova-compute[74342]: No targets found.
Oct 16 09:54:08 user nova-compute[74342]: STATIC:
Oct 16 09:54:08 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea
Oct 16 09:54:08 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:54:08 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:54:08 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84
Oct 16 09:54:08 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:54:08 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:54:08 user nova-compute[74342]: FIRMWARE:
Oct 16 09:54:08 user nova-compute[74342]: No targets found.
Oct 16 09:54:08 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 09:54:08 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 09:54:08 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fe2aa7c1-4340-4adb-915f-3be7ae4a985d', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbea792b-b0b4-4d4f-9520-48dfa20b981f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded44f8d-6152-4e3c-81bc-d66120573585]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:54:08 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:54:08 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:54:08 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:54:08 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b601c72e0>, {}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Disconnecting from: [] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.074s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] <== disconnect_volume: return (76ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 09:54:08 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Deletion of /opt/stack/data/nova/instances/017caffb-5be2-4e78-ab48-a8091c5c00f4_del complete
Oct 16 09:54:08 user nova-compute[74342]: INFO nova.compute.manager [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Took 0.17 seconds to destroy the instance on the hypervisor.
Oct 16 09:54:08 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 09:54:08 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 09:54:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:09 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:54:09 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Took 1.34 seconds to deallocate network for instance.
Oct 16 09:54:09 user nova-compute[74342]: DEBUG nova.compute.manager [req-1900b8e1-b55b-4bbd-a61c-5e0d5803fddb req-e0b2ba97-bc2d-44f2-b130-5c42052d216e service nova] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Received event network-vif-deleted-0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:54:09 user nova-compute[74342]: INFO nova.compute.manager [req-1900b8e1-b55b-4bbd-a61c-5e0d5803fddb req-e0b2ba97-bc2d-44f2-b130-5c42052d216e service nova] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Neutron deleted interface 0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6; detaching it from the instance and deleting it from the info cache
Oct 16 09:54:09 user nova-compute[74342]: DEBUG nova.network.neutron [req-1900b8e1-b55b-4bbd-a61c-5e0d5803fddb req-e0b2ba97-bc2d-44f2-b130-5c42052d216e service nova] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:54:09 user nova-compute[74342]: DEBUG nova.compute.manager [req-1900b8e1-b55b-4bbd-a61c-5e0d5803fddb req-e0b2ba97-bc2d-44f2-b130-5c42052d216e service nova] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Detach interface failed, port_id=0ad97513-e2ed-4c47-b353-9c2e7d3ff4a6, reason: Instance 017caffb-5be2-4e78-ab48-a8091c5c00f4 could not be found. {{(pid=74342) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 09:54:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:54:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:54:09 user nova-compute[74342]: INFO nova.compute.manager [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Detaching volume 98a7eb7a-b514-4dde-858c-4f0676d16f84
Oct 16 09:54:09 user nova-compute[74342]: INFO nova.compute.manager [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Took 0.10 seconds to detach 1 volumes for instance.
Oct 16 09:54:09 user nova-compute[74342]: DEBUG nova.compute.manager [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] [instance: 017caffb-5be2-4e78-ab48-a8091c5c00f4] Deleting volume: fe2aa7c1-4340-4adb-915f-3be7ae4a985d {{(pid=74342) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 16 09:54:09 user nova-compute[74342]: INFO nova.virt.block_device [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Attempting to driver detach volume 98a7eb7a-b514-4dde-858c-4f0676d16f84 from mountpoint /dev/vdb
Oct 16 09:54:09 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Attempting to detach device vdb from instance 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4 from the persistent domain config. {{(pid=74342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 09:54:09 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 09:54:09 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:54:09 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 09:54:09 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:54:09 user nova-compute[74342]:   <serial>98a7eb7a-b514-4dde-858c-4f0676d16f84</serial>
Oct 16 09:54:09 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 09:54:09 user nova-compute[74342]: </disk>
Oct 16 09:54:09 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 09:54:09 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Successfully detached device vdb from instance 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4 from the persistent domain config.
Oct 16 09:54:09 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4 from the live domain config. {{(pid=74342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 09:54:09 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 09:54:09 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:54:09 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 09:54:09 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:54:09 user nova-compute[74342]:   <serial>98a7eb7a-b514-4dde-858c-4f0676d16f84</serial>
Oct 16 09:54:09 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 09:54:09 user nova-compute[74342]: </disk>
Oct 16 09:54:09 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 09:54:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:54:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:54:10 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:54:10 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:54:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.361s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:54:10 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Deleted allocations for instance 017caffb-5be2-4e78-ab48-a8091c5c00f4
Oct 16 09:54:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4 {{(pid=74342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 09:54:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5992341d-4058-4d17-b1c8-f00ef32ba44f tempest-ServerActionsV293TestJSON-1575697015 tempest-ServerActionsV293TestJSON-1575697015-project-member] Lock "017caffb-5be2-4e78-ab48-a8091c5c00f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.251s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:54:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-201422b8-6826-453c-8a7f-7acc78aa4d74 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Acquiring lock "a9a7676e-87d8-4e8a-832a-67a5470f16a1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:54:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-201422b8-6826-453c-8a7f-7acc78aa4d74 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lock "a9a7676e-87d8-4e8a-832a-67a5470f16a1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:54:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-201422b8-6826-453c-8a7f-7acc78aa4d74 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Acquiring lock "a9a7676e-87d8-4e8a-832a-67a5470f16a1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:54:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-201422b8-6826-453c-8a7f-7acc78aa4d74 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lock "a9a7676e-87d8-4e8a-832a-67a5470f16a1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:54:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-201422b8-6826-453c-8a7f-7acc78aa4d74 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lock "a9a7676e-87d8-4e8a-832a-67a5470f16a1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:54:18 user nova-compute[74342]: INFO nova.compute.manager [None req-201422b8-6826-453c-8a7f-7acc78aa4d74 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Terminating instance
Oct 16 09:54:18 user nova-compute[74342]: DEBUG nova.compute.manager [None req-201422b8-6826-453c-8a7f-7acc78aa4d74 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 09:54:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:18 user nova-compute[74342]: DEBUG nova.compute.manager [req-6c8c3cbf-1b6d-4df5-b0df-9c7b7a7e427b req-e9354f49-7aea-4595-8c0f-c9f0112653fd service nova] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Received event network-vif-unplugged-4cea4774-6a45-4adc-8019-ffda4c7253cb {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:54:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-6c8c3cbf-1b6d-4df5-b0df-9c7b7a7e427b req-e9354f49-7aea-4595-8c0f-c9f0112653fd service nova] Acquiring lock "a9a7676e-87d8-4e8a-832a-67a5470f16a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:54:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-6c8c3cbf-1b6d-4df5-b0df-9c7b7a7e427b req-e9354f49-7aea-4595-8c0f-c9f0112653fd service nova] Lock "a9a7676e-87d8-4e8a-832a-67a5470f16a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:54:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-6c8c3cbf-1b6d-4df5-b0df-9c7b7a7e427b req-e9354f49-7aea-4595-8c0f-c9f0112653fd service nova] Lock "a9a7676e-87d8-4e8a-832a-67a5470f16a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:54:18 user nova-compute[74342]: DEBUG nova.compute.manager [req-6c8c3cbf-1b6d-4df5-b0df-9c7b7a7e427b req-e9354f49-7aea-4595-8c0f-c9f0112653fd service nova] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] No waiting events found dispatching network-vif-unplugged-4cea4774-6a45-4adc-8019-ffda4c7253cb {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:54:18 user nova-compute[74342]: DEBUG nova.compute.manager [req-6c8c3cbf-1b6d-4df5-b0df-9c7b7a7e427b req-e9354f49-7aea-4595-8c0f-c9f0112653fd service nova] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Received event network-vif-unplugged-4cea4774-6a45-4adc-8019-ffda4c7253cb for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 09:54:19 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Instance destroyed successfully.
Oct 16 09:54:19 user nova-compute[74342]: DEBUG nova.objects.instance [None req-201422b8-6826-453c-8a7f-7acc78aa4d74 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lazy-loading 'resources' on Instance uuid a9a7676e-87d8-4e8a-832a-67a5470f16a1 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:54:19 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-201422b8-6826-453c-8a7f-7acc78aa4d74 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:50:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-78558754',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-78558754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-7855875',id=21,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIA+jEHNKD+6U8xW2OFDjJMQLHPhVunqe9i+g4Tu13BHF5vu58SjwzUzgNRHP++ShSGk7ueWxIgcSBB4T26ICAfNWMl5UQLdctDyI5rJfHUrbFXp4RuXz8Hko7uaz4a3mA==',key_name='tempest-keypair-519645125',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:51:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c305573fde27434282f0e3098415298d',ramdisk_id='',reservation_id='r-lw30a69m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-618744753',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:51:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='59c0aa59cd974bdaaa893eb31c87222f',uuid=a9a7676e-87d8-4e8a-832a-67a5470f16a1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4cea4774-6a45-4adc-8019-ffda4c7253cb", "address": "fa:16:3e:cc:84:df", "network": {"id": "0b3a3bbd-b156-44ad-bffa-4248d61babfe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-567602513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c305573fde27434282f0e3098415298d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cea4774-6a", "ovs_interfaceid": "4cea4774-6a45-4adc-8019-ffda4c7253cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:54:19 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-201422b8-6826-453c-8a7f-7acc78aa4d74 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Converting VIF {"id": "4cea4774-6a45-4adc-8019-ffda4c7253cb", "address": "fa:16:3e:cc:84:df", "network": {"id": "0b3a3bbd-b156-44ad-bffa-4248d61babfe", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-567602513-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c305573fde27434282f0e3098415298d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4cea4774-6a", "ovs_interfaceid": "4cea4774-6a45-4adc-8019-ffda4c7253cb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:54:19 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-201422b8-6826-453c-8a7f-7acc78aa4d74 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cc:84:df,bridge_name='br-int',has_traffic_filtering=True,id=4cea4774-6a45-4adc-8019-ffda4c7253cb,network=Network(0b3a3bbd-b156-44ad-bffa-4248d61babfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cea4774-6a') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:54:19 user nova-compute[74342]: DEBUG os_vif [None req-201422b8-6826-453c-8a7f-7acc78aa4d74 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:84:df,bridge_name='br-int',has_traffic_filtering=True,id=4cea4774-6a45-4adc-8019-ffda4c7253cb,network=Network(0b3a3bbd-b156-44ad-bffa-4248d61babfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cea4774-6a') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:54:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4cea4774-6a, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:54:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:54:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=047ca08c-0781-4878-9009-3d68f70ab5ab) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:54:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:54:19 user nova-compute[74342]: INFO os_vif [None req-201422b8-6826-453c-8a7f-7acc78aa4d74 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cc:84:df,bridge_name='br-int',has_traffic_filtering=True,id=4cea4774-6a45-4adc-8019-ffda4c7253cb,network=Network(0b3a3bbd-b156-44ad-bffa-4248d61babfe),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4cea4774-6a')
Oct 16 09:54:19 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-201422b8-6826-453c-8a7f-7acc78aa4d74 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Deleting instance files /opt/stack/data/nova/instances/a9a7676e-87d8-4e8a-832a-67a5470f16a1_del
Oct 16 09:54:19 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-201422b8-6826-453c-8a7f-7acc78aa4d74 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Deletion of /opt/stack/data/nova/instances/a9a7676e-87d8-4e8a-832a-67a5470f16a1_del complete
Oct 16 09:54:19 user nova-compute[74342]: INFO nova.compute.manager [None req-201422b8-6826-453c-8a7f-7acc78aa4d74 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 16 09:54:19 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-201422b8-6826-453c-8a7f-7acc78aa4d74 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 09:54:19 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 09:54:19 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 09:54:19 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:54:19 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Took 0.72 seconds to deallocate network for instance.
Oct 16 09:54:19 user nova-compute[74342]: DEBUG nova.compute.manager [req-52eaf585-a707-45e4-9a43-83b4edbeab41 req-b49de9c2-19e3-4d4e-ae27-3846a9c6a98e service nova] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Received event network-vif-deleted-4cea4774-6a45-4adc-8019-ffda4c7253cb {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:54:19 user nova-compute[74342]: INFO nova.compute.manager [req-52eaf585-a707-45e4-9a43-83b4edbeab41 req-b49de9c2-19e3-4d4e-ae27-3846a9c6a98e service nova] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Neutron deleted interface 4cea4774-6a45-4adc-8019-ffda4c7253cb; detaching it from the instance and deleting it from the info cache
Oct 16 09:54:19 user nova-compute[74342]: DEBUG nova.network.neutron [req-52eaf585-a707-45e4-9a43-83b4edbeab41 req-b49de9c2-19e3-4d4e-ae27-3846a9c6a98e service nova] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:54:20 user nova-compute[74342]: DEBUG nova.compute.manager [req-52eaf585-a707-45e4-9a43-83b4edbeab41 req-b49de9c2-19e3-4d4e-ae27-3846a9c6a98e service nova] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Detach interface failed, port_id=4cea4774-6a45-4adc-8019-ffda4c7253cb, reason: Instance a9a7676e-87d8-4e8a-832a-67a5470f16a1 could not be found. {{(pid=74342) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 09:54:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-201422b8-6826-453c-8a7f-7acc78aa4d74 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:54:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-201422b8-6826-453c-8a7f-7acc78aa4d74 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:54:20 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-201422b8-6826-453c-8a7f-7acc78aa4d74 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:54:20 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-201422b8-6826-453c-8a7f-7acc78aa4d74 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:54:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-201422b8-6826-453c-8a7f-7acc78aa4d74 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:54:20 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-201422b8-6826-453c-8a7f-7acc78aa4d74 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Deleted allocations for instance a9a7676e-87d8-4e8a-832a-67a5470f16a1
Oct 16 09:54:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-201422b8-6826-453c-8a7f-7acc78aa4d74 tempest-TestServerVolumeAttachScenarioOldVersion-618744753 tempest-TestServerVolumeAttachScenarioOldVersion-618744753-project-member] Lock "a9a7676e-87d8-4e8a-832a-67a5470f16a1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.178s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:54:20 user nova-compute[74342]: DEBUG nova.compute.manager [req-c422b78d-5578-48ef-96ec-777787da70fe req-0cb55cbe-3ddf-483d-9a2b-d170a9eea3e9 service nova] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Received event network-vif-plugged-4cea4774-6a45-4adc-8019-ffda4c7253cb {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:54:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c422b78d-5578-48ef-96ec-777787da70fe req-0cb55cbe-3ddf-483d-9a2b-d170a9eea3e9 service nova] Acquiring lock "a9a7676e-87d8-4e8a-832a-67a5470f16a1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:54:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c422b78d-5578-48ef-96ec-777787da70fe req-0cb55cbe-3ddf-483d-9a2b-d170a9eea3e9 service nova] Lock "a9a7676e-87d8-4e8a-832a-67a5470f16a1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:54:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c422b78d-5578-48ef-96ec-777787da70fe req-0cb55cbe-3ddf-483d-9a2b-d170a9eea3e9 service nova] Lock "a9a7676e-87d8-4e8a-832a-67a5470f16a1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:54:20 user nova-compute[74342]: DEBUG nova.compute.manager [req-c422b78d-5578-48ef-96ec-777787da70fe req-0cb55cbe-3ddf-483d-9a2b-d170a9eea3e9 service nova] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] No waiting events found dispatching network-vif-plugged-4cea4774-6a45-4adc-8019-ffda4c7253cb {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:54:20 user nova-compute[74342]: WARNING nova.compute.manager [req-c422b78d-5578-48ef-96ec-777787da70fe req-0cb55cbe-3ddf-483d-9a2b-d170a9eea3e9 service nova] [instance: a9a7676e-87d8-4e8a-832a-67a5470f16a1] Received unexpected event network-vif-plugged-4cea4774-6a45-4adc-8019-ffda4c7253cb for instance with vm_state deleted and task_state None.
Oct 16 09:54:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:25 user nova-compute[74342]: DEBUG nova.compute.manager [req-d4287e5a-f24d-4924-aa55-de1116174a4d req-4784c216-6b5e-46bc-b058-2c6a19bdcb79 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Received event network-changed-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:54:25 user nova-compute[74342]: DEBUG nova.compute.manager [req-d4287e5a-f24d-4924-aa55-de1116174a4d req-4784c216-6b5e-46bc-b058-2c6a19bdcb79 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Refreshing instance network info cache due to event network-changed-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:54:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d4287e5a-f24d-4924-aa55-de1116174a4d req-4784c216-6b5e-46bc-b058-2c6a19bdcb79 service nova] Acquiring lock "refresh_cache-4f3aa905-8eae-45cb-8019-0b991286fe42" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:54:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d4287e5a-f24d-4924-aa55-de1116174a4d req-4784c216-6b5e-46bc-b058-2c6a19bdcb79 service nova] Acquired lock "refresh_cache-4f3aa905-8eae-45cb-8019-0b991286fe42" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:54:25 user nova-compute[74342]: DEBUG nova.network.neutron [req-d4287e5a-f24d-4924-aa55-de1116174a4d req-4784c216-6b5e-46bc-b058-2c6a19bdcb79 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Refreshing network info cache for port 0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:54:25 user nova-compute[74342]: DEBUG nova.network.neutron [req-d4287e5a-f24d-4924-aa55-de1116174a4d req-4784c216-6b5e-46bc-b058-2c6a19bdcb79 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Updated VIF entry in instance network info cache for port 0e4258aa-9686-4cf1-9d1a-5bf61e7ba193. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:54:25 user nova-compute[74342]: DEBUG nova.network.neutron [req-d4287e5a-f24d-4924-aa55-de1116174a4d req-4784c216-6b5e-46bc-b058-2c6a19bdcb79 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Updating instance_info_cache with network_info: [{"id": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "address": "fa:16:3e:82:00:ac", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4258aa-96", "ovs_interfaceid": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:54:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d4287e5a-f24d-4924-aa55-de1116174a4d req-4784c216-6b5e-46bc-b058-2c6a19bdcb79 service nova] Releasing lock "refresh_cache-4f3aa905-8eae-45cb-8019-0b991286fe42" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:54:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:28 user nova-compute[74342]: INFO nova.compute.manager [None req-2b0caa22-6199-4c96-a26a-ea63cd4e9b68 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Unrescuing
Oct 16 09:54:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2b0caa22-6199-4c96-a26a-ea63cd4e9b68 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "refresh_cache-2522364c-36c7-446d-87e7-113632ceeab6" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:54:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2b0caa22-6199-4c96-a26a-ea63cd4e9b68 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquired lock "refresh_cache-2522364c-36c7-446d-87e7-113632ceeab6" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:54:28 user nova-compute[74342]: DEBUG nova.network.neutron [None req-2b0caa22-6199-4c96-a26a-ea63cd4e9b68 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:54:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:29 user nova-compute[74342]: DEBUG nova.network.neutron [None req-2b0caa22-6199-4c96-a26a-ea63cd4e9b68 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Updating instance_info_cache with network_info: [{"id": "975f1cad-dbc7-462f-9702-55567afd639b", "address": "fa:16:3e:18:9d:9a", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap975f1cad-db", "ovs_interfaceid": "975f1cad-dbc7-462f-9702-55567afd639b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:54:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2b0caa22-6199-4c96-a26a-ea63cd4e9b68 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Releasing lock "refresh_cache-2522364c-36c7-446d-87e7-113632ceeab6" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:54:29 user nova-compute[74342]: DEBUG nova.objects.instance [None req-2b0caa22-6199-4c96-a26a-ea63cd4e9b68 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lazy-loading 'flavor' on Instance uuid 2522364c-36c7-446d-87e7-113632ceeab6 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:54:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:29 user nova-compute[74342]: DEBUG nova.compute.manager [req-70467a7d-7353-48fc-bf69-0a8ee424a10f req-ed5bf6f4-bdf6-4589-b9e2-441ef3b9f51d service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Received event network-vif-unplugged-975f1cad-dbc7-462f-9702-55567afd639b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:54:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-70467a7d-7353-48fc-bf69-0a8ee424a10f req-ed5bf6f4-bdf6-4589-b9e2-441ef3b9f51d service nova] Acquiring lock "2522364c-36c7-446d-87e7-113632ceeab6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:54:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-70467a7d-7353-48fc-bf69-0a8ee424a10f req-ed5bf6f4-bdf6-4589-b9e2-441ef3b9f51d service nova] Lock "2522364c-36c7-446d-87e7-113632ceeab6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:54:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-70467a7d-7353-48fc-bf69-0a8ee424a10f req-ed5bf6f4-bdf6-4589-b9e2-441ef3b9f51d service nova] Lock "2522364c-36c7-446d-87e7-113632ceeab6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:54:29 user nova-compute[74342]: DEBUG nova.compute.manager [req-70467a7d-7353-48fc-bf69-0a8ee424a10f req-ed5bf6f4-bdf6-4589-b9e2-441ef3b9f51d service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] No waiting events found dispatching network-vif-unplugged-975f1cad-dbc7-462f-9702-55567afd639b {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:54:29 user nova-compute[74342]: WARNING nova.compute.manager [req-70467a7d-7353-48fc-bf69-0a8ee424a10f req-ed5bf6f4-bdf6-4589-b9e2-441ef3b9f51d service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Received unexpected event network-vif-unplugged-975f1cad-dbc7-462f-9702-55567afd639b for instance with vm_state rescued and task_state unrescuing.
Oct 16 09:54:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:30 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Instance destroyed successfully.
Oct 16 09:54:30 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4 is timed out.
Oct 16 09:54:30 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Successfully detached device vdb from instance 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4 from the live domain config.
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "4f3aa905-8eae-45cb-8019-0b991286fe42" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HgLqdcys', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:54:30 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:54:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG nova.objects.instance [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'flavor' on Instance uuid 4f3aa905-8eae-45cb-8019-0b991286fe42 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[35bfc07e-7c13-4dbc-9f09-b63bd815237c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 09:54:30 user nova-compute[74342]: No targets found.
Oct 16 09:54:30 user nova-compute[74342]: iSNS:
Oct 16 09:54:30 user nova-compute[74342]: No targets found.
Oct 16 09:54:30 user nova-compute[74342]: STATIC:
Oct 16 09:54:30 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea
Oct 16 09:54:30 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:54:30 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:54:30 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84
Oct 16 09:54:30 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:54:30 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:54:30 user nova-compute[74342]: FIRMWARE:
Oct 16 09:54:30 user nova-compute[74342]: No targets found.
Oct 16 09:54:30 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 09:54:30 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 09:54:30 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f429769-890a-4553-998f-79d81e7ae65e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.095s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e8d432-e3cd-46ae-82b0-8521b9571ecf]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:54:30 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:54:30 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 (non-flash)
Oct 16 09:54:30 user nova-compute[74342]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:54:30 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b6039a8c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84'): ({'sdb'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Removing single pathed devices sdb {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[186fd5e9-1e2d-451e-ac4b-0aa0fdb7b987]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[89223258-8b5f-4248-8723-467a8d674c1a]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Flushing IO for device /dev/sdb {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[797f233c-9c2e-4230-b3b2-33c5413b90f8]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8b35db-0918-460f-9044-bd78f0e3d4d9]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e60c64a-6aa6-466c-a899-d81277d51fc2]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[746f3381-5bd7-4bf1-8e74-7b9ab422345b]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84, portal: 172.16.0.220,3260]
Oct 16 09:54:30 user nova-compute[74342]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84, portal: 172.16.0.220,3260] successful.
Oct 16 09:54:30 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "4f3aa905-8eae-45cb-8019-0b991286fe42" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:54:30 user nova-compute[74342]: INFO nova.compute.manager [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Attaching volume 6e3a5814-40f6-46ab-aca8-2f0a72768a43 to /dev/vdb
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:98a7eb7a-b514-4dde-858c-4f0676d16f84 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1e4bac-9b85-493a-962b-4e51d32ab3e2]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] <== disconnect_volume: return (339ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG os_brick.utils [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbc1bb7-6b65-43a9-b96a-0b042f41a9fb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd4d2813-3f46-49e8-bdfc-eb87237aae9a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:31 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c71100c-8607-43b1-b019-287d0447cb1a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:31 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a68a64a-af4a-42bd-9a2f-5ae00bed8272]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:54:31 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:54:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:54:31 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:54:31 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1211e65-dd67-4418-af35-6383fbdde1c9]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:31 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:54:31 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:54:31 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:54:31 user nova-compute[74342]: DEBUG os_brick.utils [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:54:31 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Updating existing volume attachment record: 48d364ee-1bba-46f4-8f20-6f366f21ed41 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 09:54:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:31 user nova-compute[74342]: DEBUG nova.compute.manager [req-6b36e4f6-80eb-49a5-b32d-057edfc0ad73 req-53767d16-d8d1-45a8-977c-2e4df58211be service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Received event network-vif-plugged-975f1cad-dbc7-462f-9702-55567afd639b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:54:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-6b36e4f6-80eb-49a5-b32d-057edfc0ad73 req-53767d16-d8d1-45a8-977c-2e4df58211be service nova] Acquiring lock "2522364c-36c7-446d-87e7-113632ceeab6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:54:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-6b36e4f6-80eb-49a5-b32d-057edfc0ad73 req-53767d16-d8d1-45a8-977c-2e4df58211be service nova] Lock "2522364c-36c7-446d-87e7-113632ceeab6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:54:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-6b36e4f6-80eb-49a5-b32d-057edfc0ad73 req-53767d16-d8d1-45a8-977c-2e4df58211be service nova] Lock "2522364c-36c7-446d-87e7-113632ceeab6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:54:31 user nova-compute[74342]: DEBUG nova.compute.manager [req-6b36e4f6-80eb-49a5-b32d-057edfc0ad73 req-53767d16-d8d1-45a8-977c-2e4df58211be service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] No waiting events found dispatching network-vif-plugged-975f1cad-dbc7-462f-9702-55567afd639b {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:54:31 user nova-compute[74342]: WARNING nova.compute.manager [req-6b36e4f6-80eb-49a5-b32d-057edfc0ad73 req-53767d16-d8d1-45a8-977c-2e4df58211be service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Received unexpected event network-vif-plugged-975f1cad-dbc7-462f-9702-55567afd639b for instance with vm_state rescued and task_state unrescuing.
Oct 16 09:54:31 user nova-compute[74342]: DEBUG nova.objects.instance [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lazy-loading 'flavor' on Instance uuid 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:54:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cb1ef7c5-e038-4750-90e3-68b2467ae025 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.049s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:54:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:33 user nova-compute[74342]: DEBUG nova.compute.manager [req-4d54b39a-6ba8-4aee-b69a-d184ab7f7fcc req-869207c4-ebc1-437b-a922-8b960fc116db service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Received event network-vif-plugged-975f1cad-dbc7-462f-9702-55567afd639b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:54:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4d54b39a-6ba8-4aee-b69a-d184ab7f7fcc req-869207c4-ebc1-437b-a922-8b960fc116db service nova] Acquiring lock "2522364c-36c7-446d-87e7-113632ceeab6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:54:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4d54b39a-6ba8-4aee-b69a-d184ab7f7fcc req-869207c4-ebc1-437b-a922-8b960fc116db service nova] Lock "2522364c-36c7-446d-87e7-113632ceeab6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:54:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4d54b39a-6ba8-4aee-b69a-d184ab7f7fcc req-869207c4-ebc1-437b-a922-8b960fc116db service nova] Lock "2522364c-36c7-446d-87e7-113632ceeab6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:54:33 user nova-compute[74342]: DEBUG nova.compute.manager [req-4d54b39a-6ba8-4aee-b69a-d184ab7f7fcc req-869207c4-ebc1-437b-a922-8b960fc116db service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] No waiting events found dispatching network-vif-plugged-975f1cad-dbc7-462f-9702-55567afd639b {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:54:33 user nova-compute[74342]: WARNING nova.compute.manager [req-4d54b39a-6ba8-4aee-b69a-d184ab7f7fcc req-869207c4-ebc1-437b-a922-8b960fc116db service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Received unexpected event network-vif-plugged-975f1cad-dbc7-462f-9702-55567afd639b for instance with vm_state rescued and task_state unrescuing.
Oct 16 09:54:33 user nova-compute[74342]: DEBUG nova.compute.manager [req-4d54b39a-6ba8-4aee-b69a-d184ab7f7fcc req-869207c4-ebc1-437b-a922-8b960fc116db service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Received event network-vif-plugged-975f1cad-dbc7-462f-9702-55567afd639b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:54:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4d54b39a-6ba8-4aee-b69a-d184ab7f7fcc req-869207c4-ebc1-437b-a922-8b960fc116db service nova] Acquiring lock "2522364c-36c7-446d-87e7-113632ceeab6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:54:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4d54b39a-6ba8-4aee-b69a-d184ab7f7fcc req-869207c4-ebc1-437b-a922-8b960fc116db service nova] Lock "2522364c-36c7-446d-87e7-113632ceeab6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:54:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4d54b39a-6ba8-4aee-b69a-d184ab7f7fcc req-869207c4-ebc1-437b-a922-8b960fc116db service nova] Lock "2522364c-36c7-446d-87e7-113632ceeab6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:54:33 user nova-compute[74342]: DEBUG nova.compute.manager [req-4d54b39a-6ba8-4aee-b69a-d184ab7f7fcc req-869207c4-ebc1-437b-a922-8b960fc116db service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] No waiting events found dispatching network-vif-plugged-975f1cad-dbc7-462f-9702-55567afd639b {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:54:33 user nova-compute[74342]: WARNING nova.compute.manager [req-4d54b39a-6ba8-4aee-b69a-d184ab7f7fcc req-869207c4-ebc1-437b-a922-8b960fc116db service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Received unexpected event network-vif-plugged-975f1cad-dbc7-462f-9702-55567afd639b for instance with vm_state rescued and task_state unrescuing.
Oct 16 09:54:33 user nova-compute[74342]: DEBUG nova.compute.manager [None req-2b0caa22-6199-4c96-a26a-ea63cd4e9b68 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:54:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Acquiring lock "c5e44d3b-ed41-4920-825f-e1d283caecfd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "c5e44d3b-ed41-4920-825f-e1d283caecfd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Acquiring lock "c5e44d3b-ed41-4920-825f-e1d283caecfd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "c5e44d3b-ed41-4920-825f-e1d283caecfd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "c5e44d3b-ed41-4920-825f-e1d283caecfd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:54:41 user nova-compute[74342]: INFO nova.compute.manager [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Terminating instance
Oct 16 09:54:41 user nova-compute[74342]: DEBUG nova.compute.manager [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 09:54:41 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Instance destroyed successfully.
Oct 16 09:54:41 user nova-compute[74342]: DEBUG nova.objects.instance [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lazy-loading 'resources' on Instance uuid c5e44d3b-ed41-4920-825f-e1d283caecfd {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:48:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-13118212',display_name='tempest-ServerActionsTestOtherB-server-13118212',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-13118212',id=15,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGFyI0lKp1ntOYPGityGnnSBavRl0hSeYQxboJuGTBYyIPdaJHX27900OLhX0GU91RcLxOgMFJOVCotJNi9ZnC1rWux5jCR//n+7EdDi2c7USVCSopq2ZuImlyPrRPszQA==',key_name='tempest-keypair-1671594657',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:48:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='81481518f90a4d99abd102ab65d54caa',ramdisk_id='',reservation_id='r-p5fny93p',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1418473661',owner_user_name='tempest-ServerActionsTestOtherB-1418473661-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:53:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='afbe4a406e6a43309a197e2a209c7554',uuid=c5e44d3b-ed41-4920-825f-e1d283caecfd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='error') vif={"id": "6c307712-877a-44b9-9a89-ffad24cadbc4", "address": "fa:16:3e:21:83:11", "network": {"id": "7bf142ea-2d65-4e3e-95f4-691e535078c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409249207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81481518f90a4d99abd102ab65d54caa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c307712-87", "ovs_interfaceid": "6c307712-877a-44b9-9a89-ffad24cadbc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Converting VIF {"id": "6c307712-877a-44b9-9a89-ffad24cadbc4", "address": "fa:16:3e:21:83:11", "network": {"id": "7bf142ea-2d65-4e3e-95f4-691e535078c0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-409249207-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.179", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "81481518f90a4d99abd102ab65d54caa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6c307712-87", "ovs_interfaceid": "6c307712-877a-44b9-9a89-ffad24cadbc4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:21:83:11,bridge_name='br-int',has_traffic_filtering=True,id=6c307712-877a-44b9-9a89-ffad24cadbc4,network=Network(7bf142ea-2d65-4e3e-95f4-691e535078c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c307712-87') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG os_vif [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:83:11,bridge_name='br-int',has_traffic_filtering=True,id=6c307712-877a-44b9-9a89-ffad24cadbc4,network=Network(7bf142ea-2d65-4e3e-95f4-691e535078c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c307712-87') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6c307712-87, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:54:41 user nova-compute[74342]: INFO os_vif [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:21:83:11,bridge_name='br-int',has_traffic_filtering=True,id=6c307712-877a-44b9-9a89-ffad24cadbc4,network=Network(7bf142ea-2d65-4e3e-95f4-691e535078c0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6c307712-87')
Oct 16 09:54:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bXSmTrFc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:54:41 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:54:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[929d1576-53d1-4cde-a34d-3909143633f6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 09:54:41 user nova-compute[74342]: No targets found.
Oct 16 09:54:41 user nova-compute[74342]: iSNS:
Oct 16 09:54:41 user nova-compute[74342]: No targets found.
Oct 16 09:54:41 user nova-compute[74342]: STATIC:
Oct 16 09:54:41 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea
Oct 16 09:54:41 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:54:41 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:54:41 user nova-compute[74342]: FIRMWARE:
Oct 16 09:54:41 user nova-compute[74342]: No targets found.
Oct 16 09:54:41 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 09:54:41 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 09:54:41 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:281894b3-f5a9-4b38-842f-ab4e3d550a02', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[244d27ad-19fa-4d2e-8a44-829079538101]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d55a04-dd18-4b37-b409-c22038992bec]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:54:41 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:54:41 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b601972e0>, {}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Disconnecting from: [] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.079s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] <== disconnect_volume: return (80ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 09:54:41 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Deletion of /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd_resize failed
Oct 16 09:54:41 user nova-compute[74342]: INFO nova.compute.manager [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Took 0.24 seconds to destroy the instance on the hypervisor.
Oct 16 09:54:41 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 09:54:41 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 09:54:42 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:54:42 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Took 1.06 seconds to deallocate network for instance.
Oct 16 09:54:42 user nova-compute[74342]: DEBUG nova.compute.manager [req-79fd69ba-0f59-4ec1-b9eb-c03e20a56b09 req-cfaece26-fabe-4769-a2f3-5266aec19446 service nova] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Received event network-vif-deleted-6c307712-877a-44b9-9a89-ffad24cadbc4 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:54:42 user nova-compute[74342]: INFO nova.compute.manager [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Took 0.07 seconds to detach 1 volumes for instance.
Oct 16 09:54:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:54:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:54:42 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:54:42 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:54:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.335s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:54:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:42 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Deleted allocations for instance c5e44d3b-ed41-4920-825f-e1d283caecfd
Oct 16 09:54:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6f3a7684-25cd-47a0-a8ba-af2e568a1ba5 tempest-ServerActionsTestOtherB-1418473661 tempest-ServerActionsTestOtherB-1418473661-project-member] Lock "c5e44d3b-ed41-4920-825f-e1d283caecfd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.973s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:54:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tMGZkgah', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:54:48 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:54:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:54:48 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:54:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:54:48 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3ee0c0-dfd3-4452-bf57-a41949309238]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 09:54:48 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc60e83f-51a8-41a7-af73-832bdd3aa42d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43] added
Oct 16 09:54:48 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc0fcf09-2ec5-441b-b6f8-36cf9105e205]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c09feb-1365-4e26-a8e5-3c0ef87d4533]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tMGZkgah {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tMGZkgah" returned: 0 in 0.055s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c50197f-99c4-4bff-bbf8-24fdf2d4a658]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tMGZkgah'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3a3c53a-ae7b-40f0-8c51-69574870530f]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb70cb8-b5ac-47c5-8d44-4ad52e41c1e0]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:54:48 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:54:48 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e0b5386-0bc3-400b-818a-795f20026756]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43, portal: 172.16.0.220,3260]
Oct 16 09:54:48 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43, portal: 172.16.0.220,3260] successful.
Oct 16 09:54:48 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acc9eb2-d9da-411c-b648-b4beacaa3eb6]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6087439a-22e7-457c-ac22-d7d83bcf67a2]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:54:48 user nova-compute[74342]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:54:48 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:54:48 user nova-compute[74342]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:54:48 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] HCTL ('33', '-', '-', 0) found on session 17 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c08df8e8-afcb-420c-b8f3-e22c99ae2435]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:54:48 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: None {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:54:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:49 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:54:49 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:54:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:54:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:54:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:54:49 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 09:54:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea57d655-a24f-4a1c-bb1c-45e1dfc848c1/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:49 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Searching for a device in session 17 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:54:49 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tMGZkgah', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 09:54:49 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:54:49 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26565653364333631', 'path': '/dev/sdb'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:54:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565653364333631', 'path': '/dev/sdb'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 09:54:49 user nova-compute[74342]: DEBUG nova.objects.instance [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'flavor' on Instance uuid 4f3aa905-8eae-45cb-8019-0b991286fe42 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:54:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 09:54:49 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:54:49 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 09:54:49 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:54:49 user nova-compute[74342]:   <serial>6e3a5814-40f6-46ab-aca8-2f0a72768a43</serial>
Oct 16 09:54:49 user nova-compute[74342]: </disk>
Oct 16 09:54:49 user nova-compute[74342]:  {{(pid=74342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 09:54:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea57d655-a24f-4a1c-bb1c-45e1dfc848c1/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea57d655-a24f-4a1c-bb1c-45e1dfc848c1/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ea57d655-a24f-4a1c-bb1c-45e1dfc848c1/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:50 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:54:50 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:54:50 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] No VIF found with MAC fa:16:3e:82:00:ac, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:54:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a67ddf34-8e05-4446-8bb5-178eb3eb5cdb tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.508s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:54:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5f590b82-aa40-4935-81e2-76554d9b0338 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "4f3aa905-8eae-45cb-8019-0b991286fe42" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:54:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5f590b82-aa40-4935-81e2-76554d9b0338 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:54:51 user nova-compute[74342]: DEBUG nova.compute.manager [None req-5f590b82-aa40-4935-81e2-76554d9b0338 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:54:51 user nova-compute[74342]: DEBUG nova.compute.manager [None req-5f590b82-aa40-4935-81e2-76554d9b0338 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74342) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 16 09:54:51 user nova-compute[74342]: DEBUG nova.objects.instance [None req-5f590b82-aa40-4935-81e2-76554d9b0338 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'flavor' on Instance uuid 4f3aa905-8eae-45cb-8019-0b991286fe42 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:54:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:52 user nova-compute[74342]: DEBUG nova.compute.manager [req-0f015c43-0f19-42b0-b1f1-504010ec2f18 req-c865b986-50e2-49b6-bf43-28284ebec3df service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Received event network-vif-unplugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:54:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0f015c43-0f19-42b0-b1f1-504010ec2f18 req-c865b986-50e2-49b6-bf43-28284ebec3df service nova] Acquiring lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:54:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0f015c43-0f19-42b0-b1f1-504010ec2f18 req-c865b986-50e2-49b6-bf43-28284ebec3df service nova] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:54:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0f015c43-0f19-42b0-b1f1-504010ec2f18 req-c865b986-50e2-49b6-bf43-28284ebec3df service nova] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:54:52 user nova-compute[74342]: DEBUG nova.compute.manager [req-0f015c43-0f19-42b0-b1f1-504010ec2f18 req-c865b986-50e2-49b6-bf43-28284ebec3df service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] No waiting events found dispatching network-vif-unplugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:54:52 user nova-compute[74342]: WARNING nova.compute.manager [req-0f015c43-0f19-42b0-b1f1-504010ec2f18 req-c865b986-50e2-49b6-bf43-28284ebec3df service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Received unexpected event network-vif-unplugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 for instance with vm_state active and task_state powering-off.
Oct 16 09:54:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:54:52 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Instance destroyed successfully.
Oct 16 09:54:52 user nova-compute[74342]: DEBUG nova.compute.manager [None req-5f590b82-aa40-4935-81e2-76554d9b0338 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:54:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:54:52 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:54:52 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:54:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5f590b82-aa40-4935-81e2-76554d9b0338 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.903s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:54:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:53 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:54:53 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:54:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=7811MB free_disk=25.067073822021484GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 09:54:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:54:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:54:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance d45abd20-3a58-4657-8f4c-a426d8e39be3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:54:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 98367a96-22f0-4edb-ab03-a8eb286b437b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:54:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance edcefbe0-e89f-4496-9032-f9431d9d5c53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:54:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:54:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance f3c66abd-af75-4b48-9e29-ab4335f229f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:54:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 2522364c-36c7-446d-87e7-113632ceeab6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:54:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 4f3aa905-8eae-45cb-8019-0b991286fe42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:54:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance ea57d655-a24f-4a1c-bb1c-45e1dfc848c1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:54:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 09:54:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 09:54:53 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:54:53 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:54:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 09:54:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.490s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:54:54 user nova-compute[74342]: DEBUG nova.compute.manager [req-7aa813c2-7a37-483c-a5c2-4146c949fa2a req-0b510125-7e39-49cd-9aa5-c1ad6297c383 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Received event network-vif-plugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:54:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-7aa813c2-7a37-483c-a5c2-4146c949fa2a req-0b510125-7e39-49cd-9aa5-c1ad6297c383 service nova] Acquiring lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:54:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-7aa813c2-7a37-483c-a5c2-4146c949fa2a req-0b510125-7e39-49cd-9aa5-c1ad6297c383 service nova] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:54:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-7aa813c2-7a37-483c-a5c2-4146c949fa2a req-0b510125-7e39-49cd-9aa5-c1ad6297c383 service nova] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:54:54 user nova-compute[74342]: DEBUG nova.compute.manager [req-7aa813c2-7a37-483c-a5c2-4146c949fa2a req-0b510125-7e39-49cd-9aa5-c1ad6297c383 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] No waiting events found dispatching network-vif-plugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:54:54 user nova-compute[74342]: WARNING nova.compute.manager [req-7aa813c2-7a37-483c-a5c2-4146c949fa2a req-0b510125-7e39-49cd-9aa5-c1ad6297c383 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Received unexpected event network-vif-plugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 for instance with vm_state stopped and task_state None.
Oct 16 09:54:54 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:55 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:55 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:54:55 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:54:55 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 09:54:55 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:54:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:54:55 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 09:54:56 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Updating instance_info_cache with network_info: [{"id": "7fdd8609-f23f-4572-aa9b-68cdb668df83", "address": "fa:16:3e:4f:14:0e", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fdd8609-f2", "ovs_interfaceid": "7fdd8609-f23f-4572-aa9b-68cdb668df83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:54:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:54:56 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 09:54:56 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:54:56 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:54:56 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:54:56 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Cleaning up deleted instances {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 09:54:56 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] There are 1 instances to clean {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 09:54:56 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Instance has had 1 of 5 cleanup attempts {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 16 09:54:56 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Deletion of /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd_resize failed
Oct 16 09:54:56 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:54:56 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:54:57 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:54:57 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:54:57 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74342) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 09:54:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a3640057-4b3f-47e5-b983-56d1162bff6c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Acquiring lock "ea57d655-a24f-4a1c-bb1c-45e1dfc848c1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:54:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a3640057-4b3f-47e5-b983-56d1162bff6c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "ea57d655-a24f-4a1c-bb1c-45e1dfc848c1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:54:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a3640057-4b3f-47e5-b983-56d1162bff6c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Acquiring lock "ea57d655-a24f-4a1c-bb1c-45e1dfc848c1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:54:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a3640057-4b3f-47e5-b983-56d1162bff6c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "ea57d655-a24f-4a1c-bb1c-45e1dfc848c1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:54:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a3640057-4b3f-47e5-b983-56d1162bff6c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "ea57d655-a24f-4a1c-bb1c-45e1dfc848c1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:54:59 user nova-compute[74342]: INFO nova.compute.manager [None req-a3640057-4b3f-47e5-b983-56d1162bff6c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Terminating instance
Oct 16 09:54:59 user nova-compute[74342]: DEBUG nova.compute.manager [None req-a3640057-4b3f-47e5-b983-56d1162bff6c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 09:54:59 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:54:59 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 09:54:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:54:59 user nova-compute[74342]: DEBUG nova.compute.manager [req-4c3a92dc-87f2-4280-bbbe-4adcc3d60a64 req-fb4dff86-2e78-41e2-b7ce-a0d36594c7ca service nova] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Received event network-vif-unplugged-d1d868a0-b6c1-456b-8a9c-fe78d9168ef4 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:54:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4c3a92dc-87f2-4280-bbbe-4adcc3d60a64 req-fb4dff86-2e78-41e2-b7ce-a0d36594c7ca service nova] Acquiring lock "ea57d655-a24f-4a1c-bb1c-45e1dfc848c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:54:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4c3a92dc-87f2-4280-bbbe-4adcc3d60a64 req-fb4dff86-2e78-41e2-b7ce-a0d36594c7ca service nova] Lock "ea57d655-a24f-4a1c-bb1c-45e1dfc848c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:54:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4c3a92dc-87f2-4280-bbbe-4adcc3d60a64 req-fb4dff86-2e78-41e2-b7ce-a0d36594c7ca service nova] Lock "ea57d655-a24f-4a1c-bb1c-45e1dfc848c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:54:59 user nova-compute[74342]: DEBUG nova.compute.manager [req-4c3a92dc-87f2-4280-bbbe-4adcc3d60a64 req-fb4dff86-2e78-41e2-b7ce-a0d36594c7ca service nova] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] No waiting events found dispatching network-vif-unplugged-d1d868a0-b6c1-456b-8a9c-fe78d9168ef4 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:54:59 user nova-compute[74342]: DEBUG nova.compute.manager [req-4c3a92dc-87f2-4280-bbbe-4adcc3d60a64 req-fb4dff86-2e78-41e2-b7ce-a0d36594c7ca service nova] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Received event network-vif-unplugged-d1d868a0-b6c1-456b-8a9c-fe78d9168ef4 for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 09:54:59 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Instance destroyed successfully.
Oct 16 09:54:59 user nova-compute[74342]: DEBUG nova.objects.instance [None req-a3640057-4b3f-47e5-b983-56d1162bff6c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lazy-loading 'resources' on Instance uuid ea57d655-a24f-4a1c-bb1c-45e1dfc848c1 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-a3640057-4b3f-47e5-b983-56d1162bff6c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:52:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-232934220',display_name='tempest-VolumesAdminNegativeTest-server-232934220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-232934220',id=25,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:53:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0afd0e8f0d424fe393636bbcd26eed42',ramdisk_id='',reservation_id='r-yel98z7n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1903882113',owner_user_name='tempest-VolumesAdminNegativeTest-1903882113-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:53:03Z,user_data=None,user_id='353ec67aa4b84aa7b6992ccb49423ca6',uuid=ea57d655-a24f-4a1c-bb1c-45e1dfc848c1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1d868a0-b6c1-456b-8a9c-fe78d9168ef4", "address": "fa:16:3e:8d:27:8f", "network": {"id": "7bc80f1e-0315-4a4e-bc89-2ad397451db6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1430189260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afd0e8f0d424fe393636bbcd26eed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d868a0-b6", "ovs_interfaceid": "d1d868a0-b6c1-456b-8a9c-fe78d9168ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-a3640057-4b3f-47e5-b983-56d1162bff6c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Converting VIF {"id": "d1d868a0-b6c1-456b-8a9c-fe78d9168ef4", "address": "fa:16:3e:8d:27:8f", "network": {"id": "7bc80f1e-0315-4a4e-bc89-2ad397451db6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1430189260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afd0e8f0d424fe393636bbcd26eed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d868a0-b6", "ovs_interfaceid": "d1d868a0-b6c1-456b-8a9c-fe78d9168ef4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-a3640057-4b3f-47e5-b983-56d1162bff6c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:27:8f,bridge_name='br-int',has_traffic_filtering=True,id=d1d868a0-b6c1-456b-8a9c-fe78d9168ef4,network=Network(7bc80f1e-0315-4a4e-bc89-2ad397451db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d868a0-b6') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG os_vif [None req-a3640057-4b3f-47e5-b983-56d1162bff6c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:27:8f,bridge_name='br-int',has_traffic_filtering=True,id=d1d868a0-b6c1-456b-8a9c-fe78d9168ef4,network=Network(7bc80f1e-0315-4a4e-bc89-2ad397451db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d868a0-b6') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1d868a0-b6, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0668a65b-7af4-4f6f-a69e-1cacdd397a4c) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:00 user nova-compute[74342]: INFO os_vif [None req-a3640057-4b3f-47e5-b983-56d1162bff6c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:27:8f,bridge_name='br-int',has_traffic_filtering=True,id=d1d868a0-b6c1-456b-8a9c-fe78d9168ef4,network=Network(7bc80f1e-0315-4a4e-bc89-2ad397451db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d868a0-b6')
Oct 16 09:55:00 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-a3640057-4b3f-47e5-b983-56d1162bff6c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Deleting instance files /opt/stack/data/nova/instances/ea57d655-a24f-4a1c-bb1c-45e1dfc848c1_del
Oct 16 09:55:00 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-a3640057-4b3f-47e5-b983-56d1162bff6c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Deletion of /opt/stack/data/nova/instances/ea57d655-a24f-4a1c-bb1c-45e1dfc848c1_del complete
Oct 16 09:55:00 user nova-compute[74342]: INFO nova.compute.manager [None req-a3640057-4b3f-47e5-b983-56d1162bff6c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Took 0.70 seconds to destroy the instance on the hypervisor.
Oct 16 09:55:00 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-a3640057-4b3f-47e5-b983-56d1162bff6c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f487e5ce-793c-461a-8e1d-0006245370c9 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f487e5ce-793c-461a-8e1d-0006245370c9 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f487e5ce-793c-461a-8e1d-0006245370c9 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f487e5ce-793c-461a-8e1d-0006245370c9 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f487e5ce-793c-461a-8e1d-0006245370c9 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:55:00 user nova-compute[74342]: INFO nova.compute.manager [None req-f487e5ce-793c-461a-8e1d-0006245370c9 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Terminating instance
Oct 16 09:55:00 user nova-compute[74342]: DEBUG nova.compute.manager [None req-f487e5ce-793c-461a-8e1d-0006245370c9 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG nova.compute.manager [req-a892da17-7a40-4cfd-a62f-df7ff6f62c1e req-4b9adb89-fb0d-472a-b6be-93b0865b4a2a service nova] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Received event network-vif-unplugged-7fdd8609-f23f-4572-aa9b-68cdb668df83 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a892da17-7a40-4cfd-a62f-df7ff6f62c1e req-4b9adb89-fb0d-472a-b6be-93b0865b4a2a service nova] Acquiring lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a892da17-7a40-4cfd-a62f-df7ff6f62c1e req-4b9adb89-fb0d-472a-b6be-93b0865b4a2a service nova] Lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a892da17-7a40-4cfd-a62f-df7ff6f62c1e req-4b9adb89-fb0d-472a-b6be-93b0865b4a2a service nova] Lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG nova.compute.manager [req-a892da17-7a40-4cfd-a62f-df7ff6f62c1e req-4b9adb89-fb0d-472a-b6be-93b0865b4a2a service nova] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] No waiting events found dispatching network-vif-unplugged-7fdd8609-f23f-4572-aa9b-68cdb668df83 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG nova.compute.manager [req-a892da17-7a40-4cfd-a62f-df7ff6f62c1e req-4b9adb89-fb0d-472a-b6be-93b0865b4a2a service nova] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Received event network-vif-unplugged-7fdd8609-f23f-4572-aa9b-68cdb668df83 for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 09:55:00 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:55:00 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Took 0.86 seconds to deallocate network for instance.
Oct 16 09:55:01 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Instance destroyed successfully.
Oct 16 09:55:01 user nova-compute[74342]: DEBUG nova.objects.instance [None req-f487e5ce-793c-461a-8e1d-0006245370c9 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lazy-loading 'resources' on Instance uuid 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:55:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-f487e5ce-793c-461a-8e1d-0006245370c9 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:49:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-466043768',display_name='tempest-AttachVolumeNegativeTest-server-466043768',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-466043768',id=16,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJafaVyeoMEpPXLf0Eb/aVsJ1zT8C2AU07lc45P1QngXqb/JD5qFvpzD+ZMC/ibKPbpZ+VL5cw/9kmvq1sIUMAK0pm5nIZKdhnoQdpFuP843B9xuYHrKUbwyNRjcZVU9vQ==',key_name='tempest-keypair-512064332',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:49:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08329cd0ad7d42a1999ca4f407d93245',ramdisk_id='',reservation_id='r-9w0lpo5l',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-119585701',owner_user_name='tempest-AttachVolumeNegativeTest-119585701-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:49:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee02f6ad1d9749948f43fb432685d067',uuid=3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7fdd8609-f23f-4572-aa9b-68cdb668df83", "address": "fa:16:3e:4f:14:0e", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fdd8609-f2", "ovs_interfaceid": "7fdd8609-f23f-4572-aa9b-68cdb668df83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:55:01 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-f487e5ce-793c-461a-8e1d-0006245370c9 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Converting VIF {"id": "7fdd8609-f23f-4572-aa9b-68cdb668df83", "address": "fa:16:3e:4f:14:0e", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7fdd8609-f2", "ovs_interfaceid": "7fdd8609-f23f-4572-aa9b-68cdb668df83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:55:01 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-f487e5ce-793c-461a-8e1d-0006245370c9 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:14:0e,bridge_name='br-int',has_traffic_filtering=True,id=7fdd8609-f23f-4572-aa9b-68cdb668df83,network=Network(023e393d-f8ef-42f1-8879-6259a82218cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fdd8609-f2') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:55:01 user nova-compute[74342]: DEBUG os_vif [None req-f487e5ce-793c-461a-8e1d-0006245370c9 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:14:0e,bridge_name='br-int',has_traffic_filtering=True,id=7fdd8609-f23f-4572-aa9b-68cdb668df83,network=Network(023e393d-f8ef-42f1-8879-6259a82218cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fdd8609-f2') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:55:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7fdd8609-f2, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:55:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:55:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d1aebe7e-b8b4-445b-9576-14c289574233) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:55:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:55:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a3640057-4b3f-47e5-b983-56d1162bff6c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:55:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a3640057-4b3f-47e5-b983-56d1162bff6c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:55:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:01 user nova-compute[74342]: INFO os_vif [None req-f487e5ce-793c-461a-8e1d-0006245370c9 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:14:0e,bridge_name='br-int',has_traffic_filtering=True,id=7fdd8609-f23f-4572-aa9b-68cdb668df83,network=Network(023e393d-f8ef-42f1-8879-6259a82218cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7fdd8609-f2')
Oct 16 09:55:01 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-f487e5ce-793c-461a-8e1d-0006245370c9 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Deleting instance files /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4_del
Oct 16 09:55:01 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-f487e5ce-793c-461a-8e1d-0006245370c9 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Deletion of /opt/stack/data/nova/instances/3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4_del complete
Oct 16 09:55:01 user nova-compute[74342]: INFO nova.compute.manager [None req-f487e5ce-793c-461a-8e1d-0006245370c9 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Took 0.98 seconds to destroy the instance on the hypervisor.
Oct 16 09:55:01 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-f487e5ce-793c-461a-8e1d-0006245370c9 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 09:55:01 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 09:55:01 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 09:55:01 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-a3640057-4b3f-47e5-b983-56d1162bff6c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:55:01 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-a3640057-4b3f-47e5-b983-56d1162bff6c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:55:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a3640057-4b3f-47e5-b983-56d1162bff6c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:55:01 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-a3640057-4b3f-47e5-b983-56d1162bff6c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Deleted allocations for instance ea57d655-a24f-4a1c-bb1c-45e1dfc848c1
Oct 16 09:55:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a3640057-4b3f-47e5-b983-56d1162bff6c tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "ea57d655-a24f-4a1c-bb1c-45e1dfc848c1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.253s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:55:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-496ebbb8-815b-4ca2-9ca1-2c12a3d4603d req-04ed42f1-002c-49c0-a99d-6c77e2a14eec service nova] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Received event network-vif-plugged-d1d868a0-b6c1-456b-8a9c-fe78d9168ef4 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:55:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-496ebbb8-815b-4ca2-9ca1-2c12a3d4603d req-04ed42f1-002c-49c0-a99d-6c77e2a14eec service nova] Acquiring lock "ea57d655-a24f-4a1c-bb1c-45e1dfc848c1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:55:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-496ebbb8-815b-4ca2-9ca1-2c12a3d4603d req-04ed42f1-002c-49c0-a99d-6c77e2a14eec service nova] Lock "ea57d655-a24f-4a1c-bb1c-45e1dfc848c1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:55:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-496ebbb8-815b-4ca2-9ca1-2c12a3d4603d req-04ed42f1-002c-49c0-a99d-6c77e2a14eec service nova] Lock "ea57d655-a24f-4a1c-bb1c-45e1dfc848c1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:55:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-496ebbb8-815b-4ca2-9ca1-2c12a3d4603d req-04ed42f1-002c-49c0-a99d-6c77e2a14eec service nova] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] No waiting events found dispatching network-vif-plugged-d1d868a0-b6c1-456b-8a9c-fe78d9168ef4 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:55:02 user nova-compute[74342]: WARNING nova.compute.manager [req-496ebbb8-815b-4ca2-9ca1-2c12a3d4603d req-04ed42f1-002c-49c0-a99d-6c77e2a14eec service nova] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Received unexpected event network-vif-plugged-d1d868a0-b6c1-456b-8a9c-fe78d9168ef4 for instance with vm_state deleted and task_state None.
Oct 16 09:55:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-496ebbb8-815b-4ca2-9ca1-2c12a3d4603d req-04ed42f1-002c-49c0-a99d-6c77e2a14eec service nova] [instance: ea57d655-a24f-4a1c-bb1c-45e1dfc848c1] Received event network-vif-deleted-d1d868a0-b6c1-456b-8a9c-fe78d9168ef4 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:55:02 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:55:02 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Took 1.28 seconds to deallocate network for instance.
Oct 16 09:55:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f487e5ce-793c-461a-8e1d-0006245370c9 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:55:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f487e5ce-793c-461a-8e1d-0006245370c9 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:55:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-061f535b-a941-4434-bea7-adf6032feebd req-5bc17dc2-a24b-4aad-87a4-fc5f58b8b8c8 service nova] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Received event network-vif-plugged-7fdd8609-f23f-4572-aa9b-68cdb668df83 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:55:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-061f535b-a941-4434-bea7-adf6032feebd req-5bc17dc2-a24b-4aad-87a4-fc5f58b8b8c8 service nova] Acquiring lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:55:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-061f535b-a941-4434-bea7-adf6032feebd req-5bc17dc2-a24b-4aad-87a4-fc5f58b8b8c8 service nova] Lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:55:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-061f535b-a941-4434-bea7-adf6032feebd req-5bc17dc2-a24b-4aad-87a4-fc5f58b8b8c8 service nova] Lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:55:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-061f535b-a941-4434-bea7-adf6032feebd req-5bc17dc2-a24b-4aad-87a4-fc5f58b8b8c8 service nova] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] No waiting events found dispatching network-vif-plugged-7fdd8609-f23f-4572-aa9b-68cdb668df83 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:55:02 user nova-compute[74342]: WARNING nova.compute.manager [req-061f535b-a941-4434-bea7-adf6032feebd req-5bc17dc2-a24b-4aad-87a4-fc5f58b8b8c8 service nova] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Received unexpected event network-vif-plugged-7fdd8609-f23f-4572-aa9b-68cdb668df83 for instance with vm_state deleted and task_state None.
Oct 16 09:55:02 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-f487e5ce-793c-461a-8e1d-0006245370c9 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:55:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:02 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-f487e5ce-793c-461a-8e1d-0006245370c9 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:55:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f487e5ce-793c-461a-8e1d-0006245370c9 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:55:02 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-f487e5ce-793c-461a-8e1d-0006245370c9 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Deleted allocations for instance 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4
Oct 16 09:55:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f487e5ce-793c-461a-8e1d-0006245370c9 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.804s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:55:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:04 user nova-compute[74342]: DEBUG nova.compute.manager [req-fe4ff3eb-c0af-4623-888f-4b7b5b2f39ea req-f9730e21-82db-4dd4-a676-8839cac1a888 service nova] [instance: 3cf7c7dd-6bd5-4b9d-875e-dde6d4a5d3c4] Received event network-vif-deleted-7fdd8609-f23f-4572-aa9b-68cdb668df83 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:55:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "eeee39f2-9728-4114-8bd3-1d05f69a1215" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:55:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "eeee39f2-9728-4114-8bd3-1d05f69a1215" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:55:13 user nova-compute[74342]: INFO nova.compute.manager [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Unshelving
Oct 16 09:55:13 user nova-compute[74342]: INFO nova.virt.block_device [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Booting with volume b69a69c8-ec6a-424f-9065-933e6b7997d3 at /dev/vdc
Oct 16 09:55:13 user nova-compute[74342]: DEBUG os_brick.utils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:55:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:13 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[32ab00d6-367b-4a00-ab97-22436533fca4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:55:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:13 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffaf621c-6d60-4b13-bc49-c58de706598d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:55:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:13 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[74095afe-c41e-4f63-a146-1c6345b3d06a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:55:13 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f2bc0c6-4457-4acb-b3de-dba65ae1f517]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:55:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:55:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:55:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:55:13 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:55:13 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[388d04d4-3034-4432-a536-d5f75fe3cf4b]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:55:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:55:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:55:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:55:13 user nova-compute[74342]: DEBUG os_brick.utils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:55:13 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Updating existing volume attachment record: ba3bbcbb-b6a3-475f-8ae6-cdbdbb8200f3 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 09:55:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "aa116cab-861b-459d-b1eb-6f07e5d71e30" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:55:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "aa116cab-861b-459d-b1eb-6f07e5d71e30" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:55:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "68bdaec6-80d1-48c9-9d00-8dfdc17d52c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:55:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "68bdaec6-80d1-48c9-9d00-8dfdc17d52c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:55:48 user nova-compute[74342]: DEBUG nova.compute.manager [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:55:48 user nova-compute[74342]: DEBUG nova.compute.manager [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:55:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:55:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:55:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:55:48 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:55:48 user nova-compute[74342]: INFO nova.compute.claims [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Claim successful on node user
Oct 16 09:55:48 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Refreshing inventories for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 09:55:48 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Updating ProviderTree inventory for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 09:55:48 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Updating inventory in ProviderTree for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 09:55:48 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Refreshing aggregate associations for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca, aggregates: None {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 09:55:48 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Refreshing trait associations for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.730s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG nova.compute.manager [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.733s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:55:49 user nova-compute[74342]: INFO nova.compute.claims [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Claim successful on node user
Oct 16 09:55:49 user nova-compute[74342]: DEBUG nova.compute.manager [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG nova.network.neutron [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:55:49 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:55:49 user nova-compute[74342]: DEBUG nova.compute.manager [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG nova.policy [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e3c728429a0a42789cfc0f1251d6f623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '355bac247f9d4ea8b3c2f0d87453f4c1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:55:49 user nova-compute[74342]: INFO nova.virt.block_device [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Booting with volume e645e4f7-6f67-4461-a2e7-8195c5b246a8 at /dev/vda
Oct 16 09:55:49 user nova-compute[74342]: DEBUG os_brick.utils [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f618fe30-6738-4d68-88d8-1b8e6d9221f0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4b92fa-38e7-4286-9fbf-ee4e08875f66]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd6a549-7ea3-47c0-b3ab-c72de5de49b4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[057f8353-7a3d-4b51-bc64-4ad1fa754c05]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:55:49 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:55:49 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6439627-cd25-446c-8d97-7c32465ae5bf]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG os_brick.utils [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Updating existing volume attachment record: f5128b52-ea9d-4433-9aaf-ba685579b190 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.483s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG nova.compute.manager [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.706s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG nova.objects.instance [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lazy-loading 'pci_requests' on Instance uuid eeee39f2-9728-4114-8bd3-1d05f69a1215 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG nova.objects.instance [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lazy-loading 'numa_topology' on Instance uuid eeee39f2-9728-4114-8bd3-1d05f69a1215 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:55:49 user nova-compute[74342]: INFO nova.compute.claims [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Claim successful on node user
Oct 16 09:55:49 user nova-compute[74342]: DEBUG nova.compute.manager [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:55:49 user nova-compute[74342]: DEBUG nova.network.neutron [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:55:49 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:55:49 user nova-compute[74342]: DEBUG nova.compute.manager [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:55:50 user nova-compute[74342]: INFO nova.virt.block_device [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Booting with volume snapshot 40f56e4a-a82b-44d0-b9f5-4e13d44feb06 at /dev/vda
Oct 16 09:55:50 user nova-compute[74342]: DEBUG nova.policy [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2cac31e799b743359b93943b68b38acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799c265b3d14465a9ca6bd7d5e8a4488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:55:50 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:55:50 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:55:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.571s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:55:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.933s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:55:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:55:50 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 09:55:50 user nova-compute[74342]: DEBUG nova.network.neutron [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Successfully created port: 480ecd6b-63b3-43be-8c76-98216f55e06a {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:55:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:50 user nova-compute[74342]: INFO nova.network.neutron [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Updating port 2f21663b-c324-4ed7-80ff-fedf6e5631c8 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 16 09:55:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json" returned: 0 in 0.279s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:51 user nova-compute[74342]: DEBUG nova.network.neutron [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Successfully updated port: 480ecd6b-63b3-43be-8c76-98216f55e06a {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:55:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "refresh_cache-aa116cab-861b-459d-b1eb-6f07e5d71e30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:55:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquired lock "refresh_cache-aa116cab-861b-459d-b1eb-6f07e5d71e30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:55:51 user nova-compute[74342]: DEBUG nova.network.neutron [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:55:51 user nova-compute[74342]: DEBUG nova.compute.manager [req-666dd080-6bce-4652-82f2-9c35e0854fe4 req-7c8f0995-a1fa-47b9-b4b2-28de08077b61 service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Received event network-changed-480ecd6b-63b3-43be-8c76-98216f55e06a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:55:51 user nova-compute[74342]: DEBUG nova.compute.manager [req-666dd080-6bce-4652-82f2-9c35e0854fe4 req-7c8f0995-a1fa-47b9-b4b2-28de08077b61 service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Refreshing instance network info cache due to event network-changed-480ecd6b-63b3-43be-8c76-98216f55e06a. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:55:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-666dd080-6bce-4652-82f2-9c35e0854fe4 req-7c8f0995-a1fa-47b9-b4b2-28de08077b61 service nova] Acquiring lock "refresh_cache-aa116cab-861b-459d-b1eb-6f07e5d71e30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:55:51 user nova-compute[74342]: DEBUG nova.network.neutron [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Successfully created port: 3cf47650-a8a5-4167-9b06-07436094d93b {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:55:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:51 user nova-compute[74342]: DEBUG nova.network.neutron [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:55:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:51 user nova-compute[74342]: DEBUG nova.network.neutron [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Updating instance_info_cache with network_info: [{"id": "480ecd6b-63b3-43be-8c76-98216f55e06a", "address": "fa:16:3e:5c:87:e5", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480ecd6b-63", "ovs_interfaceid": "480ecd6b-63b3-43be-8c76-98216f55e06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:55:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Releasing lock "refresh_cache-aa116cab-861b-459d-b1eb-6f07e5d71e30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:55:51 user nova-compute[74342]: DEBUG nova.compute.manager [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Instance network_info: |[{"id": "480ecd6b-63b3-43be-8c76-98216f55e06a", "address": "fa:16:3e:5c:87:e5", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480ecd6b-63", "ovs_interfaceid": "480ecd6b-63b3-43be-8c76-98216f55e06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:55:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-666dd080-6bce-4652-82f2-9c35e0854fe4 req-7c8f0995-a1fa-47b9-b4b2-28de08077b61 service nova] Acquired lock "refresh_cache-aa116cab-861b-459d-b1eb-6f07e5d71e30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:55:51 user nova-compute[74342]: DEBUG nova.network.neutron [req-666dd080-6bce-4652-82f2-9c35e0854fe4 req-7c8f0995-a1fa-47b9-b4b2-28de08077b61 service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Refreshing network info cache for port 480ecd6b-63b3-43be-8c76-98216f55e06a {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:55:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "refresh_cache-eeee39f2-9728-4114-8bd3-1d05f69a1215" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:55:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquired lock "refresh_cache-eeee39f2-9728-4114-8bd3-1d05f69a1215" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:55:52 user nova-compute[74342]: DEBUG nova.network.neutron [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:55:52 user nova-compute[74342]: DEBUG nova.network.neutron [req-666dd080-6bce-4652-82f2-9c35e0854fe4 req-7c8f0995-a1fa-47b9-b4b2-28de08077b61 service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Updated VIF entry in instance network info cache for port 480ecd6b-63b3-43be-8c76-98216f55e06a. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:55:52 user nova-compute[74342]: DEBUG nova.network.neutron [req-666dd080-6bce-4652-82f2-9c35e0854fe4 req-7c8f0995-a1fa-47b9-b4b2-28de08077b61 service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Updating instance_info_cache with network_info: [{"id": "480ecd6b-63b3-43be-8c76-98216f55e06a", "address": "fa:16:3e:5c:87:e5", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480ecd6b-63", "ovs_interfaceid": "480ecd6b-63b3-43be-8c76-98216f55e06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:55:52 user nova-compute[74342]: DEBUG nova.compute.manager [req-b54ed27f-eec5-4cac-9a1f-5fd3b91bb90f req-f2473658-ac52-4519-bbce-d302e49f2c06 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Received event network-changed-2f21663b-c324-4ed7-80ff-fedf6e5631c8 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:55:52 user nova-compute[74342]: DEBUG nova.compute.manager [req-b54ed27f-eec5-4cac-9a1f-5fd3b91bb90f req-f2473658-ac52-4519-bbce-d302e49f2c06 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Refreshing instance network info cache due to event network-changed-2f21663b-c324-4ed7-80ff-fedf6e5631c8. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:55:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b54ed27f-eec5-4cac-9a1f-5fd3b91bb90f req-f2473658-ac52-4519-bbce-d302e49f2c06 service nova] Acquiring lock "refresh_cache-eeee39f2-9728-4114-8bd3-1d05f69a1215" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:55:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-666dd080-6bce-4652-82f2-9c35e0854fe4 req-7c8f0995-a1fa-47b9-b4b2-28de08077b61 service nova] Releasing lock "refresh_cache-aa116cab-861b-459d-b1eb-6f07e5d71e30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:55:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:53 user nova-compute[74342]: DEBUG nova.network.neutron [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Successfully updated port: 3cf47650-a8a5-4167-9b06-07436094d93b {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:55:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:53 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:55:53 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:55:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "refresh_cache-68bdaec6-80d1-48c9-9d00-8dfdc17d52c4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:55:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquired lock "refresh_cache-68bdaec6-80d1-48c9-9d00-8dfdc17d52c4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:55:53 user nova-compute[74342]: DEBUG nova.network.neutron [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:55:53 user nova-compute[74342]: DEBUG nova.network.neutron [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Updating instance_info_cache with network_info: [{"id": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "address": "fa:16:3e:7a:a5:ca", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f21663b-c3", "ovs_interfaceid": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:55:53 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:55:53 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:55:53 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8202MB free_disk=25.099571228027344GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 09:55:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:55:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:55:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Releasing lock "refresh_cache-eeee39f2-9728-4114-8bd3-1d05f69a1215" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:55:53 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:55:53 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Creating image(s)
Oct 16 09:55:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "/opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:55:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "/opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:55:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "/opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:55:53 user nova-compute[74342]: DEBUG nova.objects.instance [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lazy-loading 'trusted_certs' on Instance uuid eeee39f2-9728-4114-8bd3-1d05f69a1215 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:55:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b54ed27f-eec5-4cac-9a1f-5fd3b91bb90f req-f2473658-ac52-4519-bbce-d302e49f2c06 service nova] Acquired lock "refresh_cache-eeee39f2-9728-4114-8bd3-1d05f69a1215" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:55:53 user nova-compute[74342]: DEBUG nova.network.neutron [req-b54ed27f-eec5-4cac-9a1f-5fd3b91bb90f req-f2473658-ac52-4519-bbce-d302e49f2c06 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Refreshing network info cache for port 2f21663b-c324-4ed7-80ff-fedf6e5631c8 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:55:53 user nova-compute[74342]: DEBUG nova.network.neutron [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:55:53 user nova-compute[74342]: DEBUG nova.objects.base [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Object Instance<eeee39f2-9728-4114-8bd3-1d05f69a1215> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 09:55:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "69bfda58fcd66cfafdf8d98c945d7032a2c6bb35" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:55:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "69bfda58fcd66cfafdf8d98c945d7032a2c6bb35" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:55:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69bfda58fcd66cfafdf8d98c945d7032a2c6bb35.part --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:55 user nova-compute[74342]: DEBUG nova.compute.manager [req-5804705e-a537-4f02-a98a-8de1c7fccda2 req-3796fafc-f384-4dcb-9d4b-d590dfe65453 service nova] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Received event network-changed-3cf47650-a8a5-4167-9b06-07436094d93b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:55:55 user nova-compute[74342]: DEBUG nova.compute.manager [req-5804705e-a537-4f02-a98a-8de1c7fccda2 req-3796fafc-f384-4dcb-9d4b-d590dfe65453 service nova] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Refreshing instance network info cache due to event network-changed-3cf47650-a8a5-4167-9b06-07436094d93b. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:55:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5804705e-a537-4f02-a98a-8de1c7fccda2 req-3796fafc-f384-4dcb-9d4b-d590dfe65453 service nova] Acquiring lock "refresh_cache-68bdaec6-80d1-48c9-9d00-8dfdc17d52c4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:55:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance d45abd20-3a58-4657-8f4c-a426d8e39be3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:55:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 98367a96-22f0-4edb-ab03-a8eb286b437b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:55:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance edcefbe0-e89f-4496-9032-f9431d9d5c53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:55:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance f3c66abd-af75-4b48-9e29-ab4335f229f3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:55:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 2522364c-36c7-446d-87e7-113632ceeab6 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:55:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 4f3aa905-8eae-45cb-8019-0b991286fe42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:55:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (b5ec9788-0ade-4d36-b3d5-0cad880481ca): {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Oct 16 09:55:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance aa116cab-861b-459d-b1eb-6f07e5d71e30 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:55:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:55:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 09:55:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 09:55:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69bfda58fcd66cfafdf8d98c945d7032a2c6bb35.part --force-share --output=json" returned: 0 in 0.197s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:55 user nova-compute[74342]: DEBUG nova.virt.images [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] 99afbe16-9947-4ce7-b069-8b63097a58d6 was qcow2, converting to raw {{(pid=74342) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 09:55:55 user nova-compute[74342]: DEBUG nova.privsep.utils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 09:55:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/69bfda58fcd66cfafdf8d98c945d7032a2c6bb35.part /opt/stack/data/nova/instances/_base/69bfda58fcd66cfafdf8d98c945d7032a2c6bb35.converted {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:55 user nova-compute[74342]: DEBUG nova.network.neutron [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Updating instance_info_cache with network_info: [{"id": "3cf47650-a8a5-4167-9b06-07436094d93b", "address": "fa:16:3e:ed:06:03", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf47650-a8", "ovs_interfaceid": "3cf47650-a8a5-4167-9b06-07436094d93b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:55:55 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:55:55 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:55:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Releasing lock "refresh_cache-68bdaec6-80d1-48c9-9d00-8dfdc17d52c4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:55:55 user nova-compute[74342]: DEBUG nova.compute.manager [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Instance network_info: |[{"id": "3cf47650-a8a5-4167-9b06-07436094d93b", "address": "fa:16:3e:ed:06:03", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf47650-a8", "ovs_interfaceid": "3cf47650-a8a5-4167-9b06-07436094d93b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:55:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5804705e-a537-4f02-a98a-8de1c7fccda2 req-3796fafc-f384-4dcb-9d4b-d590dfe65453 service nova] Acquired lock "refresh_cache-68bdaec6-80d1-48c9-9d00-8dfdc17d52c4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:55:55 user nova-compute[74342]: DEBUG nova.network.neutron [req-5804705e-a537-4f02-a98a-8de1c7fccda2 req-3796fafc-f384-4dcb-9d4b-d590dfe65453 service nova] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Refreshing network info cache for port 3cf47650-a8a5-4167-9b06-07436094d93b {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.584s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/69bfda58fcd66cfafdf8d98c945d7032a2c6bb35.part /opt/stack/data/nova/instances/_base/69bfda58fcd66cfafdf8d98c945d7032a2c6bb35.converted" returned: 0 in 0.711s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69bfda58fcd66cfafdf8d98c945d7032a2c6bb35.converted --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG os_brick.utils [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG nova.network.neutron [req-b54ed27f-eec5-4cac-9a1f-5fd3b91bb90f req-f2473658-ac52-4519-bbce-d302e49f2c06 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Updated VIF entry in instance network info cache for port 2f21663b-c324-4ed7-80ff-fedf6e5631c8. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG nova.network.neutron [req-b54ed27f-eec5-4cac-9a1f-5fd3b91bb90f req-f2473658-ac52-4519-bbce-d302e49f2c06 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Updating instance_info_cache with network_info: [{"id": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "address": "fa:16:3e:7a:a5:ca", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f21663b-c3", "ovs_interfaceid": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0923088-69eb-469a-971e-f5d6beba5ff2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b54ed27f-eec5-4cac-9a1f-5fd3b91bb90f req-f2473658-ac52-4519-bbce-d302e49f2c06 service nova] Releasing lock "refresh_cache-eeee39f2-9728-4114-8bd3-1d05f69a1215" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9926184-98c6-4de5-8b0f-e26e56092ebc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69bfda58fcd66cfafdf8d98c945d7032a2c6bb35.converted --force-share --output=json" returned: 0 in 0.202s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "69bfda58fcd66cfafdf8d98c945d7032a2c6bb35" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.778s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69bfda58fcd66cfafdf8d98c945d7032a2c6bb35 --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b122d90b-c5d5-4cf7-8ae4-9e2960807492]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9d88ec-31bd-4682-abdd-23bcaf47054d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:55:56 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4312fec-25b1-4919-a9b6-31c5efd42443]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG os_brick.utils [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] <== get_connector_properties: return (197ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Updating existing volume attachment record: 687e9b0b-7979-4bb2-8901-451f7e0dff76 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69bfda58fcd66cfafdf8d98c945d7032a2c6bb35 --force-share --output=json" returned: 0 in 0.217s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "69bfda58fcd66cfafdf8d98c945d7032a2c6bb35" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "69bfda58fcd66cfafdf8d98c945d7032a2c6bb35" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69bfda58fcd66cfafdf8d98c945d7032a2c6bb35 --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG nova.network.neutron [req-5804705e-a537-4f02-a98a-8de1c7fccda2 req-3796fafc-f384-4dcb-9d4b-d590dfe65453 service nova] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Updated VIF entry in instance network info cache for port 3cf47650-a8a5-4167-9b06-07436094d93b. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG nova.network.neutron [req-5804705e-a537-4f02-a98a-8de1c7fccda2 req-3796fafc-f384-4dcb-9d4b-d590dfe65453 service nova] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Updating instance_info_cache with network_info: [{"id": "3cf47650-a8a5-4167-9b06-07436094d93b", "address": "fa:16:3e:ed:06:03", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf47650-a8", "ovs_interfaceid": "3cf47650-a8a5-4167-9b06-07436094d93b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69bfda58fcd66cfafdf8d98c945d7032a2c6bb35 --force-share --output=json" returned: 0 in 0.199s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69bfda58fcd66cfafdf8d98c945d7032a2c6bb35,backing_fmt=raw /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5804705e-a537-4f02-a98a-8de1c7fccda2 req-3796fafc-f384-4dcb-9d4b-d590dfe65453 service nova] Releasing lock "refresh_cache-68bdaec6-80d1-48c9-9d00-8dfdc17d52c4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69bfda58fcd66cfafdf8d98c945d7032a2c6bb35,backing_fmt=raw /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk 1073741824" returned: 0 in 0.051s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "69bfda58fcd66cfafdf8d98c945d7032a2c6bb35" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69bfda58fcd66cfafdf8d98c945d7032a2c6bb35 --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "7f74c903-29f2-4635-bddd-c10051728f47" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "7f74c903-29f2-4635-bddd-c10051728f47" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69bfda58fcd66cfafdf8d98c945d7032a2c6bb35 --force-share --output=json" returned: 0 in 0.179s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:56 user nova-compute[74342]: DEBUG nova.objects.instance [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lazy-loading 'migration_context' on Instance uuid eeee39f2-9728-4114-8bd3-1d05f69a1215 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:55:57 user nova-compute[74342]: DEBUG nova.compute.manager [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:55:57 user nova-compute[74342]: DEBUG nova.objects.base [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Object Instance<eeee39f2-9728-4114-8bd3-1d05f69a1215> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 09:55:57 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Rebasing disk image.
Oct 16 09:55:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:55:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:55:57 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:55:57 user nova-compute[74342]: INFO nova.compute.claims [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Claim successful on node user
Oct 16 09:55:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.238s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd -F raw /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:57 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:55:57 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:55:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.555s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:55:57 user nova-compute[74342]: DEBUG nova.compute.manager [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:55:57 user nova-compute[74342]: DEBUG nova.compute.manager [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:55:57 user nova-compute[74342]: DEBUG nova.network.neutron [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:55:57 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:55:57 user nova-compute[74342]: DEBUG nova.compute.manager [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:55:58 user nova-compute[74342]: DEBUG nova.policy [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ee02f6ad1d9749948f43fb432685d067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08329cd0ad7d42a1999ca4f407d93245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:55:58 user nova-compute[74342]: DEBUG nova.compute.manager [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 09:55:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:55:58 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Creating image(s)
Oct 16 09:55:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "/opt/stack/data/nova/instances/7f74c903-29f2-4635-bddd-c10051728f47/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:55:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "/opt/stack/data/nova/instances/7f74c903-29f2-4635-bddd-c10051728f47/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:55:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "/opt/stack/data/nova/instances/7f74c903-29f2-4635-bddd-c10051728f47/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:55:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.208s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:55:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:55:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.203s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/7f74c903-29f2-4635-bddd-c10051728f47/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/7f74c903-29f2-4635-bddd-c10051728f47/disk 1073741824" returned: 0 in 0.076s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:55:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:55:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.222s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:58 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7f74c903-29f2-4635-bddd-c10051728f47/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 09:55:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f74c903-29f2-4635-bddd-c10051728f47/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:55:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f74c903-29f2-4635-bddd-c10051728f47/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:55:59 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Cannot resize image /opt/stack/data/nova/instances/7f74c903-29f2-4635-bddd-c10051728f47/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 09:55:59 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 09:55:59 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Ensure instance console log exists: /opt/stack/data/nova/instances/7f74c903-29f2-4635-bddd-c10051728f47/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:55:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:55:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:55:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:55:59 user nova-compute[74342]: DEBUG nova.network.neutron [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Successfully created port: bebf3999-cde8-46de-93e3-f80489f3b8bf {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:55:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4abd54b7-e262-460e-90d5-138d2264d056 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Acquiring lock "f3c66abd-af75-4b48-9e29-ab4335f229f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:55:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4abd54b7-e262-460e-90d5-138d2264d056 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "f3c66abd-af75-4b48-9e29-ab4335f229f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:55:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4abd54b7-e262-460e-90d5-138d2264d056 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Acquiring lock "f3c66abd-af75-4b48-9e29-ab4335f229f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:55:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4abd54b7-e262-460e-90d5-138d2264d056 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "f3c66abd-af75-4b48-9e29-ab4335f229f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:55:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4abd54b7-e262-460e-90d5-138d2264d056 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "f3c66abd-af75-4b48-9e29-ab4335f229f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:56:00 user nova-compute[74342]: INFO nova.compute.manager [None req-4abd54b7-e262-460e-90d5-138d2264d056 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Terminating instance
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.compute.manager [None req-4abd54b7-e262-460e-90d5-138d2264d056 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Skipping network cache update for instance because it is being deleted. {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9970}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.network.neutron [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Successfully updated port: bebf3999-cde8-46de-93e3-f80489f3b8bf {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd -F raw /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk" returned: 0 in 2.949s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Ensure instance console log exists: /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Start _get_guest_xml network_info=[{"id": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "address": "fa:16:3e:7a:a5:ca", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f21663b-c3", "ovs_interfaceid": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='4201eff60acb0696eec12d384365a33e',container_format='bare',created_at=2023-10-16T09:53:19Z,direct_url=<?>,disk_format='qcow2',id=99afbe16-9947-4ce7-b069-8b63097a58d6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1957313876-shelved',owner='a70b9ea5f3404a5690cd0a73db23f034',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-16T09:53:24Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdc', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'ba3bbcbb-b6a3-475f-8ae6-cdbdbb8200f3', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygxzELjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': 'eeee39f2-9728-4114-8bd3-1d05f69a1215', 'attached_at': '', 'detached_at': '', 'volume_id': 'b69a69c8-ec6a-424f-9065-933e6b7997d3', 'serial': 'b69a69c8-ec6a-424f-9065-933e6b7997d3'}, 'volume_type': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "refresh_cache-7f74c903-29f2-4635-bddd-c10051728f47" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquired lock "refresh_cache-7f74c903-29f2-4635-bddd-c10051728f47" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.network.neutron [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Didn't find any instances for network info cache update. {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.compute.manager [req-9f83f223-dc35-499b-a841-7209dfe835e0 req-af0f8efb-020c-4154-982f-895fbd0b56d8 service nova] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Received event network-changed-bebf3999-cde8-46de-93e3-f80489f3b8bf {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.compute.manager [req-9f83f223-dc35-499b-a841-7209dfe835e0 req-af0f8efb-020c-4154-982f-895fbd0b56d8 service nova] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Refreshing instance network info cache due to event network-changed-bebf3999-cde8-46de-93e3-f80489f3b8bf. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9f83f223-dc35-499b-a841-7209dfe835e0 req-af0f8efb-020c-4154-982f-895fbd0b56d8 service nova] Acquiring lock "refresh_cache-7f74c903-29f2-4635-bddd-c10051728f47" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:56:00 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:56:00 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='4201eff60acb0696eec12d384365a33e',container_format='bare',created_at=2023-10-16T09:53:19Z,direct_url=<?>,disk_format='qcow2',id=99afbe16-9947-4ce7-b069-8b63097a58d6,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1957313876-shelved',owner='a70b9ea5f3404a5690cd0a73db23f034',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-16T09:53:24Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.objects.instance [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lazy-loading 'vcpu_model' on Instance uuid eeee39f2-9728-4114-8bd3-1d05f69a1215 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.objects.base [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Object Instance<eeee39f2-9728-4114-8bd3-1d05f69a1215> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygxzELjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:56:00 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:56:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:56:00 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:56:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:56:00 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.network.neutron [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dc2bc6-7e43-479d-bdba-b2028b368b80]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 09:56:00 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b6c3da-025f-4bdb-9194-07772f59b48b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3] added
Oct 16 09:56:00 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3e2895-bed9-44ca-86de-a8e1a5c74387]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[112ad38b-cdd6-422c-9560-f196b983b95a]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ygxzELjY {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ygxzELjY" returned: 0 in 0.027s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[71173154-d5ba-4f16-8cbe-aed91c4535ff]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ygxzELjY'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad37de4e-84af-408f-b6da-d8308e182c29]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b247dec-173f-4a7e-a3f0-bb886d044a77]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b50ae0-91cf-4aa9-b38e-1b731a967373 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:56:00 user nova-compute[74342]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:56:00 user nova-compute[74342]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b50ae0-91cf-4aa9-b38e-1b731a967373 (non-flash)
Oct 16 09:56:00 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:56:00 user nova-compute[74342]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:56:00 user nova-compute[74342]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b50ae0-91cf-4aa9-b38e-1b731a967373 (non-flash)
Oct 16 09:56:00 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[828a3ae1-ebb9-4e24-84ea-39948717d128]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3, portal: 172.16.0.220,3260]
Oct 16 09:56:00 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3, portal: 172.16.0.220,3260] successful.
Oct 16 09:56:00 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3366fb1-b8de-4e2b-b03a-e62dc06e080a]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d724f74a-c610-4167-a39c-7d8606187812]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b50ae0-91cf-4aa9-b38e-1b731a967373 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:56:00 user nova-compute[74342]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:56:00 user nova-compute[74342]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b50ae0-91cf-4aa9-b38e-1b731a967373 (non-flash)
Oct 16 09:56:00 user nova-compute[74342]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)
Oct 16 09:56:00 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:56:00 user nova-compute[74342]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:56:00 user nova-compute[74342]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b50ae0-91cf-4aa9-b38e-1b731a967373 (non-flash)
Oct 16 09:56:00 user nova-compute[74342]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)
Oct 16 09:56:00 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.343s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9399d5d-a95a-4d1b-8c86-e68e8aa41aa9]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: None {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:56:00 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Instance destroyed successfully.
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.objects.instance [None req-4abd54b7-e262-460e-90d5-138d2264d056 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lazy-loading 'resources' on Instance uuid f3c66abd-af75-4b48-9e29-ab4335f229f3 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-4abd54b7-e262-460e-90d5-138d2264d056 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:49:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1069689818',display_name='tempest-VolumesAdminNegativeTest-server-1069689818',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1069689818',id=18,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8qEW/jc08xg0yK/anKoEas78/uRRjXPMs3J1Q2CdtZlqJBxAA+P75HNk4yvkINeaJbOJj1wIW2t5agPb4AjO5k/RwFj1UGwSZX9fk8rt3keM9RTNlE203GHNK5oC6tVw==',key_name='tempest-keypair-1462511116',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:49:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0afd0e8f0d424fe393636bbcd26eed42',ramdisk_id='',reservation_id='r-mr0en132',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1903882113',owner_user_name='tempest-VolumesAdminNegativeTest-1903882113-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:49:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='353ec67aa4b84aa7b6992ccb49423ca6',uuid=f3c66abd-af75-4b48-9e29-ab4335f229f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "725894e9-c57a-469c-a85c-d5d9aabb805a", "address": "fa:16:3e:fe:a5:67", "network": {"id": "7bc80f1e-0315-4a4e-bc89-2ad397451db6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1430189260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afd0e8f0d424fe393636bbcd26eed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725894e9-c5", "ovs_interfaceid": "725894e9-c57a-469c-a85c-d5d9aabb805a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-4abd54b7-e262-460e-90d5-138d2264d056 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Converting VIF {"id": "725894e9-c57a-469c-a85c-d5d9aabb805a", "address": "fa:16:3e:fe:a5:67", "network": {"id": "7bc80f1e-0315-4a4e-bc89-2ad397451db6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1430189260-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.114", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0afd0e8f0d424fe393636bbcd26eed42", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap725894e9-c5", "ovs_interfaceid": "725894e9-c57a-469c-a85c-d5d9aabb805a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-4abd54b7-e262-460e-90d5-138d2264d056 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fe:a5:67,bridge_name='br-int',has_traffic_filtering=True,id=725894e9-c57a-469c-a85c-d5d9aabb805a,network=Network(7bc80f1e-0315-4a4e-bc89-2ad397451db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725894e9-c5') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG os_vif [None req-4abd54b7-e262-460e-90d5-138d2264d056 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:a5:67,bridge_name='br-int',has_traffic_filtering=True,id=725894e9-c57a-469c-a85c-d5d9aabb805a,network=Network(7bc80f1e-0315-4a4e-bc89-2ad397451db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725894e9-c5') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap725894e9-c5, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f98fff2e-5108-4b28-b16e-ce8e2f0d818d) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:00 user nova-compute[74342]: INFO os_vif [None req-4abd54b7-e262-460e-90d5-138d2264d056 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fe:a5:67,bridge_name='br-int',has_traffic_filtering=True,id=725894e9-c57a-469c-a85c-d5d9aabb805a,network=Network(7bc80f1e-0315-4a4e-bc89-2ad397451db6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap725894e9-c5')
Oct 16 09:56:00 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-4abd54b7-e262-460e-90d5-138d2264d056 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Deleting instance files /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3_del
Oct 16 09:56:00 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-4abd54b7-e262-460e-90d5-138d2264d056 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Deletion of /opt/stack/data/nova/instances/f3c66abd-af75-4b48-9e29-ab4335f229f3_del complete
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.network.neutron [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Updating instance_info_cache with network_info: [{"id": "bebf3999-cde8-46de-93e3-f80489f3b8bf", "address": "fa:16:3e:76:2a:2f", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbebf3999-cd", "ovs_interfaceid": "bebf3999-cde8-46de-93e3-f80489f3b8bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Releasing lock "refresh_cache-7f74c903-29f2-4635-bddd-c10051728f47" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.compute.manager [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Instance network_info: |[{"id": "bebf3999-cde8-46de-93e3-f80489f3b8bf", "address": "fa:16:3e:76:2a:2f", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbebf3999-cd", "ovs_interfaceid": "bebf3999-cde8-46de-93e3-f80489f3b8bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9f83f223-dc35-499b-a841-7209dfe835e0 req-af0f8efb-020c-4154-982f-895fbd0b56d8 service nova] Acquired lock "refresh_cache-7f74c903-29f2-4635-bddd-c10051728f47" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.network.neutron [req-9f83f223-dc35-499b-a841-7209dfe835e0 req-af0f8efb-020c-4154-982f-895fbd0b56d8 service nova] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Refreshing network info cache for port bebf3999-cde8-46de-93e3-f80489f3b8bf {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:56:00 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Start _get_guest_xml network_info=[{"id": "bebf3999-cde8-46de-93e3-f80489f3b8bf", "address": "fa:16:3e:76:2a:2f", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbebf3999-cd", "ovs_interfaceid": "bebf3999-cde8-46de-93e3-f80489f3b8bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:56:01 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:56:01 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:55:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2078792788',display_name='tempest-AttachVolumeNegativeTest-server-2078792788',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2078792788',id=28,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInoBCPz9u2gBUSLQuKukwVqGTqT/mVhiDa4+pwzySVSH1A8xw0OT4AdWKB5q6I4uArxvy8t1xLxHLZpEbjPPI5o7rmJaZMcn1iQf5tHmgNerWmZyJM4P+2E8u3++TUA0Q==',key_name='tempest-keypair-232959929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08329cd0ad7d42a1999ca4f407d93245',ramdisk_id='',reservation_id='r-hwpz4jvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-119585701',owner_user_name='tempest-AttachVolumeNegativeTest-119585701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:55:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee02f6ad1d9749948f43fb432685d067',uuid=7f74c903-29f2-4635-bddd-c10051728f47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bebf3999-cde8-46de-93e3-f80489f3b8bf", "address": "fa:16:3e:76:2a:2f", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbebf3999-cd", "ovs_interfaceid": "bebf3999-cde8-46de-93e3-f80489f3b8bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Converting VIF {"id": "bebf3999-cde8-46de-93e3-f80489f3b8bf", "address": "fa:16:3e:76:2a:2f", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbebf3999-cd", "ovs_interfaceid": "bebf3999-cde8-46de-93e3-f80489f3b8bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:2a:2f,bridge_name='br-int',has_traffic_filtering=True,id=bebf3999-cde8-46de-93e3-f80489f3b8bf,network=Network(023e393d-f8ef-42f1-8879-6259a82218cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbebf3999-cd') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.objects.instance [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lazy-loading 'pci_devices' on Instance uuid 7f74c903-29f2-4635-bddd-c10051728f47 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:56:01 user nova-compute[74342]: INFO nova.compute.manager [None req-4abd54b7-e262-460e-90d5-138d2264d056 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Took 1.07 seconds to destroy the instance on the hypervisor.
Oct 16 09:56:01 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-4abd54b7-e262-460e-90d5-138d2264d056 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:56:01 user nova-compute[74342]:   <uuid>7f74c903-29f2-4635-bddd-c10051728f47</uuid>
Oct 16 09:56:01 user nova-compute[74342]:   <name>instance-0000001c</name>
Oct 16 09:56:01 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:56:01 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:56:01 user nova-compute[74342]:   <metadata>
Oct 16 09:56:01 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:56:01 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:56:01 user nova-compute[74342]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2078792788</nova:name>
Oct 16 09:56:01 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:56:01</nova:creationTime>
Oct 16 09:56:01 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:56:01 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:56:01 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:56:01 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:56:01 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:56:01 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:56:01 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:56:01 user nova-compute[74342]:       <nova:owner>
Oct 16 09:56:01 user nova-compute[74342]:         <nova:user uuid="ee02f6ad1d9749948f43fb432685d067">tempest-AttachVolumeNegativeTest-119585701-project-member</nova:user>
Oct 16 09:56:01 user nova-compute[74342]:         <nova:project uuid="08329cd0ad7d42a1999ca4f407d93245">tempest-AttachVolumeNegativeTest-119585701</nova:project>
Oct 16 09:56:01 user nova-compute[74342]:       </nova:owner>
Oct 16 09:56:01 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:56:01 user nova-compute[74342]:       <nova:ports>
Oct 16 09:56:01 user nova-compute[74342]:         <nova:port uuid="bebf3999-cde8-46de-93e3-f80489f3b8bf">
Oct 16 09:56:01 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 16 09:56:01 user nova-compute[74342]:         </nova:port>
Oct 16 09:56:01 user nova-compute[74342]:       </nova:ports>
Oct 16 09:56:01 user nova-compute[74342]:     </nova:instance>
Oct 16 09:56:01 user nova-compute[74342]:   </metadata>
Oct 16 09:56:01 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:56:01 user nova-compute[74342]:     <system>
Oct 16 09:56:01 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:56:01 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:56:01 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:56:01 user nova-compute[74342]:       <entry name="serial">7f74c903-29f2-4635-bddd-c10051728f47</entry>
Oct 16 09:56:01 user nova-compute[74342]:       <entry name="uuid">7f74c903-29f2-4635-bddd-c10051728f47</entry>
Oct 16 09:56:01 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:56:01 user nova-compute[74342]:     </system>
Oct 16 09:56:01 user nova-compute[74342]:   </sysinfo>
Oct 16 09:56:01 user nova-compute[74342]:   <os>
Oct 16 09:56:01 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:56:01 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:56:01 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:56:01 user nova-compute[74342]:   </os>
Oct 16 09:56:01 user nova-compute[74342]:   <features>
Oct 16 09:56:01 user nova-compute[74342]:     <acpi/>
Oct 16 09:56:01 user nova-compute[74342]:     <apic/>
Oct 16 09:56:01 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:56:01 user nova-compute[74342]:   </features>
Oct 16 09:56:01 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:56:01 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:56:01 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:56:01 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:56:01 user nova-compute[74342]:   </clock>
Oct 16 09:56:01 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:56:01 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:56:01 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:56:01 user nova-compute[74342]:   </cpu>
Oct 16 09:56:01 user nova-compute[74342]:   <devices>
Oct 16 09:56:01 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 09:56:01 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 09:56:01 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/7f74c903-29f2-4635-bddd-c10051728f47/disk"/>
Oct 16 09:56:01 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:56:01 user nova-compute[74342]:     </disk>
Oct 16 09:56:01 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:56:01 user nova-compute[74342]:       <mac address="fa:16:3e:76:2a:2f"/>
Oct 16 09:56:01 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:56:01 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:56:01 user nova-compute[74342]:       <target dev="tapbebf3999-cd"/>
Oct 16 09:56:01 user nova-compute[74342]:     </interface>
Oct 16 09:56:01 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:56:01 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/7f74c903-29f2-4635-bddd-c10051728f47/console.log" append="off"/>
Oct 16 09:56:01 user nova-compute[74342]:     </serial>
Oct 16 09:56:01 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:56:01 user nova-compute[74342]:     <video>
Oct 16 09:56:01 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:56:01 user nova-compute[74342]:     </video>
Oct 16 09:56:01 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:56:01 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:56:01 user nova-compute[74342]:     </rng>
Oct 16 09:56:01 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:56:01 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:56:01 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:56:01 user nova-compute[74342]:     </memballoon>
Oct 16 09:56:01 user nova-compute[74342]:   </devices>
Oct 16 09:56:01 user nova-compute[74342]: </domain>
Oct 16 09:56:01 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:55:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2078792788',display_name='tempest-AttachVolumeNegativeTest-server-2078792788',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2078792788',id=28,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInoBCPz9u2gBUSLQuKukwVqGTqT/mVhiDa4+pwzySVSH1A8xw0OT4AdWKB5q6I4uArxvy8t1xLxHLZpEbjPPI5o7rmJaZMcn1iQf5tHmgNerWmZyJM4P+2E8u3++TUA0Q==',key_name='tempest-keypair-232959929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08329cd0ad7d42a1999ca4f407d93245',ramdisk_id='',reservation_id='r-hwpz4jvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-119585701',owner_user_name='tempest-AttachVolumeNegativeTest-119585701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:55:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee02f6ad1d9749948f43fb432685d067',uuid=7f74c903-29f2-4635-bddd-c10051728f47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bebf3999-cde8-46de-93e3-f80489f3b8bf", "address": "fa:16:3e:76:2a:2f", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbebf3999-cd", "ovs_interfaceid": "bebf3999-cde8-46de-93e3-f80489f3b8bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Converting VIF {"id": "bebf3999-cde8-46de-93e3-f80489f3b8bf", "address": "fa:16:3e:76:2a:2f", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbebf3999-cd", "ovs_interfaceid": "bebf3999-cde8-46de-93e3-f80489f3b8bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:2a:2f,bridge_name='br-int',has_traffic_filtering=True,id=bebf3999-cde8-46de-93e3-f80489f3b8bf,network=Network(023e393d-f8ef-42f1-8879-6259a82218cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbebf3999-cd') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG os_vif [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:2a:2f,bridge_name='br-int',has_traffic_filtering=True,id=bebf3999-cde8-46de-93e3-f80489f3b8bf,network=Network(023e393d-f8ef-42f1-8879-6259a82218cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbebf3999-cd') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '17ac4781-bc42-5285-9728-8e75b4b64543', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbebf3999-cd, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbebf3999-cd, col_values=(('qos', UUID('25498ca7-996b-4fbc-9888-9951eec9ede7')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbebf3999-cd, col_values=(('external_ids', {'iface-id': 'bebf3999-cde8-46de-93e3-f80489f3b8bf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:2a:2f', 'vm-uuid': '7f74c903-29f2-4635-bddd-c10051728f47'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:01 user nova-compute[74342]: INFO os_vif [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:2a:2f,bridge_name='br-int',has_traffic_filtering=True,id=bebf3999-cde8-46de-93e3-f80489f3b8bf,network=Network(023e393d-f8ef-42f1-8879-6259a82218cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbebf3999-cd')
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] No VIF found with MAC fa:16:3e:76:2a:2f, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.network.neutron [req-9f83f223-dc35-499b-a841-7209dfe835e0 req-af0f8efb-020c-4154-982f-895fbd0b56d8 service nova] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Updated VIF entry in instance network info cache for port bebf3999-cde8-46de-93e3-f80489f3b8bf. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.network.neutron [req-9f83f223-dc35-499b-a841-7209dfe835e0 req-af0f8efb-020c-4154-982f-895fbd0b56d8 service nova] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Updating instance_info_cache with network_info: [{"id": "bebf3999-cde8-46de-93e3-f80489f3b8bf", "address": "fa:16:3e:76:2a:2f", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbebf3999-cd", "ovs_interfaceid": "bebf3999-cde8-46de-93e3-f80489f3b8bf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9f83f223-dc35-499b-a841-7209dfe835e0 req-af0f8efb-020c-4154-982f-895fbd0b56d8 service nova] Releasing lock "refresh_cache-7f74c903-29f2-4635-bddd-c10051728f47" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygxzELjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23536343930653739', 'path': '/dev/sde'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536343930653739', 'path': '/dev/sde'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T09:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1957313876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1957313876',id=22,image_ref='99afbe16-9947-4ce7-b069-8b63097a58d6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1825544135',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:51:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a70b9ea5f3404a5690cd0a73db23f034',ramdisk_id='',reservation_id='r-1dw8qoh2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-939526853',owner_user_name='tempest-AttachVolumeShelveTestJSON-939526853-project-member',shelved_at='2023-10-16T09:53:23.663357',shelved_host='user',shelved_image_id='99afbe16-9947-4ce7-b069-8b63097a58d6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:55:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8bf8aa8ab2d4105ad0b1fd04247e3a0',uuid=eeee39f2-9728-4114-8bd3-1d05f69a1215,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "address": "fa:16:3e:7a:a5:ca", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f21663b-c3", "ovs_interfaceid": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Converting VIF {"id": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "address": "fa:16:3e:7a:a5:ca", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f21663b-c3", "ovs_interfaceid": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:a5:ca,bridge_name='br-int',has_traffic_filtering=True,id=2f21663b-c324-4ed7-80ff-fedf6e5631c8,network=Network(bbeb1d70-a5dc-46d6-a0dd-240bf3018d31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f21663b-c3') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.objects.instance [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lazy-loading 'pci_devices' on Instance uuid eeee39f2-9728-4114-8bd3-1d05f69a1215 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.objects.base [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Object Instance<eeee39f2-9728-4114-8bd3-1d05f69a1215> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:56:01 user nova-compute[74342]:   <uuid>eeee39f2-9728-4114-8bd3-1d05f69a1215</uuid>
Oct 16 09:56:01 user nova-compute[74342]:   <name>instance-00000016</name>
Oct 16 09:56:01 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:56:01 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:56:01 user nova-compute[74342]:   <metadata>
Oct 16 09:56:01 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:56:01 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:56:01 user nova-compute[74342]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1957313876</nova:name>
Oct 16 09:56:01 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:56:00</nova:creationTime>
Oct 16 09:56:01 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:56:01 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:56:01 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:56:01 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:56:01 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:56:01 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:56:01 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:56:01 user nova-compute[74342]:       <nova:owner>
Oct 16 09:56:01 user nova-compute[74342]:         <nova:user uuid="c8bf8aa8ab2d4105ad0b1fd04247e3a0">tempest-AttachVolumeShelveTestJSON-939526853-project-member</nova:user>
Oct 16 09:56:01 user nova-compute[74342]:         <nova:project uuid="a70b9ea5f3404a5690cd0a73db23f034">tempest-AttachVolumeShelveTestJSON-939526853</nova:project>
Oct 16 09:56:01 user nova-compute[74342]:       </nova:owner>
Oct 16 09:56:01 user nova-compute[74342]:       <nova:root type="image" uuid="99afbe16-9947-4ce7-b069-8b63097a58d6"/>
Oct 16 09:56:01 user nova-compute[74342]:       <nova:ports>
Oct 16 09:56:01 user nova-compute[74342]:         <nova:port uuid="2f21663b-c324-4ed7-80ff-fedf6e5631c8">
Oct 16 09:56:01 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 16 09:56:01 user nova-compute[74342]:         </nova:port>
Oct 16 09:56:01 user nova-compute[74342]:       </nova:ports>
Oct 16 09:56:01 user nova-compute[74342]:     </nova:instance>
Oct 16 09:56:01 user nova-compute[74342]:   </metadata>
Oct 16 09:56:01 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:56:01 user nova-compute[74342]:     <system>
Oct 16 09:56:01 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:56:01 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:56:01 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:56:01 user nova-compute[74342]:       <entry name="serial">eeee39f2-9728-4114-8bd3-1d05f69a1215</entry>
Oct 16 09:56:01 user nova-compute[74342]:       <entry name="uuid">eeee39f2-9728-4114-8bd3-1d05f69a1215</entry>
Oct 16 09:56:01 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:56:01 user nova-compute[74342]:     </system>
Oct 16 09:56:01 user nova-compute[74342]:   </sysinfo>
Oct 16 09:56:01 user nova-compute[74342]:   <os>
Oct 16 09:56:01 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:56:01 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:56:01 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:56:01 user nova-compute[74342]:   </os>
Oct 16 09:56:01 user nova-compute[74342]:   <features>
Oct 16 09:56:01 user nova-compute[74342]:     <acpi/>
Oct 16 09:56:01 user nova-compute[74342]:     <apic/>
Oct 16 09:56:01 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:56:01 user nova-compute[74342]:   </features>
Oct 16 09:56:01 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:56:01 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:56:01 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:56:01 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:56:01 user nova-compute[74342]:   </clock>
Oct 16 09:56:01 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:56:01 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:56:01 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:56:01 user nova-compute[74342]:   </cpu>
Oct 16 09:56:01 user nova-compute[74342]:   <devices>
Oct 16 09:56:01 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 09:56:01 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 09:56:01 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk"/>
Oct 16 09:56:01 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:56:01 user nova-compute[74342]:     </disk>
Oct 16 09:56:01 user nova-compute[74342]:     <disk type="block" device="disk">
Oct 16 09:56:01 user nova-compute[74342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:56:01 user nova-compute[74342]:       <source dev="/dev/sde"/>
Oct 16 09:56:01 user nova-compute[74342]:       <target dev="vdc" bus="virtio"/>
Oct 16 09:56:01 user nova-compute[74342]:       <serial>b69a69c8-ec6a-424f-9065-933e6b7997d3</serial>
Oct 16 09:56:01 user nova-compute[74342]:     </disk>
Oct 16 09:56:01 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:56:01 user nova-compute[74342]:       <mac address="fa:16:3e:7a:a5:ca"/>
Oct 16 09:56:01 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:56:01 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:56:01 user nova-compute[74342]:       <target dev="tap2f21663b-c3"/>
Oct 16 09:56:01 user nova-compute[74342]:     </interface>
Oct 16 09:56:01 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:56:01 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/console.log" append="off"/>
Oct 16 09:56:01 user nova-compute[74342]:     </serial>
Oct 16 09:56:01 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:56:01 user nova-compute[74342]:     <video>
Oct 16 09:56:01 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:56:01 user nova-compute[74342]:     </video>
Oct 16 09:56:01 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:56:01 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:56:01 user nova-compute[74342]:     </rng>
Oct 16 09:56:01 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:56:01 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:56:01 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:56:01 user nova-compute[74342]:     </memballoon>
Oct 16 09:56:01 user nova-compute[74342]:   </devices>
Oct 16 09:56:01 user nova-compute[74342]: </domain>
Oct 16 09:56:01 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T09:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1957313876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1957313876',id=22,image_ref='99afbe16-9947-4ce7-b069-8b63097a58d6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1825544135',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:51:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a70b9ea5f3404a5690cd0a73db23f034',ramdisk_id='',reservation_id='r-1dw8qoh2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-939526853',owner_user_name='tempest-AttachVolumeShelveTestJSON-939526853-project-member',shelved_at='2023-10-16T09:53:23.663357',shelved_host='user',shelved_image_id='99afbe16-9947-4ce7-b069-8b63097a58d6'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:55:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8bf8aa8ab2d4105ad0b1fd04247e3a0',uuid=eeee39f2-9728-4114-8bd3-1d05f69a1215,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "address": "fa:16:3e:7a:a5:ca", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f21663b-c3", "ovs_interfaceid": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Converting VIF {"id": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "address": "fa:16:3e:7a:a5:ca", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f21663b-c3", "ovs_interfaceid": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:a5:ca,bridge_name='br-int',has_traffic_filtering=True,id=2f21663b-c324-4ed7-80ff-fedf6e5631c8,network=Network(bbeb1d70-a5dc-46d6-a0dd-240bf3018d31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f21663b-c3') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG os_vif [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:a5:ca,bridge_name='br-int',has_traffic_filtering=True,id=2f21663b-c324-4ed7-80ff-fedf6e5631c8,network=Network(bbeb1d70-a5dc-46d6-a0dd-240bf3018d31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f21663b-c3') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '522f72eb-9ae3-548a-8c6a-2efaf924f9bb', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2f21663b-c3, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2f21663b-c3, col_values=(('qos', UUID('1cdeac40-bc1e-41cb-9815-9c430c438434')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2f21663b-c3, col_values=(('external_ids', {'iface-id': '2f21663b-c324-4ed7-80ff-fedf6e5631c8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:a5:ca', 'vm-uuid': 'eeee39f2-9728-4114-8bd3-1d05f69a1215'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:56:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:01 user nova-compute[74342]: INFO os_vif [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:a5:ca,bridge_name='br-int',has_traffic_filtering=True,id=2f21663b-c324-4ed7-80ff-fedf6e5631c8,network=Network(bbeb1d70-a5dc-46d6-a0dd-240bf3018d31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f21663b-c3')
Oct 16 09:56:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:56:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:56:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] No VIF found with MAC fa:16:3e:7a:a5:ca, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:56:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-f01b06ee-96cb-4ffa-9554-82fa71cb265a req-fd606ede-1537-4571-8f08-218e04425289 service nova] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Received event network-vif-unplugged-725894e9-c57a-469c-a85c-d5d9aabb805a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:56:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f01b06ee-96cb-4ffa-9554-82fa71cb265a req-fd606ede-1537-4571-8f08-218e04425289 service nova] Acquiring lock "f3c66abd-af75-4b48-9e29-ab4335f229f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:56:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f01b06ee-96cb-4ffa-9554-82fa71cb265a req-fd606ede-1537-4571-8f08-218e04425289 service nova] Lock "f3c66abd-af75-4b48-9e29-ab4335f229f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:56:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f01b06ee-96cb-4ffa-9554-82fa71cb265a req-fd606ede-1537-4571-8f08-218e04425289 service nova] Lock "f3c66abd-af75-4b48-9e29-ab4335f229f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:56:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-f01b06ee-96cb-4ffa-9554-82fa71cb265a req-fd606ede-1537-4571-8f08-218e04425289 service nova] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] No waiting events found dispatching network-vif-unplugged-725894e9-c57a-469c-a85c-d5d9aabb805a {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:56:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-f01b06ee-96cb-4ffa-9554-82fa71cb265a req-fd606ede-1537-4571-8f08-218e04425289 service nova] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Received event network-vif-unplugged-725894e9-c57a-469c-a85c-d5d9aabb805a for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 09:56:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-f01b06ee-96cb-4ffa-9554-82fa71cb265a req-fd606ede-1537-4571-8f08-218e04425289 service nova] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Received event network-vif-plugged-725894e9-c57a-469c-a85c-d5d9aabb805a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:56:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f01b06ee-96cb-4ffa-9554-82fa71cb265a req-fd606ede-1537-4571-8f08-218e04425289 service nova] Acquiring lock "f3c66abd-af75-4b48-9e29-ab4335f229f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:56:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f01b06ee-96cb-4ffa-9554-82fa71cb265a req-fd606ede-1537-4571-8f08-218e04425289 service nova] Lock "f3c66abd-af75-4b48-9e29-ab4335f229f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:56:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f01b06ee-96cb-4ffa-9554-82fa71cb265a req-fd606ede-1537-4571-8f08-218e04425289 service nova] Lock "f3c66abd-af75-4b48-9e29-ab4335f229f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:56:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-f01b06ee-96cb-4ffa-9554-82fa71cb265a req-fd606ede-1537-4571-8f08-218e04425289 service nova] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] No waiting events found dispatching network-vif-plugged-725894e9-c57a-469c-a85c-d5d9aabb805a {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:56:02 user nova-compute[74342]: WARNING nova.compute.manager [req-f01b06ee-96cb-4ffa-9554-82fa71cb265a req-fd606ede-1537-4571-8f08-218e04425289 service nova] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Received unexpected event network-vif-plugged-725894e9-c57a-469c-a85c-d5d9aabb805a for instance with vm_state active and task_state deleting.
Oct 16 09:56:02 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:56:02 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Took 1.48 seconds to deallocate network for instance.
Oct 16 09:56:02 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:56:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4abd54b7-e262-460e-90d5-138d2264d056 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:56:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4abd54b7-e262-460e-90d5-138d2264d056 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:56:03 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-4abd54b7-e262-460e-90d5-138d2264d056 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:56:03 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-4abd54b7-e262-460e-90d5-138d2264d056 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:56:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4abd54b7-e262-460e-90d5-138d2264d056 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.597s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:56:03 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-4abd54b7-e262-460e-90d5-138d2264d056 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Deleted allocations for instance f3c66abd-af75-4b48-9e29-ab4335f229f3
Oct 16 09:56:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4abd54b7-e262-460e-90d5-138d2264d056 tempest-VolumesAdminNegativeTest-1903882113 tempest-VolumesAdminNegativeTest-1903882113-project-member] Lock "f3c66abd-af75-4b48-9e29-ab4335f229f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.470s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:56:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:04 user nova-compute[74342]: DEBUG nova.compute.manager [req-11087af0-7dc9-4296-af65-743bd255351d req-d78001ff-23f4-4a89-b995-a6b4883c7b45 service nova] [instance: f3c66abd-af75-4b48-9e29-ab4335f229f3] Received event network-vif-deleted-725894e9-c57a-469c-a85c-d5d9aabb805a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:56:04 user nova-compute[74342]: DEBUG nova.compute.manager [req-11087af0-7dc9-4296-af65-743bd255351d req-d78001ff-23f4-4a89-b995-a6b4883c7b45 service nova] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Received event network-vif-plugged-bebf3999-cde8-46de-93e3-f80489f3b8bf {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:56:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-11087af0-7dc9-4296-af65-743bd255351d req-d78001ff-23f4-4a89-b995-a6b4883c7b45 service nova] Acquiring lock "7f74c903-29f2-4635-bddd-c10051728f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:56:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-11087af0-7dc9-4296-af65-743bd255351d req-d78001ff-23f4-4a89-b995-a6b4883c7b45 service nova] Lock "7f74c903-29f2-4635-bddd-c10051728f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:56:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-11087af0-7dc9-4296-af65-743bd255351d req-d78001ff-23f4-4a89-b995-a6b4883c7b45 service nova] Lock "7f74c903-29f2-4635-bddd-c10051728f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:56:04 user nova-compute[74342]: DEBUG nova.compute.manager [req-11087af0-7dc9-4296-af65-743bd255351d req-d78001ff-23f4-4a89-b995-a6b4883c7b45 service nova] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] No waiting events found dispatching network-vif-plugged-bebf3999-cde8-46de-93e3-f80489f3b8bf {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:56:04 user nova-compute[74342]: WARNING nova.compute.manager [req-11087af0-7dc9-4296-af65-743bd255351d req-d78001ff-23f4-4a89-b995-a6b4883c7b45 service nova] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Received unexpected event network-vif-plugged-bebf3999-cde8-46de-93e3-f80489f3b8bf for instance with vm_state building and task_state spawning.
Oct 16 09:56:04 user nova-compute[74342]: DEBUG nova.compute.manager [req-11087af0-7dc9-4296-af65-743bd255351d req-d78001ff-23f4-4a89-b995-a6b4883c7b45 service nova] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Received event network-vif-plugged-bebf3999-cde8-46de-93e3-f80489f3b8bf {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:56:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-11087af0-7dc9-4296-af65-743bd255351d req-d78001ff-23f4-4a89-b995-a6b4883c7b45 service nova] Acquiring lock "7f74c903-29f2-4635-bddd-c10051728f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:56:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-11087af0-7dc9-4296-af65-743bd255351d req-d78001ff-23f4-4a89-b995-a6b4883c7b45 service nova] Lock "7f74c903-29f2-4635-bddd-c10051728f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:56:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-11087af0-7dc9-4296-af65-743bd255351d req-d78001ff-23f4-4a89-b995-a6b4883c7b45 service nova] Lock "7f74c903-29f2-4635-bddd-c10051728f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:56:04 user nova-compute[74342]: DEBUG nova.compute.manager [req-11087af0-7dc9-4296-af65-743bd255351d req-d78001ff-23f4-4a89-b995-a6b4883c7b45 service nova] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] No waiting events found dispatching network-vif-plugged-bebf3999-cde8-46de-93e3-f80489f3b8bf {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:56:04 user nova-compute[74342]: WARNING nova.compute.manager [req-11087af0-7dc9-4296-af65-743bd255351d req-d78001ff-23f4-4a89-b995-a6b4883c7b45 service nova] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Received unexpected event network-vif-plugged-bebf3999-cde8-46de-93e3-f80489f3b8bf for instance with vm_state building and task_state spawning.
Oct 16 09:56:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:06 user nova-compute[74342]: DEBUG nova.compute.manager [req-f094a270-3d39-4d4a-a24a-bb235ffe1ed3 req-93f690b5-2d48-467e-b505-75c588dcf361 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Received event network-vif-plugged-2f21663b-c324-4ed7-80ff-fedf6e5631c8 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:56:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f094a270-3d39-4d4a-a24a-bb235ffe1ed3 req-93f690b5-2d48-467e-b505-75c588dcf361 service nova] Acquiring lock "eeee39f2-9728-4114-8bd3-1d05f69a1215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:56:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f094a270-3d39-4d4a-a24a-bb235ffe1ed3 req-93f690b5-2d48-467e-b505-75c588dcf361 service nova] Lock "eeee39f2-9728-4114-8bd3-1d05f69a1215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:56:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f094a270-3d39-4d4a-a24a-bb235ffe1ed3 req-93f690b5-2d48-467e-b505-75c588dcf361 service nova] Lock "eeee39f2-9728-4114-8bd3-1d05f69a1215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:56:06 user nova-compute[74342]: DEBUG nova.compute.manager [req-f094a270-3d39-4d4a-a24a-bb235ffe1ed3 req-93f690b5-2d48-467e-b505-75c588dcf361 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] No waiting events found dispatching network-vif-plugged-2f21663b-c324-4ed7-80ff-fedf6e5631c8 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:56:06 user nova-compute[74342]: WARNING nova.compute.manager [req-f094a270-3d39-4d4a-a24a-bb235ffe1ed3 req-93f690b5-2d48-467e-b505-75c588dcf361 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Received unexpected event network-vif-plugged-2f21663b-c324-4ed7-80ff-fedf6e5631c8 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 16 09:56:06 user nova-compute[74342]: DEBUG nova.compute.manager [req-f094a270-3d39-4d4a-a24a-bb235ffe1ed3 req-93f690b5-2d48-467e-b505-75c588dcf361 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Received event network-vif-plugged-2f21663b-c324-4ed7-80ff-fedf6e5631c8 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:56:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f094a270-3d39-4d4a-a24a-bb235ffe1ed3 req-93f690b5-2d48-467e-b505-75c588dcf361 service nova] Acquiring lock "eeee39f2-9728-4114-8bd3-1d05f69a1215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:56:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f094a270-3d39-4d4a-a24a-bb235ffe1ed3 req-93f690b5-2d48-467e-b505-75c588dcf361 service nova] Lock "eeee39f2-9728-4114-8bd3-1d05f69a1215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:56:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f094a270-3d39-4d4a-a24a-bb235ffe1ed3 req-93f690b5-2d48-467e-b505-75c588dcf361 service nova] Lock "eeee39f2-9728-4114-8bd3-1d05f69a1215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:56:06 user nova-compute[74342]: DEBUG nova.compute.manager [req-f094a270-3d39-4d4a-a24a-bb235ffe1ed3 req-93f690b5-2d48-467e-b505-75c588dcf361 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] No waiting events found dispatching network-vif-plugged-2f21663b-c324-4ed7-80ff-fedf6e5631c8 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:56:06 user nova-compute[74342]: WARNING nova.compute.manager [req-f094a270-3d39-4d4a-a24a-bb235ffe1ed3 req-93f690b5-2d48-467e-b505-75c588dcf361 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Received unexpected event network-vif-plugged-2f21663b-c324-4ed7-80ff-fedf6e5631c8 for instance with vm_state shelved_offloaded and task_state spawning.
Oct 16 09:56:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:07 user nova-compute[74342]: DEBUG nova.compute.manager [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:56:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:56:07 user nova-compute[74342]: DEBUG nova.compute.manager [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:56:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:56:07 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Instance spawned successfully.
Oct 16 09:56:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:56:07 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Instance spawned successfully.
Oct 16 09:56:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:56:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:56:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:56:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:56:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:56:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:56:07 user nova-compute[74342]: INFO nova.compute.manager [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Took 9.75 seconds to spawn the instance on the hypervisor.
Oct 16 09:56:07 user nova-compute[74342]: DEBUG nova.compute.manager [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:56:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:08 user nova-compute[74342]: INFO nova.compute.manager [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Took 10.99 seconds to build instance.
Oct 16 09:56:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a9687a06-a0a1-4cfe-a467-028dedbae434 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "7f74c903-29f2-4635-bddd-c10051728f47" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.111s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:56:08 user nova-compute[74342]: DEBUG nova.compute.manager [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:56:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4381b83b-037f-4f05-9623-8bbf64d16ae5 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "eeee39f2-9728-4114-8bd3-1d05f69a1215" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 54.951s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:56:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:56:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 09:56:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 09:56:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 09:56:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:18 user nova-compute[74342]: DEBUG nova.compute.manager [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 09:56:18 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:56:18 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Creating image(s)
Oct 16 09:56:18 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Did not create local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 09:56:18 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Ensure instance console log exists: /opt/stack/data/nova/instances/68bdaec6-80d1-48c9-9d00-8dfdc17d52c4/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:56:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:56:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:56:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:56:18 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Start _get_guest_xml network_info=[{"id": "3cf47650-a8a5-4167-9b06-07436094d93b", "address": "fa:16:3e:ed:06:03", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf47650-a8", "ovs_interfaceid": "3cf47650-a8a5-4167-9b06-07436094d93b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'attachment_id': '687e9b0b-7979-4bb2-8901-451f7e0dff76', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWtjoUxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '68bdaec6-80d1-48c9-9d00-8dfdc17d52c4', 'attached_at': '', 'detached_at': '', 'volume_id': '2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa', 'serial': '2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa'}, 'volume_type': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:56:18 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:56:18 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:56:18 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:56:18 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:56:18 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:56:18 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:56:18 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:56:18 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:56:18 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:56:18 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:56:18 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:56:18 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:56:18 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:56:18 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:56:18 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:56:18 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:56:18 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:56:18 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWtjoUxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:56:19 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:56:19 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:56:19 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:56:19 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:56:19 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc4b43da-b402-4960-94cc-bd9ca0bccb24]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 09:56:19 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a785f3-4dd3-476e-b4ee-ab9b7d348585]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa] added
Oct 16 09:56:19 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0fa2c2d-9474-4d02-9951-a7fd7f90a5e8]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6de0eebe-0706-4fe5-bdd4-2a7309ed19d8]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eWtjoUxZ {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eWtjoUxZ" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43b514c-6960-4c1b-a789-d1cf4dd736b3]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eWtjoUxZ'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bc03f52-b3ab-4158-a20d-7b378e4fdde4]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebddadc0-57f5-4367-b338-535cfea90de4]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b50ae0-91cf-4aa9-b38e-1b731a967373 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5e5bde-62d4-4d7d-aa1d-8185b5fe0676 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:56:19 user nova-compute[74342]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:56:19 user nova-compute[74342]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b50ae0-91cf-4aa9-b38e-1b731a967373 (non-flash)
Oct 16 09:56:19 user nova-compute[74342]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)
Oct 16 09:56:19 user nova-compute[74342]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5e5bde-62d4-4d7d-aa1d-8185b5fe0676 (non-flash)
Oct 16 09:56:19 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:56:19 user nova-compute[74342]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:56:19 user nova-compute[74342]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b50ae0-91cf-4aa9-b38e-1b731a967373 (non-flash)
Oct 16 09:56:19 user nova-compute[74342]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)
Oct 16 09:56:19 user nova-compute[74342]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5e5bde-62d4-4d7d-aa1d-8185b5fe0676 (non-flash)
Oct 16 09:56:19 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa -p 172.16.0.220:3260 --login" returned: 0 in 0.089s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f18ac7f-4a17-44df-ba43-9d202a5c7f8a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa, portal: 172.16.0.220,3260]
Oct 16 09:56:19 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa, portal: 172.16.0.220,3260] successful.
Oct 16 09:56:19 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[23df670e-3f1d-4410-85dc-a9df4762e826]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c2a796-1ffb-4cad-b415-8e1d691cd804]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b50ae0-91cf-4aa9-b38e-1b731a967373 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5e5bde-62d4-4d7d-aa1d-8185b5fe0676 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:56:19 user nova-compute[74342]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:56:19 user nova-compute[74342]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b50ae0-91cf-4aa9-b38e-1b731a967373 (non-flash)
Oct 16 09:56:19 user nova-compute[74342]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)
Oct 16 09:56:19 user nova-compute[74342]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5e5bde-62d4-4d7d-aa1d-8185b5fe0676 (non-flash)
Oct 16 09:56:19 user nova-compute[74342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa (non-flash)
Oct 16 09:56:19 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:56:19 user nova-compute[74342]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:56:19 user nova-compute[74342]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b50ae0-91cf-4aa9-b38e-1b731a967373 (non-flash)
Oct 16 09:56:19 user nova-compute[74342]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)
Oct 16 09:56:19 user nova-compute[74342]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5e5bde-62d4-4d7d-aa1d-8185b5fe0676 (non-flash)
Oct 16 09:56:19 user nova-compute[74342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa (non-flash)
Oct 16 09:56:19 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] HCTL ('38', '-', '-', 0) found on session 21 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.030s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac0a4720-6e67-472a-8066-648a5c568bed]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Searching for a device in session 21 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:56:19 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWtjoUxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "2522364c-36c7-446d-87e7-113632ceeab6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "2522364c-36c7-446d-87e7-113632ceeab6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "2522364c-36c7-446d-87e7-113632ceeab6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "2522364c-36c7-446d-87e7-113632ceeab6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "2522364c-36c7-446d-87e7-113632ceeab6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:56:20 user nova-compute[74342]: INFO nova.compute.manager [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Terminating instance
Oct 16 09:56:20 user nova-compute[74342]: DEBUG nova.compute.manager [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.414s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '23463386461303430', 'path': '/dev/sdg'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23463386461303430', 'path': '/dev/sdg'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-324445140',display_name='tempest-TestVolumeBootPattern-server-324445140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-324445140',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='799c265b3d14465a9ca6bd7d5e8a4488',ramdisk_id='',reservation_id='r-j2r0ilok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-158744824',owner_user_name='tempest-TestVolumeBootPattern-158744824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:55:50Z,user_data=None,user_id='2cac31e799b743359b93943b68b38acf',uuid=68bdaec6-80d1-48c9-9d00-8dfdc17d52c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cf47650-a8a5-4167-9b06-07436094d93b", "address": "fa:16:3e:ed:06:03", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf47650-a8", "ovs_interfaceid": "3cf47650-a8a5-4167-9b06-07436094d93b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converting VIF {"id": "3cf47650-a8a5-4167-9b06-07436094d93b", "address": "fa:16:3e:ed:06:03", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf47650-a8", "ovs_interfaceid": "3cf47650-a8a5-4167-9b06-07436094d93b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:06:03,bridge_name='br-int',has_traffic_filtering=True,id=3cf47650-a8a5-4167-9b06-07436094d93b,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cf47650-a8') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG nova.objects.instance [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lazy-loading 'pci_devices' on Instance uuid 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:56:20 user nova-compute[74342]:   <uuid>68bdaec6-80d1-48c9-9d00-8dfdc17d52c4</uuid>
Oct 16 09:56:20 user nova-compute[74342]:   <name>instance-0000001b</name>
Oct 16 09:56:20 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:56:20 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:56:20 user nova-compute[74342]:   <metadata>
Oct 16 09:56:20 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:56:20 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:56:20 user nova-compute[74342]:       <nova:name>tempest-TestVolumeBootPattern-server-324445140</nova:name>
Oct 16 09:56:20 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:56:18</nova:creationTime>
Oct 16 09:56:20 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:56:20 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:56:20 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:56:20 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:56:20 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:56:20 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:56:20 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:56:20 user nova-compute[74342]:       <nova:owner>
Oct 16 09:56:20 user nova-compute[74342]:         <nova:user uuid="2cac31e799b743359b93943b68b38acf">tempest-TestVolumeBootPattern-158744824-project-member</nova:user>
Oct 16 09:56:20 user nova-compute[74342]:         <nova:project uuid="799c265b3d14465a9ca6bd7d5e8a4488">tempest-TestVolumeBootPattern-158744824</nova:project>
Oct 16 09:56:20 user nova-compute[74342]:       </nova:owner>
Oct 16 09:56:20 user nova-compute[74342]:       <nova:ports>
Oct 16 09:56:20 user nova-compute[74342]:         <nova:port uuid="3cf47650-a8a5-4167-9b06-07436094d93b">
Oct 16 09:56:20 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 16 09:56:20 user nova-compute[74342]:         </nova:port>
Oct 16 09:56:20 user nova-compute[74342]:       </nova:ports>
Oct 16 09:56:20 user nova-compute[74342]:     </nova:instance>
Oct 16 09:56:20 user nova-compute[74342]:   </metadata>
Oct 16 09:56:20 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:56:20 user nova-compute[74342]:     <system>
Oct 16 09:56:20 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:56:20 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:56:20 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:56:20 user nova-compute[74342]:       <entry name="serial">68bdaec6-80d1-48c9-9d00-8dfdc17d52c4</entry>
Oct 16 09:56:20 user nova-compute[74342]:       <entry name="uuid">68bdaec6-80d1-48c9-9d00-8dfdc17d52c4</entry>
Oct 16 09:56:20 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:56:20 user nova-compute[74342]:     </system>
Oct 16 09:56:20 user nova-compute[74342]:   </sysinfo>
Oct 16 09:56:20 user nova-compute[74342]:   <os>
Oct 16 09:56:20 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:56:20 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:56:20 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:56:20 user nova-compute[74342]:   </os>
Oct 16 09:56:20 user nova-compute[74342]:   <features>
Oct 16 09:56:20 user nova-compute[74342]:     <acpi/>
Oct 16 09:56:20 user nova-compute[74342]:     <apic/>
Oct 16 09:56:20 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:56:20 user nova-compute[74342]:   </features>
Oct 16 09:56:20 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:56:20 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:56:20 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:56:20 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:56:20 user nova-compute[74342]:   </clock>
Oct 16 09:56:20 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:56:20 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:56:20 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:56:20 user nova-compute[74342]:   </cpu>
Oct 16 09:56:20 user nova-compute[74342]:   <devices>
Oct 16 09:56:20 user nova-compute[74342]:     <disk type="block" device="disk">
Oct 16 09:56:20 user nova-compute[74342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:56:20 user nova-compute[74342]:       <source dev="/dev/sdg"/>
Oct 16 09:56:20 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:56:20 user nova-compute[74342]:       <serial>2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa</serial>
Oct 16 09:56:20 user nova-compute[74342]:     </disk>
Oct 16 09:56:20 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:56:20 user nova-compute[74342]:       <mac address="fa:16:3e:ed:06:03"/>
Oct 16 09:56:20 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:56:20 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:56:20 user nova-compute[74342]:       <target dev="tap3cf47650-a8"/>
Oct 16 09:56:20 user nova-compute[74342]:     </interface>
Oct 16 09:56:20 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:56:20 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/68bdaec6-80d1-48c9-9d00-8dfdc17d52c4/console.log" append="off"/>
Oct 16 09:56:20 user nova-compute[74342]:     </serial>
Oct 16 09:56:20 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:56:20 user nova-compute[74342]:     <video>
Oct 16 09:56:20 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:56:20 user nova-compute[74342]:     </video>
Oct 16 09:56:20 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:56:20 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:56:20 user nova-compute[74342]:     </rng>
Oct 16 09:56:20 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:56:20 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:56:20 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:56:20 user nova-compute[74342]:     </memballoon>
Oct 16 09:56:20 user nova-compute[74342]:   </devices>
Oct 16 09:56:20 user nova-compute[74342]: </domain>
Oct 16 09:56:20 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-324445140',display_name='tempest-TestVolumeBootPattern-server-324445140',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-324445140',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='799c265b3d14465a9ca6bd7d5e8a4488',ramdisk_id='',reservation_id='r-j2r0ilok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-158744824',owner_user_name='tempest-TestVolumeBootPattern-158744824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:55:50Z,user_data=None,user_id='2cac31e799b743359b93943b68b38acf',uuid=68bdaec6-80d1-48c9-9d00-8dfdc17d52c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3cf47650-a8a5-4167-9b06-07436094d93b", "address": "fa:16:3e:ed:06:03", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf47650-a8", "ovs_interfaceid": "3cf47650-a8a5-4167-9b06-07436094d93b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converting VIF {"id": "3cf47650-a8a5-4167-9b06-07436094d93b", "address": "fa:16:3e:ed:06:03", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf47650-a8", "ovs_interfaceid": "3cf47650-a8a5-4167-9b06-07436094d93b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:06:03,bridge_name='br-int',has_traffic_filtering=True,id=3cf47650-a8a5-4167-9b06-07436094d93b,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cf47650-a8') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG os_vif [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:06:03,bridge_name='br-int',has_traffic_filtering=True,id=3cf47650-a8a5-4167-9b06-07436094d93b,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cf47650-a8') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '589e9822-430b-5c3d-a8fe-c4c888611117', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG nova.compute.manager [req-b1c94df5-dbcd-49e5-87c3-3ddb47a941de req-a719f37d-f26d-4474-be50-d53c55e865b9 service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Received event network-vif-unplugged-975f1cad-dbc7-462f-9702-55567afd639b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b1c94df5-dbcd-49e5-87c3-3ddb47a941de req-a719f37d-f26d-4474-be50-d53c55e865b9 service nova] Acquiring lock "2522364c-36c7-446d-87e7-113632ceeab6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b1c94df5-dbcd-49e5-87c3-3ddb47a941de req-a719f37d-f26d-4474-be50-d53c55e865b9 service nova] Lock "2522364c-36c7-446d-87e7-113632ceeab6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b1c94df5-dbcd-49e5-87c3-3ddb47a941de req-a719f37d-f26d-4474-be50-d53c55e865b9 service nova] Lock "2522364c-36c7-446d-87e7-113632ceeab6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG nova.compute.manager [req-b1c94df5-dbcd-49e5-87c3-3ddb47a941de req-a719f37d-f26d-4474-be50-d53c55e865b9 service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] No waiting events found dispatching network-vif-unplugged-975f1cad-dbc7-462f-9702-55567afd639b {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG nova.compute.manager [req-b1c94df5-dbcd-49e5-87c3-3ddb47a941de req-a719f37d-f26d-4474-be50-d53c55e865b9 service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Received event network-vif-unplugged-975f1cad-dbc7-462f-9702-55567afd639b for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3cf47650-a8, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3cf47650-a8, col_values=(('qos', UUID('aed0ac77-489e-4a58-8314-88aacaace281')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3cf47650-a8, col_values=(('external_ids', {'iface-id': '3cf47650-a8a5-4167-9b06-07436094d93b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:06:03', 'vm-uuid': '68bdaec6-80d1-48c9-9d00-8dfdc17d52c4'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:20 user nova-compute[74342]: INFO os_vif [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:06:03,bridge_name='br-int',has_traffic_filtering=True,id=3cf47650-a8a5-4167-9b06-07436094d93b,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cf47650-a8')
Oct 16 09:56:20 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] No VIF found with MAC fa:16:3e:ed:06:03, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:21 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Instance destroyed successfully.
Oct 16 09:56:21 user nova-compute[74342]: DEBUG nova.objects.instance [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lazy-loading 'resources' on Instance uuid 2522364c-36c7-446d-87e7-113632ceeab6 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:50:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1187825465',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1187825465',id=19,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:52:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4fcf2437a2d413ea584d0cc2508bed3',ramdisk_id='',reservation_id='r-cy1bowxe',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-476995503',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:54:34Z,user_data=None,user_id='f90f091b76254a13957807feaeaef3fc',uuid=2522364c-36c7-446d-87e7-113632ceeab6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "975f1cad-dbc7-462f-9702-55567afd639b", "address": "fa:16:3e:18:9d:9a", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap975f1cad-db", "ovs_interfaceid": "975f1cad-dbc7-462f-9702-55567afd639b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Converting VIF {"id": "975f1cad-dbc7-462f-9702-55567afd639b", "address": "fa:16:3e:18:9d:9a", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap975f1cad-db", "ovs_interfaceid": "975f1cad-dbc7-462f-9702-55567afd639b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:9d:9a,bridge_name='br-int',has_traffic_filtering=True,id=975f1cad-dbc7-462f-9702-55567afd639b,network=Network(a571ad70-6f8b-4b02-86b9-df50290509f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap975f1cad-db') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG os_vif [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:9d:9a,bridge_name='br-int',has_traffic_filtering=True,id=975f1cad-dbc7-462f-9702-55567afd639b,network=Network(a571ad70-6f8b-4b02-86b9-df50290509f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap975f1cad-db') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap975f1cad-db, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ef8f9e7c-16a3-43eb-8c46-fcc8a30bf692) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:21 user nova-compute[74342]: INFO os_vif [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:9d:9a,bridge_name='br-int',has_traffic_filtering=True,id=975f1cad-dbc7-462f-9702-55567afd639b,network=Network(a571ad70-6f8b-4b02-86b9-df50290509f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap975f1cad-db')
Oct 16 09:56:21 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xSlhtdYW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:56:21 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:56:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.062s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40fb60f-1c76-4b9b-8395-c0075a8034ad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17b50ae0-91cf-4aa9-b38e-1b731a967373\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6a5e5bde-62d4-4d7d-aa1d-8185b5fe0676\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 09:56:21 user nova-compute[74342]: No targets found.
Oct 16 09:56:21 user nova-compute[74342]: iSNS:
Oct 16 09:56:21 user nova-compute[74342]: No targets found.
Oct 16 09:56:21 user nova-compute[74342]: STATIC:
Oct 16 09:56:21 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea
Oct 16 09:56:21 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:56:21 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:56:21 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3
Oct 16 09:56:21 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:56:21 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:56:21 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:17b50ae0-91cf-4aa9-b38e-1b731a967373
Oct 16 09:56:21 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:56:21 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:56:21 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43
Oct 16 09:56:21 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:56:21 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:56:21 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:6a5e5bde-62d4-4d7d-aa1d-8185b5fe0676
Oct 16 09:56:21 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:56:21 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:56:21 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa
Oct 16 09:56:21 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:56:21 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:56:21 user nova-compute[74342]: FIRMWARE:
Oct 16 09:56:21 user nova-compute[74342]: No targets found.
Oct 16 09:56:21 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 09:56:21 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 09:56:21 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb76d856-713c-4418-ad9f-d3cf2c10ebfb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17b50ae0-91cf-4aa9-b38e-1b731a967373\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6a5e5bde-62d4-4d7d-aa1d-8185b5fe0676\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[da3fd2bd-0fd6-485e-90cd-3300b23f329b]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b50ae0-91cf-4aa9-b38e-1b731a967373 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5e5bde-62d4-4d7d-aa1d-8185b5fe0676 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:56:21 user nova-compute[74342]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:56:21 user nova-compute[74342]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b50ae0-91cf-4aa9-b38e-1b731a967373 (non-flash)
Oct 16 09:56:21 user nova-compute[74342]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)
Oct 16 09:56:21 user nova-compute[74342]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5e5bde-62d4-4d7d-aa1d-8185b5fe0676 (non-flash)
Oct 16 09:56:21 user nova-compute[74342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa (non-flash)
Oct 16 09:56:21 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea (non-flash)
Oct 16 09:56:21 user nova-compute[74342]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:56:21 user nova-compute[74342]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17b50ae0-91cf-4aa9-b38e-1b731a967373 (non-flash)
Oct 16 09:56:21 user nova-compute[74342]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)
Oct 16 09:56:21 user nova-compute[74342]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5e5bde-62d4-4d7d-aa1d-8185b5fe0676 (non-flash)
Oct 16 09:56:21 user nova-compute[74342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa (non-flash)
Oct 16 09:56:21 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b602720e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea'): ({'sdd'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Removing single pathed devices sdd {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec95aafb-e9b3-4af3-bba4-c944d979e893]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2791c835-386e-44bb-baac-f3d36e7ec43c]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Flushing IO for device /dev/sdd {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[73134b8c-9b34-4e8c-a5a6-f4ddc41fb24f]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a650ef-765f-43be-9d96-89123a6509c3]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] SCSI volumes sdd have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:22 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa618871-78e7-4c8f-b918-65c7a0887fef]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:22 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbaeadc5-de3c-4a0e-b1e3-6e69972b75d2]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea, portal: 172.16.0.220,3260]
Oct 16 09:56:22 user nova-compute[74342]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea, portal: 172.16.0.220,3260] successful.
Oct 16 09:56:22 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bffc475-b62a-4b57-ab2c-1d23cf21e1ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.043s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:22 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67ba998-fcb9-4b71-ae31-07c404c62faa]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.511s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:56:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] <== disconnect_volume: return (515ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:56:22 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 09:56:22 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Deleting instance files /opt/stack/data/nova/instances/2522364c-36c7-446d-87e7-113632ceeab6_del
Oct 16 09:56:22 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Deletion of /opt/stack/data/nova/instances/2522364c-36c7-446d-87e7-113632ceeab6_del complete
Oct 16 09:56:22 user nova-compute[74342]: INFO nova.compute.manager [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Took 2.03 seconds to destroy the instance on the hypervisor.
Oct 16 09:56:22 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 09:56:22 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 09:56:22 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 09:56:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:22 user nova-compute[74342]: DEBUG nova.compute.manager [req-00f08a76-e9cd-43b0-9c29-2bd50c522a9a req-2166bb58-32ce-4add-b384-775f0101558a service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Received event network-vif-plugged-975f1cad-dbc7-462f-9702-55567afd639b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:56:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-00f08a76-e9cd-43b0-9c29-2bd50c522a9a req-2166bb58-32ce-4add-b384-775f0101558a service nova] Acquiring lock "2522364c-36c7-446d-87e7-113632ceeab6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:56:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-00f08a76-e9cd-43b0-9c29-2bd50c522a9a req-2166bb58-32ce-4add-b384-775f0101558a service nova] Lock "2522364c-36c7-446d-87e7-113632ceeab6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:56:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-00f08a76-e9cd-43b0-9c29-2bd50c522a9a req-2166bb58-32ce-4add-b384-775f0101558a service nova] Lock "2522364c-36c7-446d-87e7-113632ceeab6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:56:22 user nova-compute[74342]: DEBUG nova.compute.manager [req-00f08a76-e9cd-43b0-9c29-2bd50c522a9a req-2166bb58-32ce-4add-b384-775f0101558a service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] No waiting events found dispatching network-vif-plugged-975f1cad-dbc7-462f-9702-55567afd639b {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:56:22 user nova-compute[74342]: WARNING nova.compute.manager [req-00f08a76-e9cd-43b0-9c29-2bd50c522a9a req-2166bb58-32ce-4add-b384-775f0101558a service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Received unexpected event network-vif-plugged-975f1cad-dbc7-462f-9702-55567afd639b for instance with vm_state active and task_state deleting.
Oct 16 09:56:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:23 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:56:23 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Took 0.96 seconds to deallocate network for instance.
Oct 16 09:56:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:24 user nova-compute[74342]: INFO nova.compute.manager [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Took 1.14 seconds to detach 1 volumes for instance.
Oct 16 09:56:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:56:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:56:24 user nova-compute[74342]: DEBUG nova.compute.manager [req-c32a174d-1132-4287-8318-9960bff02f1e req-0ca200d4-9394-44aa-b35e-d380925cd9a1 service nova] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Received event network-vif-plugged-3cf47650-a8a5-4167-9b06-07436094d93b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:56:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c32a174d-1132-4287-8318-9960bff02f1e req-0ca200d4-9394-44aa-b35e-d380925cd9a1 service nova] Acquiring lock "68bdaec6-80d1-48c9-9d00-8dfdc17d52c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:56:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c32a174d-1132-4287-8318-9960bff02f1e req-0ca200d4-9394-44aa-b35e-d380925cd9a1 service nova] Lock "68bdaec6-80d1-48c9-9d00-8dfdc17d52c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:56:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c32a174d-1132-4287-8318-9960bff02f1e req-0ca200d4-9394-44aa-b35e-d380925cd9a1 service nova] Lock "68bdaec6-80d1-48c9-9d00-8dfdc17d52c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:56:24 user nova-compute[74342]: DEBUG nova.compute.manager [req-c32a174d-1132-4287-8318-9960bff02f1e req-0ca200d4-9394-44aa-b35e-d380925cd9a1 service nova] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] No waiting events found dispatching network-vif-plugged-3cf47650-a8a5-4167-9b06-07436094d93b {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:56:24 user nova-compute[74342]: WARNING nova.compute.manager [req-c32a174d-1132-4287-8318-9960bff02f1e req-0ca200d4-9394-44aa-b35e-d380925cd9a1 service nova] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Received unexpected event network-vif-plugged-3cf47650-a8a5-4167-9b06-07436094d93b for instance with vm_state building and task_state spawning.
Oct 16 09:56:24 user nova-compute[74342]: DEBUG nova.compute.manager [req-c32a174d-1132-4287-8318-9960bff02f1e req-0ca200d4-9394-44aa-b35e-d380925cd9a1 service nova] [instance: 2522364c-36c7-446d-87e7-113632ceeab6] Received event network-vif-deleted-975f1cad-dbc7-462f-9702-55567afd639b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:56:24 user nova-compute[74342]: DEBUG nova.compute.manager [req-c32a174d-1132-4287-8318-9960bff02f1e req-0ca200d4-9394-44aa-b35e-d380925cd9a1 service nova] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Received event network-vif-plugged-3cf47650-a8a5-4167-9b06-07436094d93b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:56:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c32a174d-1132-4287-8318-9960bff02f1e req-0ca200d4-9394-44aa-b35e-d380925cd9a1 service nova] Acquiring lock "68bdaec6-80d1-48c9-9d00-8dfdc17d52c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:56:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c32a174d-1132-4287-8318-9960bff02f1e req-0ca200d4-9394-44aa-b35e-d380925cd9a1 service nova] Lock "68bdaec6-80d1-48c9-9d00-8dfdc17d52c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:56:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c32a174d-1132-4287-8318-9960bff02f1e req-0ca200d4-9394-44aa-b35e-d380925cd9a1 service nova] Lock "68bdaec6-80d1-48c9-9d00-8dfdc17d52c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:56:24 user nova-compute[74342]: DEBUG nova.compute.manager [req-c32a174d-1132-4287-8318-9960bff02f1e req-0ca200d4-9394-44aa-b35e-d380925cd9a1 service nova] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] No waiting events found dispatching network-vif-plugged-3cf47650-a8a5-4167-9b06-07436094d93b {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:56:24 user nova-compute[74342]: WARNING nova.compute.manager [req-c32a174d-1132-4287-8318-9960bff02f1e req-0ca200d4-9394-44aa-b35e-d380925cd9a1 service nova] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Received unexpected event network-vif-plugged-3cf47650-a8a5-4167-9b06-07436094d93b for instance with vm_state building and task_state spawning.
Oct 16 09:56:25 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:56:25 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:56:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.769s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:56:25 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Deleted allocations for instance 2522364c-36c7-446d-87e7-113632ceeab6
Oct 16 09:56:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-796a6c7b-7c18-4d07-bcde-718f00203c2c tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "2522364c-36c7-446d-87e7-113632ceeab6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.190s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:56:25 user nova-compute[74342]: DEBUG nova.compute.manager [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:56:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:56:25 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Instance spawned successfully.
Oct 16 09:56:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:56:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:56:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:56:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:56:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:56:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:56:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:56:25 user nova-compute[74342]: INFO nova.compute.manager [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Took 6.81 seconds to spawn the instance on the hypervisor.
Oct 16 09:56:25 user nova-compute[74342]: DEBUG nova.compute.manager [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:56:25 user nova-compute[74342]: INFO nova.compute.manager [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Took 37.42 seconds to build instance.
Oct 16 09:56:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cd4164e4-2f11-41b5-82e8-dda7f35d08a0 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "68bdaec6-80d1-48c9-9d00-8dfdc17d52c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.537s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:56:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG nova.compute.manager [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:56:32 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Creating image(s)
Oct 16 09:56:32 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Did not create local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Ensure instance console log exists: /opt/stack/data/nova/instances/aa116cab-861b-459d-b1eb-6f07e5d71e30/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Start _get_guest_xml network_info=[{"id": "480ecd6b-63b3-43be-8c76-98216f55e06a", "address": "fa:16:3e:5c:87:e5", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480ecd6b-63", "ovs_interfaceid": "480ecd6b-63b3-43be-8c76-98216f55e06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'attachment_id': 'f5128b52-ea9d-4433-9aaf-ba685579b190', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CoeJBEON', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'aa116cab-861b-459d-b1eb-6f07e5d71e30', 'attached_at': '', 'detached_at': '', 'volume_id': 'e645e4f7-6f67-4461-a2e7-8195c5b246a8', 'serial': 'e645e4f7-6f67-4461-a2e7-8195c5b246a8'}, 'volume_type': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:56:32 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:56:32 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:56:32 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CoeJBEON', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:56:32 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:56:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:56:32 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:56:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:56:32 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6124406d-09d9-4f8b-b549-bd93f8c69d78]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 09:56:32 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8c8fb6-fcdc-4d6c-8759-eaf28e411309]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8] added
Oct 16 09:56:32 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5e902d-1670-40c8-b239-1f80576e2c21]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7385765c-f117-4d6a-a4ff-17378ea4cc48]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CoeJBEON {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CoeJBEON" returned: 0 in 0.027s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cca4323-d7a9-48e5-a34d-e2d034f8e91e]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CoeJBEON'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.029s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[33dba4dd-ac7c-4e9c-aa80-a553ccbbee05]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[21dff6a6-9cc8-416b-8074-9bceb67b45c1]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5e5bde-62d4-4d7d-aa1d-8185b5fe0676 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:56:32 user nova-compute[74342]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)
Oct 16 09:56:32 user nova-compute[74342]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5e5bde-62d4-4d7d-aa1d-8185b5fe0676 (non-flash)
Oct 16 09:56:32 user nova-compute[74342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa (non-flash)
Oct 16 09:56:32 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:56:32 user nova-compute[74342]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)
Oct 16 09:56:32 user nova-compute[74342]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5e5bde-62d4-4d7d-aa1d-8185b5fe0676 (non-flash)
Oct 16 09:56:32 user nova-compute[74342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa (non-flash)
Oct 16 09:56:32 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4736e8b8-35e5-46af-87e4-aade49e5279a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8, portal: 172.16.0.220,3260]
Oct 16 09:56:32 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8, portal: 172.16.0.220,3260] successful.
Oct 16 09:56:32 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3144e4e-e804-4aed-bd32-31142670bebe]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1fa775-3f83-440f-87fc-9b3b1c099ff7]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5e5bde-62d4-4d7d-aa1d-8185b5fe0676 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:56:32 user nova-compute[74342]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)
Oct 16 09:56:32 user nova-compute[74342]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5e5bde-62d4-4d7d-aa1d-8185b5fe0676 (non-flash)
Oct 16 09:56:32 user nova-compute[74342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa (non-flash)
Oct 16 09:56:32 user nova-compute[74342]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 09:56:32 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:56:32 user nova-compute[74342]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)
Oct 16 09:56:32 user nova-compute[74342]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6a5e5bde-62d4-4d7d-aa1d-8185b5fe0676 (non-flash)
Oct 16 09:56:32 user nova-compute[74342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa (non-flash)
Oct 16 09:56:32 user nova-compute[74342]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 09:56:32 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.401s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] HCTL ('34', '-', '-', 0) found on session 22 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd41102-c145-4066-aa41-90c72fcfc3ee]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Searching for a device in session 22 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CoeJBEON', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 09:56:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.460s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:56:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] <== connect_volume: return (1461ms) {'type': 'block', 'scsi_wwn': '23264303130306234', 'path': '/dev/sdc'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:56:33 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264303130306234', 'path': '/dev/sdc'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 09:56:33 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1222282830',display_name='tempest-ServerActionsTestOtherA-server-1222282830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1222282830',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5Nn7Cd9XA4JGuwKexWOVVgfutTMETbY1OUIw/2Lg/7f8J0Bw2Ei1JnC+VmVg9p5to1vwEeuuESoLWsMybdIS98JRtnBeQn9/1YcrhMFyK9tNXAGp/a4/hIqjXfamZ4kQ==',key_name='tempest-keypair-772403242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='355bac247f9d4ea8b3c2f0d87453f4c1',ramdisk_id='',reservation_id='r-g85xdm18',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1004911708',owner_user_name='tempest-ServerActionsTestOtherA-1004911708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:55:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3c728429a0a42789cfc0f1251d6f623',uuid=aa116cab-861b-459d-b1eb-6f07e5d71e30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "480ecd6b-63b3-43be-8c76-98216f55e06a", "address": "fa:16:3e:5c:87:e5", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480ecd6b-63", "ovs_interfaceid": "480ecd6b-63b3-43be-8c76-98216f55e06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:56:33 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Converting VIF {"id": "480ecd6b-63b3-43be-8c76-98216f55e06a", "address": "fa:16:3e:5c:87:e5", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480ecd6b-63", "ovs_interfaceid": "480ecd6b-63b3-43be-8c76-98216f55e06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:56:33 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:87:e5,bridge_name='br-int',has_traffic_filtering=True,id=480ecd6b-63b3-43be-8c76-98216f55e06a,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480ecd6b-63') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:56:33 user nova-compute[74342]: DEBUG nova.objects.instance [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lazy-loading 'pci_devices' on Instance uuid aa116cab-861b-459d-b1eb-6f07e5d71e30 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:56:33 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:56:33 user nova-compute[74342]:   <uuid>aa116cab-861b-459d-b1eb-6f07e5d71e30</uuid>
Oct 16 09:56:33 user nova-compute[74342]:   <name>instance-0000001a</name>
Oct 16 09:56:33 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:56:33 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:56:33 user nova-compute[74342]:   <metadata>
Oct 16 09:56:33 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:56:33 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:56:33 user nova-compute[74342]:       <nova:name>tempest-ServerActionsTestOtherA-server-1222282830</nova:name>
Oct 16 09:56:33 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:56:32</nova:creationTime>
Oct 16 09:56:33 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:56:33 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:56:33 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:56:33 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:56:33 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:56:33 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:56:33 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:56:33 user nova-compute[74342]:       <nova:owner>
Oct 16 09:56:33 user nova-compute[74342]:         <nova:user uuid="e3c728429a0a42789cfc0f1251d6f623">tempest-ServerActionsTestOtherA-1004911708-project-member</nova:user>
Oct 16 09:56:33 user nova-compute[74342]:         <nova:project uuid="355bac247f9d4ea8b3c2f0d87453f4c1">tempest-ServerActionsTestOtherA-1004911708</nova:project>
Oct 16 09:56:33 user nova-compute[74342]:       </nova:owner>
Oct 16 09:56:33 user nova-compute[74342]:       <nova:ports>
Oct 16 09:56:33 user nova-compute[74342]:         <nova:port uuid="480ecd6b-63b3-43be-8c76-98216f55e06a">
Oct 16 09:56:33 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 16 09:56:33 user nova-compute[74342]:         </nova:port>
Oct 16 09:56:33 user nova-compute[74342]:       </nova:ports>
Oct 16 09:56:33 user nova-compute[74342]:     </nova:instance>
Oct 16 09:56:33 user nova-compute[74342]:   </metadata>
Oct 16 09:56:33 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:56:33 user nova-compute[74342]:     <system>
Oct 16 09:56:33 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:56:33 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:56:33 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:56:33 user nova-compute[74342]:       <entry name="serial">aa116cab-861b-459d-b1eb-6f07e5d71e30</entry>
Oct 16 09:56:33 user nova-compute[74342]:       <entry name="uuid">aa116cab-861b-459d-b1eb-6f07e5d71e30</entry>
Oct 16 09:56:33 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:56:33 user nova-compute[74342]:     </system>
Oct 16 09:56:33 user nova-compute[74342]:   </sysinfo>
Oct 16 09:56:33 user nova-compute[74342]:   <os>
Oct 16 09:56:33 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:56:33 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:56:33 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:56:33 user nova-compute[74342]:   </os>
Oct 16 09:56:33 user nova-compute[74342]:   <features>
Oct 16 09:56:33 user nova-compute[74342]:     <acpi/>
Oct 16 09:56:33 user nova-compute[74342]:     <apic/>
Oct 16 09:56:33 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:56:33 user nova-compute[74342]:   </features>
Oct 16 09:56:33 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:56:33 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:56:33 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:56:33 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:56:33 user nova-compute[74342]:   </clock>
Oct 16 09:56:33 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:56:33 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:56:33 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:56:33 user nova-compute[74342]:   </cpu>
Oct 16 09:56:33 user nova-compute[74342]:   <devices>
Oct 16 09:56:33 user nova-compute[74342]:     <disk type="block" device="disk">
Oct 16 09:56:33 user nova-compute[74342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:56:33 user nova-compute[74342]:       <source dev="/dev/sdc"/>
Oct 16 09:56:33 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:56:33 user nova-compute[74342]:       <serial>e645e4f7-6f67-4461-a2e7-8195c5b246a8</serial>
Oct 16 09:56:33 user nova-compute[74342]:     </disk>
Oct 16 09:56:33 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:56:33 user nova-compute[74342]:       <mac address="fa:16:3e:5c:87:e5"/>
Oct 16 09:56:33 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:56:33 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:56:33 user nova-compute[74342]:       <target dev="tap480ecd6b-63"/>
Oct 16 09:56:33 user nova-compute[74342]:     </interface>
Oct 16 09:56:33 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:56:33 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/aa116cab-861b-459d-b1eb-6f07e5d71e30/console.log" append="off"/>
Oct 16 09:56:33 user nova-compute[74342]:     </serial>
Oct 16 09:56:33 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:56:33 user nova-compute[74342]:     <video>
Oct 16 09:56:33 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:56:33 user nova-compute[74342]:     </video>
Oct 16 09:56:33 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:56:33 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:56:33 user nova-compute[74342]:     </rng>
Oct 16 09:56:33 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:56:33 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:56:33 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:56:33 user nova-compute[74342]:     </memballoon>
Oct 16 09:56:33 user nova-compute[74342]:   </devices>
Oct 16 09:56:33 user nova-compute[74342]: </domain>
Oct 16 09:56:33 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:56:33 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1222282830',display_name='tempest-ServerActionsTestOtherA-server-1222282830',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1222282830',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5Nn7Cd9XA4JGuwKexWOVVgfutTMETbY1OUIw/2Lg/7f8J0Bw2Ei1JnC+VmVg9p5to1vwEeuuESoLWsMybdIS98JRtnBeQn9/1YcrhMFyK9tNXAGp/a4/hIqjXfamZ4kQ==',key_name='tempest-keypair-772403242',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='355bac247f9d4ea8b3c2f0d87453f4c1',ramdisk_id='',reservation_id='r-g85xdm18',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1004911708',owner_user_name='tempest-ServerActionsTestOtherA-1004911708-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:55:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3c728429a0a42789cfc0f1251d6f623',uuid=aa116cab-861b-459d-b1eb-6f07e5d71e30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "480ecd6b-63b3-43be-8c76-98216f55e06a", "address": "fa:16:3e:5c:87:e5", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480ecd6b-63", "ovs_interfaceid": "480ecd6b-63b3-43be-8c76-98216f55e06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:56:33 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Converting VIF {"id": "480ecd6b-63b3-43be-8c76-98216f55e06a", "address": "fa:16:3e:5c:87:e5", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480ecd6b-63", "ovs_interfaceid": "480ecd6b-63b3-43be-8c76-98216f55e06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:56:33 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:87:e5,bridge_name='br-int',has_traffic_filtering=True,id=480ecd6b-63b3-43be-8c76-98216f55e06a,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480ecd6b-63') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:56:33 user nova-compute[74342]: DEBUG os_vif [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:87:e5,bridge_name='br-int',has_traffic_filtering=True,id=480ecd6b-63b3-43be-8c76-98216f55e06a,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480ecd6b-63') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:56:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:56:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a84785d8-40ca-54c5-9179-a57ab04d183c', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:56:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap480ecd6b-63, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap480ecd6b-63, col_values=(('qos', UUID('e6c4679e-764e-437b-8917-f53501cd14ab')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap480ecd6b-63, col_values=(('external_ids', {'iface-id': '480ecd6b-63b3-43be-8c76-98216f55e06a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:87:e5', 'vm-uuid': 'aa116cab-861b-459d-b1eb-6f07e5d71e30'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:56:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:33 user nova-compute[74342]: INFO os_vif [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:87:e5,bridge_name='br-int',has_traffic_filtering=True,id=480ecd6b-63b3-43be-8c76-98216f55e06a,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480ecd6b-63')
Oct 16 09:56:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:56:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] No VIF found with MAC fa:16:3e:5c:87:e5, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:56:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:35 user nova-compute[74342]: DEBUG nova.compute.manager [req-ded84ae6-7ceb-4fec-9801-20bc9cc63169 req-638013d2-abb6-41b7-a1e3-b492e7e1597f service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Received event network-vif-plugged-480ecd6b-63b3-43be-8c76-98216f55e06a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:56:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ded84ae6-7ceb-4fec-9801-20bc9cc63169 req-638013d2-abb6-41b7-a1e3-b492e7e1597f service nova] Acquiring lock "aa116cab-861b-459d-b1eb-6f07e5d71e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:56:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ded84ae6-7ceb-4fec-9801-20bc9cc63169 req-638013d2-abb6-41b7-a1e3-b492e7e1597f service nova] Lock "aa116cab-861b-459d-b1eb-6f07e5d71e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:56:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ded84ae6-7ceb-4fec-9801-20bc9cc63169 req-638013d2-abb6-41b7-a1e3-b492e7e1597f service nova] Lock "aa116cab-861b-459d-b1eb-6f07e5d71e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:56:35 user nova-compute[74342]: DEBUG nova.compute.manager [req-ded84ae6-7ceb-4fec-9801-20bc9cc63169 req-638013d2-abb6-41b7-a1e3-b492e7e1597f service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] No waiting events found dispatching network-vif-plugged-480ecd6b-63b3-43be-8c76-98216f55e06a {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:56:35 user nova-compute[74342]: WARNING nova.compute.manager [req-ded84ae6-7ceb-4fec-9801-20bc9cc63169 req-638013d2-abb6-41b7-a1e3-b492e7e1597f service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Received unexpected event network-vif-plugged-480ecd6b-63b3-43be-8c76-98216f55e06a for instance with vm_state building and task_state spawning.
Oct 16 09:56:37 user nova-compute[74342]: DEBUG nova.compute.manager [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:56:37 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:56:37 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Instance spawned successfully.
Oct 16 09:56:37 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:56:37 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:56:37 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:56:37 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:56:37 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:56:37 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:56:37 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:56:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:37 user nova-compute[74342]: DEBUG nova.compute.manager [req-5509a1e1-6302-4d25-9e3a-4588dbc50fa6 req-7d038394-0ce8-435d-879b-be65f5cd9ca4 service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Received event network-vif-plugged-480ecd6b-63b3-43be-8c76-98216f55e06a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:56:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5509a1e1-6302-4d25-9e3a-4588dbc50fa6 req-7d038394-0ce8-435d-879b-be65f5cd9ca4 service nova] Acquiring lock "aa116cab-861b-459d-b1eb-6f07e5d71e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:56:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5509a1e1-6302-4d25-9e3a-4588dbc50fa6 req-7d038394-0ce8-435d-879b-be65f5cd9ca4 service nova] Lock "aa116cab-861b-459d-b1eb-6f07e5d71e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:56:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5509a1e1-6302-4d25-9e3a-4588dbc50fa6 req-7d038394-0ce8-435d-879b-be65f5cd9ca4 service nova] Lock "aa116cab-861b-459d-b1eb-6f07e5d71e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:56:37 user nova-compute[74342]: DEBUG nova.compute.manager [req-5509a1e1-6302-4d25-9e3a-4588dbc50fa6 req-7d038394-0ce8-435d-879b-be65f5cd9ca4 service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] No waiting events found dispatching network-vif-plugged-480ecd6b-63b3-43be-8c76-98216f55e06a {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:56:37 user nova-compute[74342]: WARNING nova.compute.manager [req-5509a1e1-6302-4d25-9e3a-4588dbc50fa6 req-7d038394-0ce8-435d-879b-be65f5cd9ca4 service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Received unexpected event network-vif-plugged-480ecd6b-63b3-43be-8c76-98216f55e06a for instance with vm_state building and task_state spawning.
Oct 16 09:56:38 user nova-compute[74342]: INFO nova.compute.manager [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Took 5.76 seconds to spawn the instance on the hypervisor.
Oct 16 09:56:38 user nova-compute[74342]: DEBUG nova.compute.manager [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:56:38 user nova-compute[74342]: INFO nova.compute.manager [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Took 49.75 seconds to build instance.
Oct 16 09:56:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f13a20d5-8911-4a2a-b83a-e55c1fc07591 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "aa116cab-861b-459d-b1eb-6f07e5d71e30" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 49.883s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:56:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:42 user nova-compute[74342]: DEBUG nova.objects.instance [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'flavor' on Instance uuid 4f3aa905-8eae-45cb-8019-0b991286fe42 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:56:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "refresh_cache-4f3aa905-8eae-45cb-8019-0b991286fe42" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:56:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquired lock "refresh_cache-4f3aa905-8eae-45cb-8019-0b991286fe42" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:56:42 user nova-compute[74342]: DEBUG nova.network.neutron [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:56:42 user nova-compute[74342]: DEBUG nova.objects.instance [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'info_cache' on Instance uuid 4f3aa905-8eae-45cb-8019-0b991286fe42 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:56:42 user nova-compute[74342]: DEBUG nova.objects.base [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Object Instance<4f3aa905-8eae-45cb-8019-0b991286fe42> lazy-loaded attributes: flavor,info_cache {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 09:56:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG nova.network.neutron [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Updating instance_info_cache with network_info: [{"id": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "address": "fa:16:3e:82:00:ac", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4258aa-96", "ovs_interfaceid": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Releasing lock "refresh_cache-4f3aa905-8eae-45cb-8019-0b991286fe42" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:56:43 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Instance destroyed successfully.
Oct 16 09:56:43 user nova-compute[74342]: DEBUG nova.objects.instance [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'resources' on Instance uuid 4f3aa905-8eae-45cb-8019-0b991286fe42 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG nova.objects.base [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Object Instance<4f3aa905-8eae-45cb-8019-0b991286fe42> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1589424972',display_name='tempest-AttachVolumeTestJSON-server-1589424972',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1589424972',id=24,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBO8M7UyZeyQg1aYm+ByuTDEoeaBTTsQAFljuagcRlcGDhfx2FLzwqTOwmYqO1+0IHWLuSXoneV6tc1mCRPSiL9W+Jq0YYyfdyDE26TRgq7GChyXwYOsK9694M/+yJ6Kw==',key_name='tempest-keypair-1616245480',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:52:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c28511c6c42147db9a0992cf40e044bb',ramdisk_id='',reservation_id='r-tipl03lh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-965713551',owner_user_name='tempest-AttachVolumeTestJSON-965713551-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:54:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc0dfbfdb77347cda95ba991d37c311d',uuid=4f3aa905-8eae-45cb-8019-0b991286fe42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "address": "fa:16:3e:82:00:ac", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4258aa-96", "ovs_interfaceid": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Converting VIF {"id": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "address": "fa:16:3e:82:00:ac", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4258aa-96", "ovs_interfaceid": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:00:ac,bridge_name='br-int',has_traffic_filtering=True,id=0e4258aa-9686-4cf1-9d1a-5bf61e7ba193,network=Network(54ba0b2e-1a1f-44a4-ba26-8a96960d4165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e4258aa-96') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG os_vif [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:00:ac,bridge_name='br-int',has_traffic_filtering=True,id=0e4258aa-9686-4cf1-9d1a-5bf61e7ba193,network=Network(54ba0b2e-1a1f-44a4-ba26-8a96960d4165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e4258aa-96') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e4258aa-96, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c216aee6-ff27-4894-bbd7-58535246840d) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:43 user nova-compute[74342]: INFO os_vif [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:00:ac,bridge_name='br-int',has_traffic_filtering=True,id=0e4258aa-9686-4cf1-9d1a-5bf61e7ba193,network=Network(54ba0b2e-1a1f-44a4-ba26-8a96960d4165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e4258aa-96')
Oct 16 09:56:43 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tMGZkgah', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:56:43 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:56:43 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a395de72-a5f0-4ffd-8206-aa4c4764e2fd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 09:56:43 user nova-compute[74342]: No targets found.
Oct 16 09:56:43 user nova-compute[74342]: iSNS:
Oct 16 09:56:43 user nova-compute[74342]: No targets found.
Oct 16 09:56:43 user nova-compute[74342]: STATIC:
Oct 16 09:56:43 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3
Oct 16 09:56:43 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:56:43 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:56:43 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43
Oct 16 09:56:43 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:56:43 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:56:43 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8
Oct 16 09:56:43 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:56:43 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:56:43 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa
Oct 16 09:56:43 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:56:43 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:56:43 user nova-compute[74342]: FIRMWARE:
Oct 16 09:56:43 user nova-compute[74342]: No targets found.
Oct 16 09:56:43 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 09:56:43 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 09:56:43 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[459bec44-5972-4d52-8d2d-97dc906d94d4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7014a87-1799-403e-adcf-04b16e959bc9]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:56:43 user nova-compute[74342]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)
Oct 16 09:56:43 user nova-compute[74342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa (non-flash)
Oct 16 09:56:43 user nova-compute[74342]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 09:56:43 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:56:43 user nova-compute[74342]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)
Oct 16 09:56:43 user nova-compute[74342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa (non-flash)
Oct 16 09:56:43 user nova-compute[74342]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 09:56:43 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b602732e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43'): ({'sdb'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Removing single pathed devices sdb {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1628de-aafe-4ad3-b69e-9dcdb7b432a8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6fe27a-e1b4-4c21-8b49-6e3ef9476a04]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Flushing IO for device /dev/sdb {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1316e07-7010-48ba-9c06-1cb3ce897968]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9470dba1-b1d7-4835-ad4c-9094a5ef258d]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c25a16-14e5-46b6-8e2c-3b2ec2ee44c6]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e6de85-ba33-44ae-8b9f-7c533fee4123]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43, portal: 172.16.0.220,3260]
Oct 16 09:56:43 user nova-compute[74342]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43, portal: 172.16.0.220,3260] successful.
Oct 16 09:56:43 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4ade66-e8ad-446d-b73f-7343c462a632]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] <== disconnect_volume: return (378ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Start _get_guest_xml network_info=[{"id": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "address": "fa:16:3e:82:00:ac", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4258aa-96", "ovs_interfaceid": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '48d364ee-1bba-46f4-8f20-6f366f21ed41', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tMGZkgah', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '4f3aa905-8eae-45cb-8019-0b991286fe42', 'attached_at': '', 'detached_at': '', 'volume_id': '6e3a5814-40f6-46ab-aca8-2f0a72768a43', 'serial': '6e3a5814-40f6-46ab-aca8-2f0a72768a43'}, 'volume_type': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG nova.objects.instance [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'numa_topology' on Instance uuid 4f3aa905-8eae-45cb-8019-0b991286fe42 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG nova.objects.base [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Object Instance<4f3aa905-8eae-45cb-8019-0b991286fe42> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 09:56:43 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:56:43 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:56:43 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG nova.objects.instance [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4f3aa905-8eae-45cb-8019-0b991286fe42 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG nova.objects.base [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Object Instance<4f3aa905-8eae-45cb-8019-0b991286fe42> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tMGZkgah', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:56:43 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:56:43 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:56:43 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:56:43 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:56:43 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc7b9d97-3045-4e5f-842f-73bd3ca1da59]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 09:56:43 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[374d2bed-c3a5-41eb-a894-cef25cfb6ffe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43] added
Oct 16 09:56:43 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c39aee3-d28f-4d23-9c48-a756c140aec0]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e889e36d-f706-4e8e-9a32-723e7d7dc04e]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tMGZkgah {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tMGZkgah" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88899d7-c956-4ba6-8f44-4ea5e034070f]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tMGZkgah'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8160e329-baf2-4a9d-b867-f8556ad72742]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[36814db6-1c08-422b-b559-7e8d0db6311a]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)
Oct 16 09:56:44 user nova-compute[74342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa (non-flash)
Oct 16 09:56:44 user nova-compute[74342]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 09:56:44 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)
Oct 16 09:56:44 user nova-compute[74342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa (non-flash)
Oct 16 09:56:44 user nova-compute[74342]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 09:56:44 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[75034f89-abe1-450f-80b4-07f8375869c7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43, portal: 172.16.0.220,3260]
Oct 16 09:56:44 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43, portal: 172.16.0.220,3260] successful.
Oct 16 09:56:44 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1708d248-9274-4927-b0c8-57ee73295eb0]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4075a074-c811-4db8-8aac-4c21ba312586]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)
Oct 16 09:56:44 user nova-compute[74342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa (non-flash)
Oct 16 09:56:44 user nova-compute[74342]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 09:56:44 user nova-compute[74342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:56:44 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)
Oct 16 09:56:44 user nova-compute[74342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa (non-flash)
Oct 16 09:56:44 user nova-compute[74342]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 09:56:44 user nova-compute[74342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:56:44 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.328s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] HCTL ('33', '-', '-', 0) found on session 23 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d9873b9-47c4-49f0-b247-762667dd41c3]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:44 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: None {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:56:45 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Searching for a device in session 23 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:56:45 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tMGZkgah', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 09:56:45 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.363s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:56:45 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26565653364333631', 'path': '/dev/sdb'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:56:45 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26565653364333631', 'path': '/dev/sdb'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 09:56:45 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1589424972',display_name='tempest-AttachVolumeTestJSON-server-1589424972',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1589424972',id=24,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBO8M7UyZeyQg1aYm+ByuTDEoeaBTTsQAFljuagcRlcGDhfx2FLzwqTOwmYqO1+0IHWLuSXoneV6tc1mCRPSiL9W+Jq0YYyfdyDE26TRgq7GChyXwYOsK9694M/+yJ6Kw==',key_name='tempest-keypair-1616245480',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:52:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c28511c6c42147db9a0992cf40e044bb',ramdisk_id='',reservation_id='r-tipl03lh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-965713551',owner_user_name='tempest-AttachVolumeTestJSON-965713551-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:54:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc0dfbfdb77347cda95ba991d37c311d',uuid=4f3aa905-8eae-45cb-8019-0b991286fe42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "address": "fa:16:3e:82:00:ac", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4258aa-96", "ovs_interfaceid": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:56:45 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Converting VIF {"id": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "address": "fa:16:3e:82:00:ac", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4258aa-96", "ovs_interfaceid": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:56:45 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:00:ac,bridge_name='br-int',has_traffic_filtering=True,id=0e4258aa-9686-4cf1-9d1a-5bf61e7ba193,network=Network(54ba0b2e-1a1f-44a4-ba26-8a96960d4165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e4258aa-96') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:56:45 user nova-compute[74342]: DEBUG nova.objects.instance [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f3aa905-8eae-45cb-8019-0b991286fe42 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:56:45 user nova-compute[74342]: DEBUG nova.objects.base [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Object Instance<4f3aa905-8eae-45cb-8019-0b991286fe42> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 09:56:45 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:56:45 user nova-compute[74342]:   <uuid>4f3aa905-8eae-45cb-8019-0b991286fe42</uuid>
Oct 16 09:56:45 user nova-compute[74342]:   <name>instance-00000018</name>
Oct 16 09:56:45 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:56:45 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:56:45 user nova-compute[74342]:   <metadata>
Oct 16 09:56:45 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:56:45 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:56:45 user nova-compute[74342]:       <nova:name>tempest-AttachVolumeTestJSON-server-1589424972</nova:name>
Oct 16 09:56:45 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:56:43</nova:creationTime>
Oct 16 09:56:45 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:56:45 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:56:45 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:56:45 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:56:45 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:56:45 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:56:45 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:56:45 user nova-compute[74342]:       <nova:owner>
Oct 16 09:56:45 user nova-compute[74342]:         <nova:user uuid="bc0dfbfdb77347cda95ba991d37c311d">tempest-AttachVolumeTestJSON-965713551-project-member</nova:user>
Oct 16 09:56:45 user nova-compute[74342]:         <nova:project uuid="c28511c6c42147db9a0992cf40e044bb">tempest-AttachVolumeTestJSON-965713551</nova:project>
Oct 16 09:56:45 user nova-compute[74342]:       </nova:owner>
Oct 16 09:56:45 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:56:45 user nova-compute[74342]:       <nova:ports>
Oct 16 09:56:45 user nova-compute[74342]:         <nova:port uuid="0e4258aa-9686-4cf1-9d1a-5bf61e7ba193">
Oct 16 09:56:45 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 16 09:56:45 user nova-compute[74342]:         </nova:port>
Oct 16 09:56:45 user nova-compute[74342]:       </nova:ports>
Oct 16 09:56:45 user nova-compute[74342]:     </nova:instance>
Oct 16 09:56:45 user nova-compute[74342]:   </metadata>
Oct 16 09:56:45 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:56:45 user nova-compute[74342]:     <system>
Oct 16 09:56:45 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:56:45 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:56:45 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:56:45 user nova-compute[74342]:       <entry name="serial">4f3aa905-8eae-45cb-8019-0b991286fe42</entry>
Oct 16 09:56:45 user nova-compute[74342]:       <entry name="uuid">4f3aa905-8eae-45cb-8019-0b991286fe42</entry>
Oct 16 09:56:45 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:56:45 user nova-compute[74342]:     </system>
Oct 16 09:56:45 user nova-compute[74342]:   </sysinfo>
Oct 16 09:56:45 user nova-compute[74342]:   <os>
Oct 16 09:56:45 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:56:45 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:56:45 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:56:45 user nova-compute[74342]:   </os>
Oct 16 09:56:45 user nova-compute[74342]:   <features>
Oct 16 09:56:45 user nova-compute[74342]:     <acpi/>
Oct 16 09:56:45 user nova-compute[74342]:     <apic/>
Oct 16 09:56:45 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:56:45 user nova-compute[74342]:   </features>
Oct 16 09:56:45 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:56:45 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:56:45 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:56:45 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:56:45 user nova-compute[74342]:   </clock>
Oct 16 09:56:45 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:56:45 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:56:45 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:56:45 user nova-compute[74342]:   </cpu>
Oct 16 09:56:45 user nova-compute[74342]:   <devices>
Oct 16 09:56:45 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 09:56:45 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 09:56:45 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk"/>
Oct 16 09:56:45 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:56:45 user nova-compute[74342]:     </disk>
Oct 16 09:56:45 user nova-compute[74342]:     <disk type="block" device="disk">
Oct 16 09:56:45 user nova-compute[74342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:56:45 user nova-compute[74342]:       <source dev="/dev/sdb"/>
Oct 16 09:56:45 user nova-compute[74342]:       <target dev="vdb" bus="virtio"/>
Oct 16 09:56:45 user nova-compute[74342]:       <serial>6e3a5814-40f6-46ab-aca8-2f0a72768a43</serial>
Oct 16 09:56:45 user nova-compute[74342]:     </disk>
Oct 16 09:56:45 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:56:45 user nova-compute[74342]:       <mac address="fa:16:3e:82:00:ac"/>
Oct 16 09:56:45 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:56:45 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:56:45 user nova-compute[74342]:       <target dev="tap0e4258aa-96"/>
Oct 16 09:56:45 user nova-compute[74342]:     </interface>
Oct 16 09:56:45 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:56:45 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/console.log" append="off"/>
Oct 16 09:56:45 user nova-compute[74342]:     </serial>
Oct 16 09:56:45 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:56:45 user nova-compute[74342]:     <video>
Oct 16 09:56:45 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:56:45 user nova-compute[74342]:     </video>
Oct 16 09:56:45 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:56:45 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:56:45 user nova-compute[74342]:     </rng>
Oct 16 09:56:45 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:56:45 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:56:45 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:56:45 user nova-compute[74342]:     </memballoon>
Oct 16 09:56:45 user nova-compute[74342]:   </devices>
Oct 16 09:56:45 user nova-compute[74342]: </domain>
Oct 16 09:56:45 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:56:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:45 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:56:45 user nova-compute[74342]: DEBUG nova.objects.instance [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4f3aa905-8eae-45cb-8019-0b991286fe42 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:56:45 user nova-compute[74342]: DEBUG nova.objects.base [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Object Instance<4f3aa905-8eae-45cb-8019-0b991286fe42> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 09:56:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.189s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:45 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 09:56:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:46 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Cannot resize image /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 09:56:46 user nova-compute[74342]: DEBUG nova.objects.instance [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'migration_context' on Instance uuid 4f3aa905-8eae-45cb-8019-0b991286fe42 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:56:46 user nova-compute[74342]: DEBUG nova.objects.base [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Object Instance<4f3aa905-8eae-45cb-8019-0b991286fe42> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 09:56:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1589424972',display_name='tempest-AttachVolumeTestJSON-server-1589424972',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1589424972',id=24,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBO8M7UyZeyQg1aYm+ByuTDEoeaBTTsQAFljuagcRlcGDhfx2FLzwqTOwmYqO1+0IHWLuSXoneV6tc1mCRPSiL9W+Jq0YYyfdyDE26TRgq7GChyXwYOsK9694M/+yJ6Kw==',key_name='tempest-keypair-1616245480',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:52:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='c28511c6c42147db9a0992cf40e044bb',ramdisk_id='',reservation_id='r-tipl03lh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-965713551',owner_user_name='tempest-AttachVolumeTestJSON-965713551-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:54:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc0dfbfdb77347cda95ba991d37c311d',uuid=4f3aa905-8eae-45cb-8019-0b991286fe42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "address": "fa:16:3e:82:00:ac", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4258aa-96", "ovs_interfaceid": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:56:46 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Converting VIF {"id": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "address": "fa:16:3e:82:00:ac", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4258aa-96", "ovs_interfaceid": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:56:46 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:00:ac,bridge_name='br-int',has_traffic_filtering=True,id=0e4258aa-9686-4cf1-9d1a-5bf61e7ba193,network=Network(54ba0b2e-1a1f-44a4-ba26-8a96960d4165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e4258aa-96') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:56:46 user nova-compute[74342]: DEBUG os_vif [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:00:ac,bridge_name='br-int',has_traffic_filtering=True,id=0e4258aa-9686-4cf1-9d1a-5bf61e7ba193,network=Network(54ba0b2e-1a1f-44a4-ba26-8a96960d4165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e4258aa-96') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:56:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:56:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f6e4084-f495-51ae-9896-e97b4ee7087d', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:56:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e4258aa-96, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0e4258aa-96, col_values=(('qos', UUID('21daed4c-a474-4155-97fa-07d0d95a103b')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0e4258aa-96, col_values=(('external_ids', {'iface-id': '0e4258aa-9686-4cf1-9d1a-5bf61e7ba193', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:00:ac', 'vm-uuid': '4f3aa905-8eae-45cb-8019-0b991286fe42'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:56:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:56:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:46 user nova-compute[74342]: INFO os_vif [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:00:ac,bridge_name='br-int',has_traffic_filtering=True,id=0e4258aa-9686-4cf1-9d1a-5bf61e7ba193,network=Network(54ba0b2e-1a1f-44a4-ba26-8a96960d4165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e4258aa-96')
Oct 16 09:56:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:48 user nova-compute[74342]: DEBUG nova.compute.manager [req-250dd2f6-6422-4077-a056-8a069b449c93 req-6ea686b8-359c-4b83-b4b2-a5e060ce759f service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Received event network-vif-plugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:56:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-250dd2f6-6422-4077-a056-8a069b449c93 req-6ea686b8-359c-4b83-b4b2-a5e060ce759f service nova] Acquiring lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:56:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-250dd2f6-6422-4077-a056-8a069b449c93 req-6ea686b8-359c-4b83-b4b2-a5e060ce759f service nova] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:56:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-250dd2f6-6422-4077-a056-8a069b449c93 req-6ea686b8-359c-4b83-b4b2-a5e060ce759f service nova] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:56:48 user nova-compute[74342]: DEBUG nova.compute.manager [req-250dd2f6-6422-4077-a056-8a069b449c93 req-6ea686b8-359c-4b83-b4b2-a5e060ce759f service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] No waiting events found dispatching network-vif-plugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:56:48 user nova-compute[74342]: WARNING nova.compute.manager [req-250dd2f6-6422-4077-a056-8a069b449c93 req-6ea686b8-359c-4b83-b4b2-a5e060ce759f service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Received unexpected event network-vif-plugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 for instance with vm_state stopped and task_state powering-on.
Oct 16 09:56:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:50 user nova-compute[74342]: DEBUG nova.compute.manager [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:56:50 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Instance rebooted successfully.
Oct 16 09:56:50 user nova-compute[74342]: DEBUG nova.compute.manager [None req-f648c917-d467-4d40-9c63-096a2c334248 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:56:50 user nova-compute[74342]: DEBUG nova.compute.manager [req-bf1a27bf-b9c1-48fd-b53d-f38b2f5c52c2 req-2d81bd3b-6a21-49ff-a5e1-00d2332d240b service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Received event network-vif-plugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:56:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-bf1a27bf-b9c1-48fd-b53d-f38b2f5c52c2 req-2d81bd3b-6a21-49ff-a5e1-00d2332d240b service nova] Acquiring lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:56:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-bf1a27bf-b9c1-48fd-b53d-f38b2f5c52c2 req-2d81bd3b-6a21-49ff-a5e1-00d2332d240b service nova] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:56:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-bf1a27bf-b9c1-48fd-b53d-f38b2f5c52c2 req-2d81bd3b-6a21-49ff-a5e1-00d2332d240b service nova] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:56:50 user nova-compute[74342]: DEBUG nova.compute.manager [req-bf1a27bf-b9c1-48fd-b53d-f38b2f5c52c2 req-2d81bd3b-6a21-49ff-a5e1-00d2332d240b service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] No waiting events found dispatching network-vif-plugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:56:50 user nova-compute[74342]: WARNING nova.compute.manager [req-bf1a27bf-b9c1-48fd-b53d-f38b2f5c52c2 req-2d81bd3b-6a21-49ff-a5e1-00d2332d240b service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Received unexpected event network-vif-plugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 for instance with vm_state active and task_state None.
Oct 16 09:56:50 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:56:50 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:56:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:56:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:56:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:56:50 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 09:56:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f74c903-29f2-4635-bddd-c10051728f47/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f74c903-29f2-4635-bddd-c10051728f47/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:50 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f74c903-29f2-4635-bddd-c10051728f47/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f74c903-29f2-4635-bddd-c10051728f47/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk --force-share --output=json" returned: 0 in 0.285s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:51 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:56:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:51 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:52 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:56:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json" returned: 0 in 0.236s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json" returned: 0 in 0.266s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:53 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:56:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:53 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:56:54 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:56:54 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:56:54 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=7840MB free_disk=25.057880401611328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 09:56:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:56:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:56:54 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance d45abd20-3a58-4657-8f4c-a426d8e39be3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:56:54 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 98367a96-22f0-4edb-ab03-a8eb286b437b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:56:54 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance edcefbe0-e89f-4496-9032-f9431d9d5c53 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:56:54 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 4f3aa905-8eae-45cb-8019-0b991286fe42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:56:54 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance eeee39f2-9728-4114-8bd3-1d05f69a1215 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:56:54 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance aa116cab-861b-459d-b1eb-6f07e5d71e30 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:56:54 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:56:54 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7f74c903-29f2-4635-bddd-c10051728f47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:56:54 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 09:56:54 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 09:56:54 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:54 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:56:54 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:56:54 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 09:56:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.542s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:56:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Acquiring lock "575ff5fb-6cd7-4e84-b6de-c971129c7935" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:56:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "575ff5fb-6cd7-4e84-b6de-c971129c7935" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:56:58 user nova-compute[74342]: DEBUG nova.compute.manager [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:56:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:56:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:56:58 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:56:58 user nova-compute[74342]: INFO nova.compute.claims [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Claim successful on node user
Oct 16 09:56:58 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:56:58 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:56:58 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 09:56:58 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Rebuilding the list of instances to heal {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 09:56:58 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:56:58 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Skipping network cache update for instance because it is Building. {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 16 09:56:58 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:56:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:56:58 user nova-compute[74342]: DEBUG nova.compute.manager [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:56:58 user nova-compute[74342]: DEBUG nova.compute.manager [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:56:58 user nova-compute[74342]: DEBUG nova.network.neutron [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:56:58 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:56:58 user nova-compute[74342]: DEBUG nova.compute.manager [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:56:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-d45abd20-3a58-4657-8f4c-a426d8e39be3" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:56:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-d45abd20-3a58-4657-8f4c-a426d8e39be3" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:56:58 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 09:56:58 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lazy-loading 'info_cache' on Instance uuid d45abd20-3a58-4657-8f4c-a426d8e39be3 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:56:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:56:59 user nova-compute[74342]: INFO nova.virt.block_device [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Booting with volume 85fe9beb-cfb8-452d-8f97-249915dd854f at /dev/vda
Oct 16 09:56:59 user nova-compute[74342]: DEBUG nova.policy [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8b8ad29a34c84e95ac5513c5a670a753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52331a6c86c446d7bb5e9e849eebdd18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:56:59 user nova-compute[74342]: DEBUG os_brick.utils [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:56:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:59 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[932957c5-78bf-46b1-ab3f-01ea3715d7e0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:59 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae886f6b-be11-4b44-bd7a-1265c27f63f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:56:59 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e70e4c-0658-452c-ab05-12d34182a36f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:59 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2611ad67-a215-4e1b-ad20-9b8d855c1d68]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:56:59 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:56:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:56:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:56:59 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:56:59 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[11280d15-dc94-4bfb-83ec-3221bcef7b1c]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:56:59 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:56:59 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:56:59 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:56:59 user nova-compute[74342]: DEBUG os_brick.utils [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:56:59 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Updating existing volume attachment record: e0fb5c8e-17d2-4878-87ef-ceebe5cecb92 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 09:56:59 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Updating instance_info_cache with network_info: [{"id": "2e5ec9cf-9b58-47bc-be15-0b896a7625bc", "address": "fa:16:3e:8c:de:8b", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e5ec9cf-9b", "ovs_interfaceid": "2e5ec9cf-9b58-47bc-be15-0b896a7625bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:56:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-d45abd20-3a58-4657-8f4c-a426d8e39be3" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:56:59 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 09:56:59 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:56:59 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:56:59 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:57:00 user nova-compute[74342]: DEBUG nova.network.neutron [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Successfully created port: a82e4268-e1e1-494b-b505-2558fa7f535e {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:57:00 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:57:00 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:57:00 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 09:57:00 user nova-compute[74342]: DEBUG nova.network.neutron [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Successfully updated port: a82e4268-e1e1-494b-b505-2558fa7f535e {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:57:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Acquiring lock "refresh_cache-575ff5fb-6cd7-4e84-b6de-c971129c7935" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:57:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Acquired lock "refresh_cache-575ff5fb-6cd7-4e84-b6de-c971129c7935" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:57:00 user nova-compute[74342]: DEBUG nova.network.neutron [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:57:01 user nova-compute[74342]: DEBUG nova.compute.manager [req-970e1b17-ef2b-4191-a10d-cae07758e5af req-8f123579-b2f2-4761-ab9d-98800c0053f7 service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Received event network-changed-a82e4268-e1e1-494b-b505-2558fa7f535e {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:57:01 user nova-compute[74342]: DEBUG nova.compute.manager [req-970e1b17-ef2b-4191-a10d-cae07758e5af req-8f123579-b2f2-4761-ab9d-98800c0053f7 service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Refreshing instance network info cache due to event network-changed-a82e4268-e1e1-494b-b505-2558fa7f535e. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:57:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-970e1b17-ef2b-4191-a10d-cae07758e5af req-8f123579-b2f2-4761-ab9d-98800c0053f7 service nova] Acquiring lock "refresh_cache-575ff5fb-6cd7-4e84-b6de-c971129c7935" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:57:01 user nova-compute[74342]: DEBUG nova.network.neutron [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:57:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:01 user nova-compute[74342]: DEBUG nova.network.neutron [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Updating instance_info_cache with network_info: [{"id": "a82e4268-e1e1-494b-b505-2558fa7f535e", "address": "fa:16:3e:13:f1:6f", "network": {"id": "46f96b88-d08a-4f28-bcbf-a630d369074a", "bridge": "br-int", "label": "tempest-TestShelveInstance-2043632303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52331a6c86c446d7bb5e9e849eebdd18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa82e4268-e1", "ovs_interfaceid": "a82e4268-e1e1-494b-b505-2558fa7f535e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:57:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Releasing lock "refresh_cache-575ff5fb-6cd7-4e84-b6de-c971129c7935" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:57:01 user nova-compute[74342]: DEBUG nova.compute.manager [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Instance network_info: |[{"id": "a82e4268-e1e1-494b-b505-2558fa7f535e", "address": "fa:16:3e:13:f1:6f", "network": {"id": "46f96b88-d08a-4f28-bcbf-a630d369074a", "bridge": "br-int", "label": "tempest-TestShelveInstance-2043632303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52331a6c86c446d7bb5e9e849eebdd18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa82e4268-e1", "ovs_interfaceid": "a82e4268-e1e1-494b-b505-2558fa7f535e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:57:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-970e1b17-ef2b-4191-a10d-cae07758e5af req-8f123579-b2f2-4761-ab9d-98800c0053f7 service nova] Acquired lock "refresh_cache-575ff5fb-6cd7-4e84-b6de-c971129c7935" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:57:01 user nova-compute[74342]: DEBUG nova.network.neutron [req-970e1b17-ef2b-4191-a10d-cae07758e5af req-8f123579-b2f2-4761-ab9d-98800c0053f7 service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Refreshing network info cache for port a82e4268-e1e1-494b-b505-2558fa7f535e {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:57:01 user nova-compute[74342]: DEBUG nova.network.neutron [req-970e1b17-ef2b-4191-a10d-cae07758e5af req-8f123579-b2f2-4761-ab9d-98800c0053f7 service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Updated VIF entry in instance network info cache for port a82e4268-e1e1-494b-b505-2558fa7f535e. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:57:01 user nova-compute[74342]: DEBUG nova.network.neutron [req-970e1b17-ef2b-4191-a10d-cae07758e5af req-8f123579-b2f2-4761-ab9d-98800c0053f7 service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Updating instance_info_cache with network_info: [{"id": "a82e4268-e1e1-494b-b505-2558fa7f535e", "address": "fa:16:3e:13:f1:6f", "network": {"id": "46f96b88-d08a-4f28-bcbf-a630d369074a", "bridge": "br-int", "label": "tempest-TestShelveInstance-2043632303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52331a6c86c446d7bb5e9e849eebdd18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa82e4268-e1", "ovs_interfaceid": "a82e4268-e1e1-494b-b505-2558fa7f535e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:57:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-970e1b17-ef2b-4191-a10d-cae07758e5af req-8f123579-b2f2-4761-ab9d-98800c0053f7 service nova] Releasing lock "refresh_cache-575ff5fb-6cd7-4e84-b6de-c971129c7935" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:57:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Acquiring lock "d7607dcc-e70e-42fb-9421-c5f630706241" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:57:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "d7607dcc-e70e-42fb-9421-c5f630706241" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:57:09 user nova-compute[74342]: DEBUG nova.compute.manager [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:57:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:57:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:57:10 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:57:10 user nova-compute[74342]: INFO nova.compute.claims [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Claim successful on node user
Oct 16 09:57:10 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:57:10 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:57:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.434s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:57:10 user nova-compute[74342]: DEBUG nova.compute.manager [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:57:10 user nova-compute[74342]: DEBUG nova.compute.manager [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:57:10 user nova-compute[74342]: DEBUG nova.network.neutron [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:57:10 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:57:10 user nova-compute[74342]: DEBUG nova.compute.manager [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:57:10 user nova-compute[74342]: DEBUG nova.policy [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21ee41cd47eb4493ac26a4199e8b5902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a3c19c78264cc7a4083e20cf4598ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:57:10 user nova-compute[74342]: DEBUG nova.compute.manager [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 09:57:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:57:10 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Creating image(s)
Oct 16 09:57:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Acquiring lock "/opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:57:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "/opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:57:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "/opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:57:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.179s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:57:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:57:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.251s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:11 user nova-compute[74342]: DEBUG nova.network.neutron [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Successfully created port: f9bd07aa-abd7-4ff6-afd3-388251345ec0 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:57:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk 1073741824" returned: 0 in 0.056s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.314s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:57:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-29cf84cd-05e7-4f8a-8627-4c5629f873a9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "edcefbe0-e89f-4496-9032-f9431d9d5c53" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:57:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-29cf84cd-05e7-4f8a-8627-4c5629f873a9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "edcefbe0-e89f-4496-9032-f9431d9d5c53" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:57:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-29cf84cd-05e7-4f8a-8627-4c5629f873a9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "edcefbe0-e89f-4496-9032-f9431d9d5c53-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:57:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-29cf84cd-05e7-4f8a-8627-4c5629f873a9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "edcefbe0-e89f-4496-9032-f9431d9d5c53-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:57:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-29cf84cd-05e7-4f8a-8627-4c5629f873a9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "edcefbe0-e89f-4496-9032-f9431d9d5c53-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:57:11 user nova-compute[74342]: INFO nova.compute.manager [None req-29cf84cd-05e7-4f8a-8627-4c5629f873a9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Terminating instance
Oct 16 09:57:11 user nova-compute[74342]: DEBUG nova.compute.manager [None req-29cf84cd-05e7-4f8a-8627-4c5629f873a9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 09:57:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.226s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:11 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 09:57:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:11 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Cannot resize image /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 09:57:11 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 09:57:11 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Ensure instance console log exists: /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:57:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:57:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:57:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:57:11 user nova-compute[74342]: DEBUG nova.compute.manager [req-4968933e-e595-470f-b94b-12dd033acdab req-4c934dad-5294-4ed3-a133-f75f512b61c2 service nova] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Received event network-vif-unplugged-5a9f3200-5a15-4afa-b812-7b68e3130d6d {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:57:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4968933e-e595-470f-b94b-12dd033acdab req-4c934dad-5294-4ed3-a133-f75f512b61c2 service nova] Acquiring lock "edcefbe0-e89f-4496-9032-f9431d9d5c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:57:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4968933e-e595-470f-b94b-12dd033acdab req-4c934dad-5294-4ed3-a133-f75f512b61c2 service nova] Lock "edcefbe0-e89f-4496-9032-f9431d9d5c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:57:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4968933e-e595-470f-b94b-12dd033acdab req-4c934dad-5294-4ed3-a133-f75f512b61c2 service nova] Lock "edcefbe0-e89f-4496-9032-f9431d9d5c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:57:11 user nova-compute[74342]: DEBUG nova.compute.manager [req-4968933e-e595-470f-b94b-12dd033acdab req-4c934dad-5294-4ed3-a133-f75f512b61c2 service nova] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] No waiting events found dispatching network-vif-unplugged-5a9f3200-5a15-4afa-b812-7b68e3130d6d {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:57:11 user nova-compute[74342]: DEBUG nova.compute.manager [req-4968933e-e595-470f-b94b-12dd033acdab req-4c934dad-5294-4ed3-a133-f75f512b61c2 service nova] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Received event network-vif-unplugged-5a9f3200-5a15-4afa-b812-7b68e3130d6d for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 09:57:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:12 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Instance destroyed successfully.
Oct 16 09:57:12 user nova-compute[74342]: DEBUG nova.objects.instance [None req-29cf84cd-05e7-4f8a-8627-4c5629f873a9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lazy-loading 'resources' on Instance uuid edcefbe0-e89f-4496-9032-f9431d9d5c53 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:57:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-29cf84cd-05e7-4f8a-8627-4c5629f873a9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:47:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-139790548',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-139790548',id=14,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:47:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4fcf2437a2d413ea584d0cc2508bed3',ramdisk_id='',reservation_id='r-8nb2dk74',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-476995503',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:49:45Z,user_data=None,user_id='f90f091b76254a13957807feaeaef3fc',uuid=edcefbe0-e89f-4496-9032-f9431d9d5c53,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5a9f3200-5a15-4afa-b812-7b68e3130d6d", "address": "fa:16:3e:df:2e:36", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a9f3200-5a", "ovs_interfaceid": "5a9f3200-5a15-4afa-b812-7b68e3130d6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:57:12 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-29cf84cd-05e7-4f8a-8627-4c5629f873a9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Converting VIF {"id": "5a9f3200-5a15-4afa-b812-7b68e3130d6d", "address": "fa:16:3e:df:2e:36", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5a9f3200-5a", "ovs_interfaceid": "5a9f3200-5a15-4afa-b812-7b68e3130d6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:57:12 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-29cf84cd-05e7-4f8a-8627-4c5629f873a9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:2e:36,bridge_name='br-int',has_traffic_filtering=True,id=5a9f3200-5a15-4afa-b812-7b68e3130d6d,network=Network(a571ad70-6f8b-4b02-86b9-df50290509f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a9f3200-5a') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:57:12 user nova-compute[74342]: DEBUG os_vif [None req-29cf84cd-05e7-4f8a-8627-4c5629f873a9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:2e:36,bridge_name='br-int',has_traffic_filtering=True,id=5a9f3200-5a15-4afa-b812-7b68e3130d6d,network=Network(a571ad70-6f8b-4b02-86b9-df50290509f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a9f3200-5a') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:57:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5a9f3200-5a, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:57:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:57:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d5c8d7f5-537b-4d59-ac77-fa0911a50bfc) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:57:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:57:12 user nova-compute[74342]: INFO os_vif [None req-29cf84cd-05e7-4f8a-8627-4c5629f873a9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:2e:36,bridge_name='br-int',has_traffic_filtering=True,id=5a9f3200-5a15-4afa-b812-7b68e3130d6d,network=Network(a571ad70-6f8b-4b02-86b9-df50290509f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5a9f3200-5a')
Oct 16 09:57:12 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-29cf84cd-05e7-4f8a-8627-4c5629f873a9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Deleting instance files /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53_del
Oct 16 09:57:12 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-29cf84cd-05e7-4f8a-8627-4c5629f873a9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Deletion of /opt/stack/data/nova/instances/edcefbe0-e89f-4496-9032-f9431d9d5c53_del complete
Oct 16 09:57:12 user nova-compute[74342]: INFO nova.compute.manager [None req-29cf84cd-05e7-4f8a-8627-4c5629f873a9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Took 1.02 seconds to destroy the instance on the hypervisor.
Oct 16 09:57:12 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-29cf84cd-05e7-4f8a-8627-4c5629f873a9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 09:57:12 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 09:57:12 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 09:57:12 user nova-compute[74342]: DEBUG nova.network.neutron [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Successfully updated port: f9bd07aa-abd7-4ff6-afd3-388251345ec0 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:57:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Acquiring lock "refresh_cache-d7607dcc-e70e-42fb-9421-c5f630706241" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:57:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Acquired lock "refresh_cache-d7607dcc-e70e-42fb-9421-c5f630706241" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:57:12 user nova-compute[74342]: DEBUG nova.network.neutron [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:57:12 user nova-compute[74342]: DEBUG nova.network.neutron [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:57:13 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Took 0.72 seconds to deallocate network for instance.
Oct 16 09:57:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-29cf84cd-05e7-4f8a-8627-4c5629f873a9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-29cf84cd-05e7-4f8a-8627-4c5629f873a9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.network.neutron [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Updating instance_info_cache with network_info: [{"id": "f9bd07aa-abd7-4ff6-afd3-388251345ec0", "address": "fa:16:3e:f5:80:2e", "network": {"id": "19a96357-4b1f-4da6-a8f4-795a37500116", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1856971527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8a3c19c78264cc7a4083e20cf4598ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9bd07aa-ab", "ovs_interfaceid": "f9bd07aa-abd7-4ff6-afd3-388251345ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Releasing lock "refresh_cache-d7607dcc-e70e-42fb-9421-c5f630706241" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.compute.manager [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Instance network_info: |[{"id": "f9bd07aa-abd7-4ff6-afd3-388251345ec0", "address": "fa:16:3e:f5:80:2e", "network": {"id": "19a96357-4b1f-4da6-a8f4-795a37500116", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1856971527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8a3c19c78264cc7a4083e20cf4598ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9bd07aa-ab", "ovs_interfaceid": "f9bd07aa-abd7-4ff6-afd3-388251345ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Start _get_guest_xml network_info=[{"id": "f9bd07aa-abd7-4ff6-afd3-388251345ec0", "address": "fa:16:3e:f5:80:2e", "network": {"id": "19a96357-4b1f-4da6-a8f4-795a37500116", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1856971527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8a3c19c78264cc7a4083e20cf4598ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9bd07aa-ab", "ovs_interfaceid": "f9bd07aa-abd7-4ff6-afd3-388251345ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:57:13 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:57:13 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:57:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1804813188',display_name='tempest-ServersNegativeTestJSON-server-1804813188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1804813188',id=30,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8a3c19c78264cc7a4083e20cf4598ec',ramdisk_id='',reservation_id='r-ac840jfw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2110827578',owner_user_name='tempest-ServersNegativeTestJSON-2110827578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:57:11Z,user_data=None,user_id='21ee41cd47eb4493ac26a4199e8b5902',uuid=d7607dcc-e70e-42fb-9421-c5f630706241,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9bd07aa-abd7-4ff6-afd3-388251345ec0", "address": "fa:16:3e:f5:80:2e", "network": {"id": "19a96357-4b1f-4da6-a8f4-795a37500116", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1856971527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8a3c19c78264cc7a4083e20cf4598ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9bd07aa-ab", "ovs_interfaceid": "f9bd07aa-abd7-4ff6-afd3-388251345ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Converting VIF {"id": "f9bd07aa-abd7-4ff6-afd3-388251345ec0", "address": "fa:16:3e:f5:80:2e", "network": {"id": "19a96357-4b1f-4da6-a8f4-795a37500116", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1856971527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8a3c19c78264cc7a4083e20cf4598ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9bd07aa-ab", "ovs_interfaceid": "f9bd07aa-abd7-4ff6-afd3-388251345ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:80:2e,bridge_name='br-int',has_traffic_filtering=True,id=f9bd07aa-abd7-4ff6-afd3-388251345ec0,network=Network(19a96357-4b1f-4da6-a8f4-795a37500116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9bd07aa-ab') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.objects.instance [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lazy-loading 'pci_devices' on Instance uuid d7607dcc-e70e-42fb-9421-c5f630706241 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:57:13 user nova-compute[74342]:   <uuid>d7607dcc-e70e-42fb-9421-c5f630706241</uuid>
Oct 16 09:57:13 user nova-compute[74342]:   <name>instance-0000001e</name>
Oct 16 09:57:13 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:57:13 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:57:13 user nova-compute[74342]:   <metadata>
Oct 16 09:57:13 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:57:13 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:57:13 user nova-compute[74342]:       <nova:name>tempest-ServersNegativeTestJSON-server-1804813188</nova:name>
Oct 16 09:57:13 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:57:13</nova:creationTime>
Oct 16 09:57:13 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:57:13 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:57:13 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:57:13 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:57:13 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:57:13 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:57:13 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:57:13 user nova-compute[74342]:       <nova:owner>
Oct 16 09:57:13 user nova-compute[74342]:         <nova:user uuid="21ee41cd47eb4493ac26a4199e8b5902">tempest-ServersNegativeTestJSON-2110827578-project-member</nova:user>
Oct 16 09:57:13 user nova-compute[74342]:         <nova:project uuid="e8a3c19c78264cc7a4083e20cf4598ec">tempest-ServersNegativeTestJSON-2110827578</nova:project>
Oct 16 09:57:13 user nova-compute[74342]:       </nova:owner>
Oct 16 09:57:13 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:57:13 user nova-compute[74342]:       <nova:ports>
Oct 16 09:57:13 user nova-compute[74342]:         <nova:port uuid="f9bd07aa-abd7-4ff6-afd3-388251345ec0">
Oct 16 09:57:13 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 16 09:57:13 user nova-compute[74342]:         </nova:port>
Oct 16 09:57:13 user nova-compute[74342]:       </nova:ports>
Oct 16 09:57:13 user nova-compute[74342]:     </nova:instance>
Oct 16 09:57:13 user nova-compute[74342]:   </metadata>
Oct 16 09:57:13 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:57:13 user nova-compute[74342]:     <system>
Oct 16 09:57:13 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:57:13 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:57:13 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:57:13 user nova-compute[74342]:       <entry name="serial">d7607dcc-e70e-42fb-9421-c5f630706241</entry>
Oct 16 09:57:13 user nova-compute[74342]:       <entry name="uuid">d7607dcc-e70e-42fb-9421-c5f630706241</entry>
Oct 16 09:57:13 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:57:13 user nova-compute[74342]:     </system>
Oct 16 09:57:13 user nova-compute[74342]:   </sysinfo>
Oct 16 09:57:13 user nova-compute[74342]:   <os>
Oct 16 09:57:13 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:57:13 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:57:13 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:57:13 user nova-compute[74342]:   </os>
Oct 16 09:57:13 user nova-compute[74342]:   <features>
Oct 16 09:57:13 user nova-compute[74342]:     <acpi/>
Oct 16 09:57:13 user nova-compute[74342]:     <apic/>
Oct 16 09:57:13 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:57:13 user nova-compute[74342]:   </features>
Oct 16 09:57:13 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:57:13 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:57:13 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:57:13 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:57:13 user nova-compute[74342]:   </clock>
Oct 16 09:57:13 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:57:13 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:57:13 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:57:13 user nova-compute[74342]:   </cpu>
Oct 16 09:57:13 user nova-compute[74342]:   <devices>
Oct 16 09:57:13 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 09:57:13 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 09:57:13 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk"/>
Oct 16 09:57:13 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:57:13 user nova-compute[74342]:     </disk>
Oct 16 09:57:13 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:57:13 user nova-compute[74342]:       <mac address="fa:16:3e:f5:80:2e"/>
Oct 16 09:57:13 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:57:13 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:57:13 user nova-compute[74342]:       <target dev="tapf9bd07aa-ab"/>
Oct 16 09:57:13 user nova-compute[74342]:     </interface>
Oct 16 09:57:13 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:57:13 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/console.log" append="off"/>
Oct 16 09:57:13 user nova-compute[74342]:     </serial>
Oct 16 09:57:13 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:57:13 user nova-compute[74342]:     <video>
Oct 16 09:57:13 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:57:13 user nova-compute[74342]:     </video>
Oct 16 09:57:13 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:57:13 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:57:13 user nova-compute[74342]:     </rng>
Oct 16 09:57:13 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:57:13 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:57:13 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:57:13 user nova-compute[74342]:     </memballoon>
Oct 16 09:57:13 user nova-compute[74342]:   </devices>
Oct 16 09:57:13 user nova-compute[74342]: </domain>
Oct 16 09:57:13 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:57:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1804813188',display_name='tempest-ServersNegativeTestJSON-server-1804813188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1804813188',id=30,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8a3c19c78264cc7a4083e20cf4598ec',ramdisk_id='',reservation_id='r-ac840jfw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2110827578',owner_user_name='tempest-ServersNegativeTestJSON-2110827578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:57:11Z,user_data=None,user_id='21ee41cd47eb4493ac26a4199e8b5902',uuid=d7607dcc-e70e-42fb-9421-c5f630706241,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9bd07aa-abd7-4ff6-afd3-388251345ec0", "address": "fa:16:3e:f5:80:2e", "network": {"id": "19a96357-4b1f-4da6-a8f4-795a37500116", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1856971527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8a3c19c78264cc7a4083e20cf4598ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9bd07aa-ab", "ovs_interfaceid": "f9bd07aa-abd7-4ff6-afd3-388251345ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Converting VIF {"id": "f9bd07aa-abd7-4ff6-afd3-388251345ec0", "address": "fa:16:3e:f5:80:2e", "network": {"id": "19a96357-4b1f-4da6-a8f4-795a37500116", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1856971527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8a3c19c78264cc7a4083e20cf4598ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9bd07aa-ab", "ovs_interfaceid": "f9bd07aa-abd7-4ff6-afd3-388251345ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:80:2e,bridge_name='br-int',has_traffic_filtering=True,id=f9bd07aa-abd7-4ff6-afd3-388251345ec0,network=Network(19a96357-4b1f-4da6-a8f4-795a37500116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9bd07aa-ab') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG os_vif [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:80:2e,bridge_name='br-int',has_traffic_filtering=True,id=f9bd07aa-abd7-4ff6-afd3-388251345ec0,network=Network(19a96357-4b1f-4da6-a8f4-795a37500116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9bd07aa-ab') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1fa4f965-9b48-56a8-881a-d0d08385ab17', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9bd07aa-ab, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9bd07aa-ab, col_values=(('qos', UUID('2e7dd88f-7ac1-4bd1-8e63-8db128aa9496')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9bd07aa-ab, col_values=(('external_ids', {'iface-id': 'f9bd07aa-abd7-4ff6-afd3-388251345ec0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:80:2e', 'vm-uuid': 'd7607dcc-e70e-42fb-9421-c5f630706241'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:13 user nova-compute[74342]: INFO os_vif [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:80:2e,bridge_name='br-int',has_traffic_filtering=True,id=f9bd07aa-abd7-4ff6-afd3-388251345ec0,network=Network(19a96357-4b1f-4da6-a8f4-795a37500116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9bd07aa-ab')
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] No VIF found with MAC fa:16:3e:f5:80:2e, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-29cf84cd-05e7-4f8a-8627-4c5629f873a9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-29cf84cd-05e7-4f8a-8627-4c5629f873a9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:57:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-29cf84cd-05e7-4f8a-8627-4c5629f873a9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.827s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:57:14 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-29cf84cd-05e7-4f8a-8627-4c5629f873a9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Deleted allocations for instance edcefbe0-e89f-4496-9032-f9431d9d5c53
Oct 16 09:57:14 user nova-compute[74342]: DEBUG nova.compute.manager [req-c3e27dbb-053a-4d14-98c5-ad39f5c60423 req-01c66a22-a109-46d2-a618-1f5182f05e6f service nova] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Received event network-vif-plugged-5a9f3200-5a15-4afa-b812-7b68e3130d6d {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:57:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c3e27dbb-053a-4d14-98c5-ad39f5c60423 req-01c66a22-a109-46d2-a618-1f5182f05e6f service nova] Acquiring lock "edcefbe0-e89f-4496-9032-f9431d9d5c53-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:57:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c3e27dbb-053a-4d14-98c5-ad39f5c60423 req-01c66a22-a109-46d2-a618-1f5182f05e6f service nova] Lock "edcefbe0-e89f-4496-9032-f9431d9d5c53-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:57:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c3e27dbb-053a-4d14-98c5-ad39f5c60423 req-01c66a22-a109-46d2-a618-1f5182f05e6f service nova] Lock "edcefbe0-e89f-4496-9032-f9431d9d5c53-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:57:14 user nova-compute[74342]: DEBUG nova.compute.manager [req-c3e27dbb-053a-4d14-98c5-ad39f5c60423 req-01c66a22-a109-46d2-a618-1f5182f05e6f service nova] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] No waiting events found dispatching network-vif-plugged-5a9f3200-5a15-4afa-b812-7b68e3130d6d {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:57:14 user nova-compute[74342]: WARNING nova.compute.manager [req-c3e27dbb-053a-4d14-98c5-ad39f5c60423 req-01c66a22-a109-46d2-a618-1f5182f05e6f service nova] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Received unexpected event network-vif-plugged-5a9f3200-5a15-4afa-b812-7b68e3130d6d for instance with vm_state deleted and task_state None.
Oct 16 09:57:14 user nova-compute[74342]: DEBUG nova.compute.manager [req-c3e27dbb-053a-4d14-98c5-ad39f5c60423 req-01c66a22-a109-46d2-a618-1f5182f05e6f service nova] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Received event network-changed-f9bd07aa-abd7-4ff6-afd3-388251345ec0 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:57:14 user nova-compute[74342]: DEBUG nova.compute.manager [req-c3e27dbb-053a-4d14-98c5-ad39f5c60423 req-01c66a22-a109-46d2-a618-1f5182f05e6f service nova] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Refreshing instance network info cache due to event network-changed-f9bd07aa-abd7-4ff6-afd3-388251345ec0. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:57:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c3e27dbb-053a-4d14-98c5-ad39f5c60423 req-01c66a22-a109-46d2-a618-1f5182f05e6f service nova] Acquiring lock "refresh_cache-d7607dcc-e70e-42fb-9421-c5f630706241" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:57:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c3e27dbb-053a-4d14-98c5-ad39f5c60423 req-01c66a22-a109-46d2-a618-1f5182f05e6f service nova] Acquired lock "refresh_cache-d7607dcc-e70e-42fb-9421-c5f630706241" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:57:14 user nova-compute[74342]: DEBUG nova.network.neutron [req-c3e27dbb-053a-4d14-98c5-ad39f5c60423 req-01c66a22-a109-46d2-a618-1f5182f05e6f service nova] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Refreshing network info cache for port f9bd07aa-abd7-4ff6-afd3-388251345ec0 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:57:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-29cf84cd-05e7-4f8a-8627-4c5629f873a9 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "edcefbe0-e89f-4496-9032-f9431d9d5c53" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.829s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:57:14 user nova-compute[74342]: DEBUG nova.network.neutron [req-c3e27dbb-053a-4d14-98c5-ad39f5c60423 req-01c66a22-a109-46d2-a618-1f5182f05e6f service nova] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Updated VIF entry in instance network info cache for port f9bd07aa-abd7-4ff6-afd3-388251345ec0. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:57:14 user nova-compute[74342]: DEBUG nova.network.neutron [req-c3e27dbb-053a-4d14-98c5-ad39f5c60423 req-01c66a22-a109-46d2-a618-1f5182f05e6f service nova] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Updating instance_info_cache with network_info: [{"id": "f9bd07aa-abd7-4ff6-afd3-388251345ec0", "address": "fa:16:3e:f5:80:2e", "network": {"id": "19a96357-4b1f-4da6-a8f4-795a37500116", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1856971527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8a3c19c78264cc7a4083e20cf4598ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9bd07aa-ab", "ovs_interfaceid": "f9bd07aa-abd7-4ff6-afd3-388251345ec0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:57:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c3e27dbb-053a-4d14-98c5-ad39f5c60423 req-01c66a22-a109-46d2-a618-1f5182f05e6f service nova] Releasing lock "refresh_cache-d7607dcc-e70e-42fb-9421-c5f630706241" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:57:14 user nova-compute[74342]: DEBUG nova.compute.manager [req-c3e27dbb-053a-4d14-98c5-ad39f5c60423 req-01c66a22-a109-46d2-a618-1f5182f05e6f service nova] [instance: edcefbe0-e89f-4496-9032-f9431d9d5c53] Received event network-vif-deleted-5a9f3200-5a15-4afa-b812-7b68e3130d6d {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:57:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-136ff015-359d-429d-b0bd-6982dbf4de1c req-6aa96311-e614-4e37-81d9-fab117e0ad25 service nova] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Received event network-vif-plugged-f9bd07aa-abd7-4ff6-afd3-388251345ec0 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:57:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-136ff015-359d-429d-b0bd-6982dbf4de1c req-6aa96311-e614-4e37-81d9-fab117e0ad25 service nova] Acquiring lock "d7607dcc-e70e-42fb-9421-c5f630706241-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:57:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-136ff015-359d-429d-b0bd-6982dbf4de1c req-6aa96311-e614-4e37-81d9-fab117e0ad25 service nova] Lock "d7607dcc-e70e-42fb-9421-c5f630706241-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:57:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-136ff015-359d-429d-b0bd-6982dbf4de1c req-6aa96311-e614-4e37-81d9-fab117e0ad25 service nova] Lock "d7607dcc-e70e-42fb-9421-c5f630706241-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:57:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-136ff015-359d-429d-b0bd-6982dbf4de1c req-6aa96311-e614-4e37-81d9-fab117e0ad25 service nova] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] No waiting events found dispatching network-vif-plugged-f9bd07aa-abd7-4ff6-afd3-388251345ec0 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:57:15 user nova-compute[74342]: WARNING nova.compute.manager [req-136ff015-359d-429d-b0bd-6982dbf4de1c req-6aa96311-e614-4e37-81d9-fab117e0ad25 service nova] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Received unexpected event network-vif-plugged-f9bd07aa-abd7-4ff6-afd3-388251345ec0 for instance with vm_state building and task_state spawning.
Oct 16 09:57:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:17 user nova-compute[74342]: DEBUG nova.compute.manager [req-0f4c513d-5624-4c5e-add5-684454d1846c req-e5cf14ca-9c97-4f20-b693-cf95d38c089a service nova] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Received event network-vif-plugged-f9bd07aa-abd7-4ff6-afd3-388251345ec0 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:57:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0f4c513d-5624-4c5e-add5-684454d1846c req-e5cf14ca-9c97-4f20-b693-cf95d38c089a service nova] Acquiring lock "d7607dcc-e70e-42fb-9421-c5f630706241-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:57:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0f4c513d-5624-4c5e-add5-684454d1846c req-e5cf14ca-9c97-4f20-b693-cf95d38c089a service nova] Lock "d7607dcc-e70e-42fb-9421-c5f630706241-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:57:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0f4c513d-5624-4c5e-add5-684454d1846c req-e5cf14ca-9c97-4f20-b693-cf95d38c089a service nova] Lock "d7607dcc-e70e-42fb-9421-c5f630706241-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:57:17 user nova-compute[74342]: DEBUG nova.compute.manager [req-0f4c513d-5624-4c5e-add5-684454d1846c req-e5cf14ca-9c97-4f20-b693-cf95d38c089a service nova] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] No waiting events found dispatching network-vif-plugged-f9bd07aa-abd7-4ff6-afd3-388251345ec0 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:57:17 user nova-compute[74342]: WARNING nova.compute.manager [req-0f4c513d-5624-4c5e-add5-684454d1846c req-e5cf14ca-9c97-4f20-b693-cf95d38c089a service nova] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Received unexpected event network-vif-plugged-f9bd07aa-abd7-4ff6-afd3-388251345ec0 for instance with vm_state building and task_state spawning.
Oct 16 09:57:17 user nova-compute[74342]: DEBUG nova.compute.manager [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:57:17 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:57:17 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Instance spawned successfully.
Oct 16 09:57:17 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:57:17 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:57:17 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:57:17 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:57:17 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:57:17 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:57:17 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:57:17 user nova-compute[74342]: INFO nova.compute.manager [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Took 6.85 seconds to spawn the instance on the hypervisor.
Oct 16 09:57:17 user nova-compute[74342]: DEBUG nova.compute.manager [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:57:17 user nova-compute[74342]: INFO nova.compute.manager [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Took 7.68 seconds to build instance.
Oct 16 09:57:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-40eded0f-3e39-4788-9351-95d8b3635f28 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "d7607dcc-e70e-42fb-9421-c5f630706241" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.817s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:57:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:57:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 09:57:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 09:57:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 09:57:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG nova.compute.manager [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:57:33 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Creating image(s)
Oct 16 09:57:33 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Did not create local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Ensure instance console log exists: /opt/stack/data/nova/instances/575ff5fb-6cd7-4e84-b6de-c971129c7935/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Start _get_guest_xml network_info=[{"id": "a82e4268-e1e1-494b-b505-2558fa7f535e", "address": "fa:16:3e:13:f1:6f", "network": {"id": "46f96b88-d08a-4f28-bcbf-a630d369074a", "bridge": "br-int", "label": "tempest-TestShelveInstance-2043632303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52331a6c86c446d7bb5e9e849eebdd18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa82e4268-e1", "ovs_interfaceid": "a82e4268-e1e1-494b-b505-2558fa7f535e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'attachment_id': 'e0fb5c8e-17d2-4878-87ef-ceebe5cecb92', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdvWcJrY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '575ff5fb-6cd7-4e84-b6de-c971129c7935', 'attached_at': '', 'detached_at': '', 'volume_id': '85fe9beb-cfb8-452d-8f97-249915dd854f', 'serial': '85fe9beb-cfb8-452d-8f97-249915dd854f'}, 'volume_type': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:57:33 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:57:33 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:57:33 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdvWcJrY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:57:33 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:57:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:57:33 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:57:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:57:33 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 09:57:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9f135a8-006e-4162-99a8-67db64f28b9e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 09:57:33 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6214de3c-a678-407c-a3df-9e2454a1e3a7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f] added
Oct 16 09:57:33 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca71fce-8768-467f-9bd0-53d11a55c2fc]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a2a6fc-0c0c-4ab7-8292-3be7585d365a]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fdvWcJrY {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fdvWcJrY" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f03210-598f-449e-88c7-9e2386a2058d]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fdvWcJrY'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[256bfe00-2a61-4c51-8c26-938e48652b8c]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:57:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[40590e62-eb92-4dd6-8f7c-9e9f475d121b]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:57:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)
Oct 16 09:57:34 user nova-compute[74342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa (non-flash)
Oct 16 09:57:34 user nova-compute[74342]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 09:57:34 user nova-compute[74342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:57:34 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:57:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)
Oct 16 09:57:34 user nova-compute[74342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa (non-flash)
Oct 16 09:57:34 user nova-compute[74342]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 09:57:34 user nova-compute[74342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:57:34 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:57:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --login" returned: 0 in 0.084s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d920cdd0-f539-42fe-8b61-615c97792753]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:57:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f, portal: 172.16.0.220,3260]
Oct 16 09:57:34 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f, portal: 172.16.0.220,3260] successful.
Oct 16 09:57:34 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:57:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a65512-c416-41ab-a469-fd7b94602f9d]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:57:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:57:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ba66946-0ee4-45e4-9fa5-a0599eaf1b71]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:57:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)
Oct 16 09:57:34 user nova-compute[74342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa (non-flash)
Oct 16 09:57:34 user nova-compute[74342]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 09:57:34 user nova-compute[74342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:57:34 user nova-compute[74342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)
Oct 16 09:57:34 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:57:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)
Oct 16 09:57:34 user nova-compute[74342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa (non-flash)
Oct 16 09:57:34 user nova-compute[74342]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 09:57:34 user nova-compute[74342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:57:34 user nova-compute[74342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)
Oct 16 09:57:34 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:57:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:57:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 09:57:34 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 09:57:34 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 09:57:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d406a0b-6859-4abd-8ae9-9b1b3eb5a3af]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:57:34 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: None {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:57:35 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:57:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdvWcJrY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 09:57:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:57:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '23136366639633964', 'path': '/dev/sdd'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:57:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136366639633964', 'path': '/dev/sdd'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 09:57:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:56:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-359637512',display_name='tempest-TestShelveInstance-server-359637512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-359637512',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlgdxAD7+2/8I5Bmwwuxc9f9iE6qWVwSxmtHBDMK1V+4lFb8ymmohLRVrvUFwuOB4SKQFH8KIs71Bp4myXAMERD+6XX8zG+ywxbtrHDK1mSRcDXhNmnUm0DIioqGZROew==',key_name='tempest-TestShelveInstance-223238522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52331a6c86c446d7bb5e9e849eebdd18',ramdisk_id='',reservation_id='r-8avw62ul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1417500607',owner_user_name='tempest-TestShelveInstance-1417500607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:56:59Z,user_data=None,user_id='8b8ad29a34c84e95ac5513c5a670a753',uuid=575ff5fb-6cd7-4e84-b6de-c971129c7935,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a82e4268-e1e1-494b-b505-2558fa7f535e", "address": "fa:16:3e:13:f1:6f", "network": {"id": "46f96b88-d08a-4f28-bcbf-a630d369074a", "bridge": "br-int", "label": "tempest-TestShelveInstance-2043632303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52331a6c86c446d7bb5e9e849eebdd18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa82e4268-e1", "ovs_interfaceid": "a82e4268-e1e1-494b-b505-2558fa7f535e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:57:35 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Converting VIF {"id": "a82e4268-e1e1-494b-b505-2558fa7f535e", "address": "fa:16:3e:13:f1:6f", "network": {"id": "46f96b88-d08a-4f28-bcbf-a630d369074a", "bridge": "br-int", "label": "tempest-TestShelveInstance-2043632303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52331a6c86c446d7bb5e9e849eebdd18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa82e4268-e1", "ovs_interfaceid": "a82e4268-e1e1-494b-b505-2558fa7f535e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:57:35 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:f1:6f,bridge_name='br-int',has_traffic_filtering=True,id=a82e4268-e1e1-494b-b505-2558fa7f535e,network=Network(46f96b88-d08a-4f28-bcbf-a630d369074a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa82e4268-e1') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:57:35 user nova-compute[74342]: DEBUG nova.objects.instance [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lazy-loading 'pci_devices' on Instance uuid 575ff5fb-6cd7-4e84-b6de-c971129c7935 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:57:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:57:35 user nova-compute[74342]:   <uuid>575ff5fb-6cd7-4e84-b6de-c971129c7935</uuid>
Oct 16 09:57:35 user nova-compute[74342]:   <name>instance-0000001d</name>
Oct 16 09:57:35 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:57:35 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:57:35 user nova-compute[74342]:   <metadata>
Oct 16 09:57:35 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:57:35 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:57:35 user nova-compute[74342]:       <nova:name>tempest-TestShelveInstance-server-359637512</nova:name>
Oct 16 09:57:35 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:57:33</nova:creationTime>
Oct 16 09:57:35 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:57:35 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:57:35 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:57:35 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:57:35 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:57:35 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:57:35 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:57:35 user nova-compute[74342]:       <nova:owner>
Oct 16 09:57:35 user nova-compute[74342]:         <nova:user uuid="8b8ad29a34c84e95ac5513c5a670a753">tempest-TestShelveInstance-1417500607-project-member</nova:user>
Oct 16 09:57:35 user nova-compute[74342]:         <nova:project uuid="52331a6c86c446d7bb5e9e849eebdd18">tempest-TestShelveInstance-1417500607</nova:project>
Oct 16 09:57:35 user nova-compute[74342]:       </nova:owner>
Oct 16 09:57:35 user nova-compute[74342]:       <nova:ports>
Oct 16 09:57:35 user nova-compute[74342]:         <nova:port uuid="a82e4268-e1e1-494b-b505-2558fa7f535e">
Oct 16 09:57:35 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 09:57:35 user nova-compute[74342]:         </nova:port>
Oct 16 09:57:35 user nova-compute[74342]:       </nova:ports>
Oct 16 09:57:35 user nova-compute[74342]:     </nova:instance>
Oct 16 09:57:35 user nova-compute[74342]:   </metadata>
Oct 16 09:57:35 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:57:35 user nova-compute[74342]:     <system>
Oct 16 09:57:35 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:57:35 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:57:35 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:57:35 user nova-compute[74342]:       <entry name="serial">575ff5fb-6cd7-4e84-b6de-c971129c7935</entry>
Oct 16 09:57:35 user nova-compute[74342]:       <entry name="uuid">575ff5fb-6cd7-4e84-b6de-c971129c7935</entry>
Oct 16 09:57:35 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:57:35 user nova-compute[74342]:     </system>
Oct 16 09:57:35 user nova-compute[74342]:   </sysinfo>
Oct 16 09:57:35 user nova-compute[74342]:   <os>
Oct 16 09:57:35 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:57:35 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:57:35 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:57:35 user nova-compute[74342]:   </os>
Oct 16 09:57:35 user nova-compute[74342]:   <features>
Oct 16 09:57:35 user nova-compute[74342]:     <acpi/>
Oct 16 09:57:35 user nova-compute[74342]:     <apic/>
Oct 16 09:57:35 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:57:35 user nova-compute[74342]:   </features>
Oct 16 09:57:35 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:57:35 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:57:35 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:57:35 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:57:35 user nova-compute[74342]:   </clock>
Oct 16 09:57:35 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:57:35 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:57:35 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:57:35 user nova-compute[74342]:   </cpu>
Oct 16 09:57:35 user nova-compute[74342]:   <devices>
Oct 16 09:57:35 user nova-compute[74342]:     <disk type="block" device="disk">
Oct 16 09:57:35 user nova-compute[74342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:57:35 user nova-compute[74342]:       <source dev="/dev/sdd"/>
Oct 16 09:57:35 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:57:35 user nova-compute[74342]:       <serial>85fe9beb-cfb8-452d-8f97-249915dd854f</serial>
Oct 16 09:57:35 user nova-compute[74342]:     </disk>
Oct 16 09:57:35 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:57:35 user nova-compute[74342]:       <mac address="fa:16:3e:13:f1:6f"/>
Oct 16 09:57:35 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:57:35 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:57:35 user nova-compute[74342]:       <target dev="tapa82e4268-e1"/>
Oct 16 09:57:35 user nova-compute[74342]:     </interface>
Oct 16 09:57:35 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:57:35 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/575ff5fb-6cd7-4e84-b6de-c971129c7935/console.log" append="off"/>
Oct 16 09:57:35 user nova-compute[74342]:     </serial>
Oct 16 09:57:35 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:57:35 user nova-compute[74342]:     <video>
Oct 16 09:57:35 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:57:35 user nova-compute[74342]:     </video>
Oct 16 09:57:35 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:57:35 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:57:35 user nova-compute[74342]:     </rng>
Oct 16 09:57:35 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:57:35 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:57:35 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:57:35 user nova-compute[74342]:     </memballoon>
Oct 16 09:57:35 user nova-compute[74342]:   </devices>
Oct 16 09:57:35 user nova-compute[74342]: </domain>
Oct 16 09:57:35 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:57:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:56:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-359637512',display_name='tempest-TestShelveInstance-server-359637512',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-359637512',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlgdxAD7+2/8I5Bmwwuxc9f9iE6qWVwSxmtHBDMK1V+4lFb8ymmohLRVrvUFwuOB4SKQFH8KIs71Bp4myXAMERD+6XX8zG+ywxbtrHDK1mSRcDXhNmnUm0DIioqGZROew==',key_name='tempest-TestShelveInstance-223238522',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='52331a6c86c446d7bb5e9e849eebdd18',ramdisk_id='',reservation_id='r-8avw62ul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-1417500607',owner_user_name='tempest-TestShelveInstance-1417500607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:56:59Z,user_data=None,user_id='8b8ad29a34c84e95ac5513c5a670a753',uuid=575ff5fb-6cd7-4e84-b6de-c971129c7935,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a82e4268-e1e1-494b-b505-2558fa7f535e", "address": "fa:16:3e:13:f1:6f", "network": {"id": "46f96b88-d08a-4f28-bcbf-a630d369074a", "bridge": "br-int", "label": "tempest-TestShelveInstance-2043632303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52331a6c86c446d7bb5e9e849eebdd18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa82e4268-e1", "ovs_interfaceid": "a82e4268-e1e1-494b-b505-2558fa7f535e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:57:35 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Converting VIF {"id": "a82e4268-e1e1-494b-b505-2558fa7f535e", "address": "fa:16:3e:13:f1:6f", "network": {"id": "46f96b88-d08a-4f28-bcbf-a630d369074a", "bridge": "br-int", "label": "tempest-TestShelveInstance-2043632303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52331a6c86c446d7bb5e9e849eebdd18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa82e4268-e1", "ovs_interfaceid": "a82e4268-e1e1-494b-b505-2558fa7f535e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:57:35 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:f1:6f,bridge_name='br-int',has_traffic_filtering=True,id=a82e4268-e1e1-494b-b505-2558fa7f535e,network=Network(46f96b88-d08a-4f28-bcbf-a630d369074a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa82e4268-e1') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:57:35 user nova-compute[74342]: DEBUG os_vif [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:f1:6f,bridge_name='br-int',has_traffic_filtering=True,id=a82e4268-e1e1-494b-b505-2558fa7f535e,network=Network(46f96b88-d08a-4f28-bcbf-a630d369074a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa82e4268-e1') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:57:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:57:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:57:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0d72596c-e269-5e4a-8f8e-e931615e481c', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:57:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:57:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa82e4268-e1, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:57:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa82e4268-e1, col_values=(('qos', UUID('b0fb9c48-5931-4b6a-b905-171cee8a84e6')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:57:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa82e4268-e1, col_values=(('external_ids', {'iface-id': 'a82e4268-e1e1-494b-b505-2558fa7f535e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:f1:6f', 'vm-uuid': '575ff5fb-6cd7-4e84-b6de-c971129c7935'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:57:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:57:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:35 user nova-compute[74342]: INFO os_vif [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:f1:6f,bridge_name='br-int',has_traffic_filtering=True,id=a82e4268-e1e1-494b-b505-2558fa7f535e,network=Network(46f96b88-d08a-4f28-bcbf-a630d369074a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa82e4268-e1')
Oct 16 09:57:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:57:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] No VIF found with MAC fa:16:3e:13:f1:6f, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:57:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:37 user nova-compute[74342]: DEBUG nova.compute.manager [req-e15c72a1-5392-4429-88b8-9f40eae87fbf req-054b4c66-1634-4f0d-8676-c191681e5b95 service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Received event network-vif-plugged-a82e4268-e1e1-494b-b505-2558fa7f535e {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:57:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e15c72a1-5392-4429-88b8-9f40eae87fbf req-054b4c66-1634-4f0d-8676-c191681e5b95 service nova] Acquiring lock "575ff5fb-6cd7-4e84-b6de-c971129c7935-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:57:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e15c72a1-5392-4429-88b8-9f40eae87fbf req-054b4c66-1634-4f0d-8676-c191681e5b95 service nova] Lock "575ff5fb-6cd7-4e84-b6de-c971129c7935-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:57:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e15c72a1-5392-4429-88b8-9f40eae87fbf req-054b4c66-1634-4f0d-8676-c191681e5b95 service nova] Lock "575ff5fb-6cd7-4e84-b6de-c971129c7935-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:57:37 user nova-compute[74342]: DEBUG nova.compute.manager [req-e15c72a1-5392-4429-88b8-9f40eae87fbf req-054b4c66-1634-4f0d-8676-c191681e5b95 service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] No waiting events found dispatching network-vif-plugged-a82e4268-e1e1-494b-b505-2558fa7f535e {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:57:37 user nova-compute[74342]: WARNING nova.compute.manager [req-e15c72a1-5392-4429-88b8-9f40eae87fbf req-054b4c66-1634-4f0d-8676-c191681e5b95 service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Received unexpected event network-vif-plugged-a82e4268-e1e1-494b-b505-2558fa7f535e for instance with vm_state building and task_state spawning.
Oct 16 09:57:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:39 user nova-compute[74342]: DEBUG nova.compute.manager [req-15569914-6b62-48ac-8951-20e1a8649230 req-7b1aeed6-bf3e-4045-af76-04e5da8a927e service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Received event network-vif-plugged-a82e4268-e1e1-494b-b505-2558fa7f535e {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:57:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-15569914-6b62-48ac-8951-20e1a8649230 req-7b1aeed6-bf3e-4045-af76-04e5da8a927e service nova] Acquiring lock "575ff5fb-6cd7-4e84-b6de-c971129c7935-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:57:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-15569914-6b62-48ac-8951-20e1a8649230 req-7b1aeed6-bf3e-4045-af76-04e5da8a927e service nova] Lock "575ff5fb-6cd7-4e84-b6de-c971129c7935-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:57:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-15569914-6b62-48ac-8951-20e1a8649230 req-7b1aeed6-bf3e-4045-af76-04e5da8a927e service nova] Lock "575ff5fb-6cd7-4e84-b6de-c971129c7935-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:57:39 user nova-compute[74342]: DEBUG nova.compute.manager [req-15569914-6b62-48ac-8951-20e1a8649230 req-7b1aeed6-bf3e-4045-af76-04e5da8a927e service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] No waiting events found dispatching network-vif-plugged-a82e4268-e1e1-494b-b505-2558fa7f535e {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:57:39 user nova-compute[74342]: WARNING nova.compute.manager [req-15569914-6b62-48ac-8951-20e1a8649230 req-7b1aeed6-bf3e-4045-af76-04e5da8a927e service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Received unexpected event network-vif-plugged-a82e4268-e1e1-494b-b505-2558fa7f535e for instance with vm_state building and task_state spawning.
Oct 16 09:57:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "68bdaec6-80d1-48c9-9d00-8dfdc17d52c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:57:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "68bdaec6-80d1-48c9-9d00-8dfdc17d52c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:57:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "68bdaec6-80d1-48c9-9d00-8dfdc17d52c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:57:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "68bdaec6-80d1-48c9-9d00-8dfdc17d52c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:57:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "68bdaec6-80d1-48c9-9d00-8dfdc17d52c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:57:39 user nova-compute[74342]: INFO nova.compute.manager [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Terminating instance
Oct 16 09:57:39 user nova-compute[74342]: DEBUG nova.compute.manager [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 09:57:39 user nova-compute[74342]: DEBUG nova.compute.manager [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:57:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:57:39 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Instance spawned successfully.
Oct 16 09:57:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:57:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:57:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:57:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:57:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:57:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:57:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:57:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:39 user nova-compute[74342]: INFO nova.compute.manager [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Took 5.71 seconds to spawn the instance on the hypervisor.
Oct 16 09:57:39 user nova-compute[74342]: DEBUG nova.compute.manager [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:57:39 user nova-compute[74342]: DEBUG nova.compute.manager [req-d08e6674-512f-4f91-bd0f-f1869cc7311f req-4cd1e44d-2390-4b0c-a864-1b66e16e1e36 service nova] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Received event network-vif-unplugged-3cf47650-a8a5-4167-9b06-07436094d93b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:57:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d08e6674-512f-4f91-bd0f-f1869cc7311f req-4cd1e44d-2390-4b0c-a864-1b66e16e1e36 service nova] Acquiring lock "68bdaec6-80d1-48c9-9d00-8dfdc17d52c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:57:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d08e6674-512f-4f91-bd0f-f1869cc7311f req-4cd1e44d-2390-4b0c-a864-1b66e16e1e36 service nova] Lock "68bdaec6-80d1-48c9-9d00-8dfdc17d52c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:57:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d08e6674-512f-4f91-bd0f-f1869cc7311f req-4cd1e44d-2390-4b0c-a864-1b66e16e1e36 service nova] Lock "68bdaec6-80d1-48c9-9d00-8dfdc17d52c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:57:39 user nova-compute[74342]: DEBUG nova.compute.manager [req-d08e6674-512f-4f91-bd0f-f1869cc7311f req-4cd1e44d-2390-4b0c-a864-1b66e16e1e36 service nova] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] No waiting events found dispatching network-vif-unplugged-3cf47650-a8a5-4167-9b06-07436094d93b {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:57:39 user nova-compute[74342]: DEBUG nova.compute.manager [req-d08e6674-512f-4f91-bd0f-f1869cc7311f req-4cd1e44d-2390-4b0c-a864-1b66e16e1e36 service nova] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Received event network-vif-unplugged-3cf47650-a8a5-4167-9b06-07436094d93b for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 09:57:39 user nova-compute[74342]: INFO nova.compute.manager [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Took 41.23 seconds to build instance.
Oct 16 09:57:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d70fbcb6-bd35-4e76-99b8-88869f5830ef tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "575ff5fb-6cd7-4e84-b6de-c971129c7935" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.362s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:57:39 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Instance destroyed successfully.
Oct 16 09:57:39 user nova-compute[74342]: DEBUG nova.objects.instance [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lazy-loading 'resources' on Instance uuid 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-324445140',display_name='tempest-TestVolumeBootPattern-server-324445140',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-324445140',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:56:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='799c265b3d14465a9ca6bd7d5e8a4488',ramdisk_id='',reservation_id='r-j2r0ilok',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-158744824',owner_user_name='tempest-TestVolumeBootPattern-158744824-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:56:26Z,user_data=None,user_id='2cac31e799b743359b93943b68b38acf',uuid=68bdaec6-80d1-48c9-9d00-8dfdc17d52c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3cf47650-a8a5-4167-9b06-07436094d93b", "address": "fa:16:3e:ed:06:03", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf47650-a8", "ovs_interfaceid": "3cf47650-a8a5-4167-9b06-07436094d93b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converting VIF {"id": "3cf47650-a8a5-4167-9b06-07436094d93b", "address": "fa:16:3e:ed:06:03", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3cf47650-a8", "ovs_interfaceid": "3cf47650-a8a5-4167-9b06-07436094d93b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:06:03,bridge_name='br-int',has_traffic_filtering=True,id=3cf47650-a8a5-4167-9b06-07436094d93b,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cf47650-a8') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG os_vif [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:06:03,bridge_name='br-int',has_traffic_filtering=True,id=3cf47650-a8a5-4167-9b06-07436094d93b,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cf47650-a8') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3cf47650-a8, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aed0ac77-489e-4a58-8314-88aacaace281) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:40 user nova-compute[74342]: INFO os_vif [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:06:03,bridge_name='br-int',has_traffic_filtering=True,id=3cf47650-a8a5-4167-9b06-07436094d93b,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3cf47650-a8')
Oct 16 09:57:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eWtjoUxZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:57:40 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:57:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e3d2e2-ab2a-455d-9d65-022276bbc341]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 09:57:40 user nova-compute[74342]: No targets found.
Oct 16 09:57:40 user nova-compute[74342]: iSNS:
Oct 16 09:57:40 user nova-compute[74342]: No targets found.
Oct 16 09:57:40 user nova-compute[74342]: STATIC:
Oct 16 09:57:40 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3
Oct 16 09:57:40 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:57:40 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:57:40 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f
Oct 16 09:57:40 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:57:40 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:57:40 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43
Oct 16 09:57:40 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:57:40 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:57:40 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8
Oct 16 09:57:40 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:57:40 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:57:40 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa
Oct 16 09:57:40 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:57:40 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:57:40 user nova-compute[74342]: FIRMWARE:
Oct 16 09:57:40 user nova-compute[74342]: No targets found.
Oct 16 09:57:40 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 09:57:40 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 09:57:40 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[391de479-6c52-4960-92f5-7cfde1aaee6e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b84206-2a88-4491-b29c-4aa430f18610]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)
Oct 16 09:57:40 user nova-compute[74342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa (non-flash)
Oct 16 09:57:40 user nova-compute[74342]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 09:57:40 user nova-compute[74342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:57:40 user nova-compute[74342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)
Oct 16 09:57:40 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)
Oct 16 09:57:40 user nova-compute[74342]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa (non-flash)
Oct 16 09:57:40 user nova-compute[74342]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 09:57:40 user nova-compute[74342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:57:40 user nova-compute[74342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)
Oct 16 09:57:40 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b4077e290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa'): ({'sdg'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Removing single pathed devices sdg {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[672b6b61-ba4e-431b-bff9-94ade1b40303]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f402d8-6c71-46c4-8b99-ddb877c3cf79]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Flushing IO for device /dev/sdg {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3489e4e3-93f3-4c97-bf6c-803200c5ab29]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4baa2e3-e0b0-4b45-8087-16a19f4ca4e2]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] SCSI volumes sdg have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_38960fe5', '/dev/disk/by-id/scsi-1SCST_BIO38960fe5-4c8da0409c504154', '/dev/disk/by-id/scsi-23463386461303430') {{(pid=85400) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[30de8b75-0c67-446d-b934-1d36895dcda2]: (4, None) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[792f34dd-db21-4550-87f4-ae84077792e4]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a90907d-2ed0-439d-a084-fb6d8eb5fbbf]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa, portal: 172.16.0.220,3260]
Oct 16 09:57:40 user nova-compute[74342]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa, portal: 172.16.0.220,3260] successful.
Oct 16 09:57:40 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fb0ce8f-6469-41c6-825a-8c7750ad29e7]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] <== disconnect_volume: return (350ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 09:57:40 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Deleting instance files /opt/stack/data/nova/instances/68bdaec6-80d1-48c9-9d00-8dfdc17d52c4_del
Oct 16 09:57:40 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Deletion of /opt/stack/data/nova/instances/68bdaec6-80d1-48c9-9d00-8dfdc17d52c4_del complete
Oct 16 09:57:40 user nova-compute[74342]: INFO nova.compute.manager [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Took 1.25 seconds to destroy the instance on the hypervisor.
Oct 16 09:57:40 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 09:57:40 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 09:57:41 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:57:41 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Took 0.57 seconds to deallocate network for instance.
Oct 16 09:57:41 user nova-compute[74342]: DEBUG nova.compute.manager [req-66454c05-8928-4f84-8317-cc3654de8fc9 req-3d13834c-1ee7-4b6f-bd1f-b36ccac78322 service nova] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Received event network-vif-plugged-3cf47650-a8a5-4167-9b06-07436094d93b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:57:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-66454c05-8928-4f84-8317-cc3654de8fc9 req-3d13834c-1ee7-4b6f-bd1f-b36ccac78322 service nova] Acquiring lock "68bdaec6-80d1-48c9-9d00-8dfdc17d52c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:57:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-66454c05-8928-4f84-8317-cc3654de8fc9 req-3d13834c-1ee7-4b6f-bd1f-b36ccac78322 service nova] Lock "68bdaec6-80d1-48c9-9d00-8dfdc17d52c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:57:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-66454c05-8928-4f84-8317-cc3654de8fc9 req-3d13834c-1ee7-4b6f-bd1f-b36ccac78322 service nova] Lock "68bdaec6-80d1-48c9-9d00-8dfdc17d52c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:57:41 user nova-compute[74342]: DEBUG nova.compute.manager [req-66454c05-8928-4f84-8317-cc3654de8fc9 req-3d13834c-1ee7-4b6f-bd1f-b36ccac78322 service nova] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] No waiting events found dispatching network-vif-plugged-3cf47650-a8a5-4167-9b06-07436094d93b {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:57:41 user nova-compute[74342]: WARNING nova.compute.manager [req-66454c05-8928-4f84-8317-cc3654de8fc9 req-3d13834c-1ee7-4b6f-bd1f-b36ccac78322 service nova] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Received unexpected event network-vif-plugged-3cf47650-a8a5-4167-9b06-07436094d93b for instance with vm_state active and task_state deleting.
Oct 16 09:57:41 user nova-compute[74342]: DEBUG nova.compute.manager [req-66454c05-8928-4f84-8317-cc3654de8fc9 req-3d13834c-1ee7-4b6f-bd1f-b36ccac78322 service nova] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Received event network-vif-deleted-3cf47650-a8a5-4167-9b06-07436094d93b {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:57:42 user nova-compute[74342]: INFO nova.compute.manager [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Took 1.03 seconds to detach 1 volumes for instance.
Oct 16 09:57:42 user nova-compute[74342]: DEBUG nova.compute.manager [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4] Deleting volume: 2dcf0a3c-a5e7-4092-9307-ab4ad203bdaa {{(pid=74342) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 16 09:57:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:57:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:57:42 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:57:42 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:57:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.401s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:57:42 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Deleted allocations for instance 68bdaec6-80d1-48c9-9d00-8dfdc17d52c4
Oct 16 09:57:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f683548c-4a02-43f6-8af1-39e901869fc1 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "68bdaec6-80d1-48c9-9d00-8dfdc17d52c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.633s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:57:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:48 user nova-compute[74342]: DEBUG nova.compute.manager [req-76e35573-c3f6-460e-a06d-aaaab89865c9 req-858db47d-d1e9-4415-ac6b-a3553a87783f service nova] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Received event network-changed-bebf3999-cde8-46de-93e3-f80489f3b8bf {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:57:48 user nova-compute[74342]: DEBUG nova.compute.manager [req-76e35573-c3f6-460e-a06d-aaaab89865c9 req-858db47d-d1e9-4415-ac6b-a3553a87783f service nova] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Refreshing instance network info cache due to event network-changed-bebf3999-cde8-46de-93e3-f80489f3b8bf. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:57:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-76e35573-c3f6-460e-a06d-aaaab89865c9 req-858db47d-d1e9-4415-ac6b-a3553a87783f service nova] Acquiring lock "refresh_cache-7f74c903-29f2-4635-bddd-c10051728f47" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:57:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-76e35573-c3f6-460e-a06d-aaaab89865c9 req-858db47d-d1e9-4415-ac6b-a3553a87783f service nova] Acquired lock "refresh_cache-7f74c903-29f2-4635-bddd-c10051728f47" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:57:48 user nova-compute[74342]: DEBUG nova.network.neutron [req-76e35573-c3f6-460e-a06d-aaaab89865c9 req-858db47d-d1e9-4415-ac6b-a3553a87783f service nova] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Refreshing network info cache for port bebf3999-cde8-46de-93e3-f80489f3b8bf {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:57:48 user nova-compute[74342]: DEBUG nova.network.neutron [req-76e35573-c3f6-460e-a06d-aaaab89865c9 req-858db47d-d1e9-4415-ac6b-a3553a87783f service nova] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Updated VIF entry in instance network info cache for port bebf3999-cde8-46de-93e3-f80489f3b8bf. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:57:48 user nova-compute[74342]: DEBUG nova.network.neutron [req-76e35573-c3f6-460e-a06d-aaaab89865c9 req-858db47d-d1e9-4415-ac6b-a3553a87783f service nova] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Updating instance_info_cache with network_info: [{"id": "bebf3999-cde8-46de-93e3-f80489f3b8bf", "address": "fa:16:3e:76:2a:2f", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbebf3999-cd", "ovs_interfaceid": "bebf3999-cde8-46de-93e3-f80489f3b8bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:57:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-76e35573-c3f6-460e-a06d-aaaab89865c9 req-858db47d-d1e9-4415-ac6b-a3553a87783f service nova] Releasing lock "refresh_cache-7f74c903-29f2-4635-bddd-c10051728f47" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:57:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:51 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:57:52 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:57:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:57:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:57:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:57:52 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 09:57:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f74c903-29f2-4635-bddd-c10051728f47/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f74c903-29f2-4635-bddd-c10051728f47/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f74c903-29f2-4635-bddd-c10051728f47/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f74c903-29f2-4635-bddd-c10051728f47/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:53 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sde (vdc) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:57:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "eeee39f2-9728-4114-8bd3-1d05f69a1215" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:57:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "eeee39f2-9728-4114-8bd3-1d05f69a1215" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:57:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:53 user nova-compute[74342]: INFO nova.compute.manager [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Detaching volume b69a69c8-ec6a-424f-9065-933e6b7997d3
Oct 16 09:57:53 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:57:53 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:57:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:53 user nova-compute[74342]: INFO nova.virt.block_device [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Attempting to driver detach volume b69a69c8-ec6a-424f-9065-933e6b7997d3 from mountpoint /dev/vdc
Oct 16 09:57:53 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Attempting to detach device vdc from instance eeee39f2-9728-4114-8bd3-1d05f69a1215 from the persistent domain config. {{(pid=74342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 09:57:53 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 09:57:53 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:57:53 user nova-compute[74342]:   <source dev="/dev/sde"/>
Oct 16 09:57:53 user nova-compute[74342]:   <target dev="vdc" bus="virtio"/>
Oct 16 09:57:53 user nova-compute[74342]:   <serial>b69a69c8-ec6a-424f-9065-933e6b7997d3</serial>
Oct 16 09:57:53 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 09:57:53 user nova-compute[74342]: </disk>
Oct 16 09:57:53 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 09:57:53 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Successfully detached device vdc from instance eeee39f2-9728-4114-8bd3-1d05f69a1215 from the persistent domain config.
Oct 16 09:57:53 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance eeee39f2-9728-4114-8bd3-1d05f69a1215 from the live domain config. {{(pid=74342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 09:57:53 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 09:57:53 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:57:53 user nova-compute[74342]:   <source dev="/dev/sde"/>
Oct 16 09:57:53 user nova-compute[74342]:   <target dev="vdc" bus="virtio"/>
Oct 16 09:57:53 user nova-compute[74342]:   <serial>b69a69c8-ec6a-424f-9065-933e6b7997d3</serial>
Oct 16 09:57:53 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 09:57:53 user nova-compute[74342]: </disk>
Oct 16 09:57:53 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "7f74c903-29f2-4635-bddd-c10051728f47" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "7f74c903-29f2-4635-bddd-c10051728f47" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG nova.objects.instance [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lazy-loading 'flavor' on Instance uuid 7f74c903-29f2-4635-bddd-c10051728f47 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "7f74c903-29f2-4635-bddd-c10051728f47" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance eeee39f2-9728-4114-8bd3-1d05f69a1215 {{(pid=74342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "7f74c903-29f2-4635-bddd-c10051728f47" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "7f74c903-29f2-4635-bddd-c10051728f47" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:57:54 user nova-compute[74342]: INFO nova.compute.manager [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Attaching volume d5e1cdfe-2361-44d6-9bf4-95c45daec303 to /dev/vdb
Oct 16 09:57:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG os_brick.utils [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0782d551-a1ce-4013-b152-74b2b5cdca80]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2dd9c0b-b96e-47b4-9866-7794b8b8a291]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.012s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbc023c5-3e14-47c3-932f-23bc7a3f226d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e9a70da-2ffb-4fb1-abf9-17ee095722f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:57:54 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:57:54 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40a4ec8-6cca-439a-bbc1-3c1126e0fd51]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG os_brick.utils [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Updating existing volume attachment record: 223dab9d-f9f3-413f-ad03-6a783e8f6312 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:57:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:57:55 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:55 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:57:55 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:57:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=7727MB free_disk=25.140644073486328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 09:57:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:57:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:57:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance d45abd20-3a58-4657-8f4c-a426d8e39be3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:57:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 98367a96-22f0-4edb-ab03-a8eb286b437b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:57:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 4f3aa905-8eae-45cb-8019-0b991286fe42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:57:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance eeee39f2-9728-4114-8bd3-1d05f69a1215 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:57:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance aa116cab-861b-459d-b1eb-6f07e5d71e30 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:57:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7f74c903-29f2-4635-bddd-c10051728f47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:57:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 575ff5fb-6cd7-4e84-b6de-c971129c7935 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:57:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance d7607dcc-e70e-42fb-9421-c5f630706241 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:57:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 09:57:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 09:57:55 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:57:55 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:57:55 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 09:57:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.408s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:57:57 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:57:57 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 09:57:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-98367a96-22f0-4edb-ab03-a8eb286b437b" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:57:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-98367a96-22f0-4edb-ab03-a8eb286b437b" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:57:57 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 09:57:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:57:58 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Updating instance_info_cache with network_info: [{"id": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "address": "fa:16:3e:7a:58:71", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f58c77-45", "ovs_interfaceid": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:57:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-98367a96-22f0-4edb-ab03-a8eb286b437b" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:57:58 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 09:57:58 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:57:58 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:57:58 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:58:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:00 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:58:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cb5b7629-0be2-42b2-862a-7a69cd137878 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "d45abd20-3a58-4657-8f4c-a426d8e39be3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:58:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cb5b7629-0be2-42b2-862a-7a69cd137878 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "d45abd20-3a58-4657-8f4c-a426d8e39be3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:58:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cb5b7629-0be2-42b2-862a-7a69cd137878 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "d45abd20-3a58-4657-8f4c-a426d8e39be3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:58:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cb5b7629-0be2-42b2-862a-7a69cd137878 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "d45abd20-3a58-4657-8f4c-a426d8e39be3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:58:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cb5b7629-0be2-42b2-862a-7a69cd137878 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "d45abd20-3a58-4657-8f4c-a426d8e39be3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:58:02 user nova-compute[74342]: INFO nova.compute.manager [None req-cb5b7629-0be2-42b2-862a-7a69cd137878 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Terminating instance
Oct 16 09:58:02 user nova-compute[74342]: DEBUG nova.compute.manager [None req-cb5b7629-0be2-42b2-862a-7a69cd137878 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 09:58:02 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:58:02 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:58:02 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 09:58:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-a5a520c3-eb88-472e-928b-b473209d30af req-18f77f8f-e965-4437-9c6b-a8a045480894 service nova] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Received event network-vif-unplugged-2e5ec9cf-9b58-47bc-be15-0b896a7625bc {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:58:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a5a520c3-eb88-472e-928b-b473209d30af req-18f77f8f-e965-4437-9c6b-a8a045480894 service nova] Acquiring lock "d45abd20-3a58-4657-8f4c-a426d8e39be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:58:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a5a520c3-eb88-472e-928b-b473209d30af req-18f77f8f-e965-4437-9c6b-a8a045480894 service nova] Lock "d45abd20-3a58-4657-8f4c-a426d8e39be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:58:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a5a520c3-eb88-472e-928b-b473209d30af req-18f77f8f-e965-4437-9c6b-a8a045480894 service nova] Lock "d45abd20-3a58-4657-8f4c-a426d8e39be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:58:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-a5a520c3-eb88-472e-928b-b473209d30af req-18f77f8f-e965-4437-9c6b-a8a045480894 service nova] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] No waiting events found dispatching network-vif-unplugged-2e5ec9cf-9b58-47bc-be15-0b896a7625bc {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:58:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-a5a520c3-eb88-472e-928b-b473209d30af req-18f77f8f-e965-4437-9c6b-a8a045480894 service nova] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Received event network-vif-unplugged-2e5ec9cf-9b58-47bc-be15-0b896a7625bc for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 09:58:03 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Instance destroyed successfully.
Oct 16 09:58:03 user nova-compute[74342]: DEBUG nova.objects.instance [None req-cb5b7629-0be2-42b2-862a-7a69cd137878 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lazy-loading 'resources' on Instance uuid d45abd20-3a58-4657-8f4c-a426d8e39be3 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:58:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-cb5b7629-0be2-42b2-862a-7a69cd137878 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:43:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-664158185',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-664158185',id=1,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:44:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a4fcf2437a2d413ea584d0cc2508bed3',ramdisk_id='',reservation_id='r-nswunun9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-476995503',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:45:52Z,user_data=None,user_id='f90f091b76254a13957807feaeaef3fc',uuid=d45abd20-3a58-4657-8f4c-a426d8e39be3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e5ec9cf-9b58-47bc-be15-0b896a7625bc", "address": "fa:16:3e:8c:de:8b", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e5ec9cf-9b", "ovs_interfaceid": "2e5ec9cf-9b58-47bc-be15-0b896a7625bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:58:03 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-cb5b7629-0be2-42b2-862a-7a69cd137878 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Converting VIF {"id": "2e5ec9cf-9b58-47bc-be15-0b896a7625bc", "address": "fa:16:3e:8c:de:8b", "network": {"id": "a571ad70-6f8b-4b02-86b9-df50290509f6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-292826937-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a4fcf2437a2d413ea584d0cc2508bed3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e5ec9cf-9b", "ovs_interfaceid": "2e5ec9cf-9b58-47bc-be15-0b896a7625bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:58:03 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-cb5b7629-0be2-42b2-862a-7a69cd137878 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8c:de:8b,bridge_name='br-int',has_traffic_filtering=True,id=2e5ec9cf-9b58-47bc-be15-0b896a7625bc,network=Network(a571ad70-6f8b-4b02-86b9-df50290509f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e5ec9cf-9b') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:58:03 user nova-compute[74342]: DEBUG os_vif [None req-cb5b7629-0be2-42b2-862a-7a69cd137878 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:de:8b,bridge_name='br-int',has_traffic_filtering=True,id=2e5ec9cf-9b58-47bc-be15-0b896a7625bc,network=Network(a571ad70-6f8b-4b02-86b9-df50290509f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e5ec9cf-9b') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:58:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e5ec9cf-9b, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:58:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:58:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=59a206b1-497f-491f-b6f8-ba53303b8fae) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:58:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:03 user nova-compute[74342]: INFO os_vif [None req-cb5b7629-0be2-42b2-862a-7a69cd137878 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8c:de:8b,bridge_name='br-int',has_traffic_filtering=True,id=2e5ec9cf-9b58-47bc-be15-0b896a7625bc,network=Network(a571ad70-6f8b-4b02-86b9-df50290509f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e5ec9cf-9b')
Oct 16 09:58:03 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-cb5b7629-0be2-42b2-862a-7a69cd137878 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Deleting instance files /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3_del
Oct 16 09:58:03 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-cb5b7629-0be2-42b2-862a-7a69cd137878 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Deletion of /opt/stack/data/nova/instances/d45abd20-3a58-4657-8f4c-a426d8e39be3_del complete
Oct 16 09:58:03 user nova-compute[74342]: INFO nova.compute.manager [None req-cb5b7629-0be2-42b2-862a-7a69cd137878 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Took 0.80 seconds to destroy the instance on the hypervisor.
Oct 16 09:58:03 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-cb5b7629-0be2-42b2-862a-7a69cd137878 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 09:58:03 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 09:58:03 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 09:58:03 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:58:03 user nova-compute[74342]: DEBUG nova.compute.manager [req-cdbc9fa9-3779-4649-8099-9b3ca61ed121 req-3740fed0-1e77-48ed-a4c4-8befb035985e service nova] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Received event network-vif-deleted-2e5ec9cf-9b58-47bc-be15-0b896a7625bc {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:58:03 user nova-compute[74342]: INFO nova.compute.manager [req-cdbc9fa9-3779-4649-8099-9b3ca61ed121 req-3740fed0-1e77-48ed-a4c4-8befb035985e service nova] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Neutron deleted interface 2e5ec9cf-9b58-47bc-be15-0b896a7625bc; detaching it from the instance and deleting it from the info cache
Oct 16 09:58:03 user nova-compute[74342]: DEBUG nova.network.neutron [req-cdbc9fa9-3779-4649-8099-9b3ca61ed121 req-3740fed0-1e77-48ed-a4c4-8befb035985e service nova] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:58:03 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Took 0.46 seconds to deallocate network for instance.
Oct 16 09:58:03 user nova-compute[74342]: DEBUG nova.compute.manager [req-cdbc9fa9-3779-4649-8099-9b3ca61ed121 req-3740fed0-1e77-48ed-a4c4-8befb035985e service nova] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Detach interface failed, port_id=2e5ec9cf-9b58-47bc-be15-0b896a7625bc, reason: Instance d45abd20-3a58-4657-8f4c-a426d8e39be3 could not be found. {{(pid=74342) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 09:58:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cb5b7629-0be2-42b2-862a-7a69cd137878 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:58:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cb5b7629-0be2-42b2-862a-7a69cd137878 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:58:03 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-cb5b7629-0be2-42b2-862a-7a69cd137878 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:58:03 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-cb5b7629-0be2-42b2-862a-7a69cd137878 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:58:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cb5b7629-0be2-42b2-862a-7a69cd137878 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.306s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:58:04 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-cb5b7629-0be2-42b2-862a-7a69cd137878 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Deleted allocations for instance d45abd20-3a58-4657-8f4c-a426d8e39be3
Oct 16 09:58:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-cb5b7629-0be2-42b2-862a-7a69cd137878 tempest-ServerBootFromVolumeStableRescueTest-476995503 tempest-ServerBootFromVolumeStableRescueTest-476995503-project-member] Lock "d45abd20-3a58-4657-8f4c-a426d8e39be3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.759s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:58:04 user nova-compute[74342]: DEBUG nova.compute.manager [req-7a6cb291-34c6-41a7-ae9b-22a6d4b15f7d req-62c1c84e-7a77-4616-bebc-bbbd80a59b05 service nova] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Received event network-vif-plugged-2e5ec9cf-9b58-47bc-be15-0b896a7625bc {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:58:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-7a6cb291-34c6-41a7-ae9b-22a6d4b15f7d req-62c1c84e-7a77-4616-bebc-bbbd80a59b05 service nova] Acquiring lock "d45abd20-3a58-4657-8f4c-a426d8e39be3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:58:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-7a6cb291-34c6-41a7-ae9b-22a6d4b15f7d req-62c1c84e-7a77-4616-bebc-bbbd80a59b05 service nova] Lock "d45abd20-3a58-4657-8f4c-a426d8e39be3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:58:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-7a6cb291-34c6-41a7-ae9b-22a6d4b15f7d req-62c1c84e-7a77-4616-bebc-bbbd80a59b05 service nova] Lock "d45abd20-3a58-4657-8f4c-a426d8e39be3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:58:04 user nova-compute[74342]: DEBUG nova.compute.manager [req-7a6cb291-34c6-41a7-ae9b-22a6d4b15f7d req-62c1c84e-7a77-4616-bebc-bbbd80a59b05 service nova] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] No waiting events found dispatching network-vif-plugged-2e5ec9cf-9b58-47bc-be15-0b896a7625bc {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:58:04 user nova-compute[74342]: WARNING nova.compute.manager [req-7a6cb291-34c6-41a7-ae9b-22a6d4b15f7d req-62c1c84e-7a77-4616-bebc-bbbd80a59b05 service nova] [instance: d45abd20-3a58-4657-8f4c-a426d8e39be3] Received unexpected event network-vif-plugged-2e5ec9cf-9b58-47bc-be15-0b896a7625bc for instance with vm_state deleted and task_state None.
Oct 16 09:58:07 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:58:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QScWjxiy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:58:12 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:58:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:58:12 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:58:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:58:12 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fdda1c-7acd-409e-b5d8-737a471feabc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 09:58:12 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[40748a33-234c-4f06-abb6-499b2a71669a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303] added
Oct 16 09:58:12 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eec48c8-865d-4a26-8f2d-adf53bf4db51]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c782c7-0596-4bd6-b34f-77a7ffbb23da]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QScWjxiy {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QScWjxiy" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41e2f3c-2f8c-48e1-8232-2da7b5fb6e63]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QScWjxiy'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2dc880-616e-496a-a8b1-88065d52ab79]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d494ab36-57a1-4d55-a94e-47021e7658d4]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe6c3034-6a67-4a91-8513-ffc0e5211bb3 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)
Oct 16 09:58:12 user nova-compute[74342]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 09:58:12 user nova-compute[74342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:58:12 user nova-compute[74342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)
Oct 16 09:58:12 user nova-compute[74342]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe6c3034-6a67-4a91-8513-ffc0e5211bb3 (non-flash)
Oct 16 09:58:12 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)
Oct 16 09:58:12 user nova-compute[74342]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 09:58:12 user nova-compute[74342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:58:12 user nova-compute[74342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)
Oct 16 09:58:12 user nova-compute[74342]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe6c3034-6a67-4a91-8513-ffc0e5211bb3 (non-flash)
Oct 16 09:58:12 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fbb7d0c-f37e-4307-a21d-e4c176c7141f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303, portal: 172.16.0.220,3260]
Oct 16 09:58:12 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303, portal: 172.16.0.220,3260] successful.
Oct 16 09:58:12 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c3debf2-9c2f-4112-bcd7-fc4e9bee0795]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c42447-358d-4627-b409-14d8c26121c4]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe6c3034-6a67-4a91-8513-ffc0e5211bb3 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)
Oct 16 09:58:12 user nova-compute[74342]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 09:58:12 user nova-compute[74342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:58:12 user nova-compute[74342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)
Oct 16 09:58:12 user nova-compute[74342]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe6c3034-6a67-4a91-8513-ffc0e5211bb3 (non-flash)
Oct 16 09:58:12 user nova-compute[74342]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 (non-flash)
Oct 16 09:58:12 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)
Oct 16 09:58:12 user nova-compute[74342]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 09:58:12 user nova-compute[74342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:58:12 user nova-compute[74342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)
Oct 16 09:58:12 user nova-compute[74342]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe6c3034-6a67-4a91-8513-ffc0e5211bb3 (non-flash)
Oct 16 09:58:12 user nova-compute[74342]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 (non-flash)
Oct 16 09:58:12 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] HCTL ('38', '-', '-', 0) found on session 26 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f17bd44-ffd4-4c17-8925-e71882ef7940]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Searching for a device in session 26 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:58:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QScWjxiy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 09:58:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:58:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] <== connect_volume: return (1329ms) {'type': 'block', 'scsi_wwn': '23330303166363862', 'path': '/dev/sdg'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:58:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23330303166363862', 'path': '/dev/sdg'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 09:58:13 user nova-compute[74342]: DEBUG nova.objects.instance [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lazy-loading 'flavor' on Instance uuid 7f74c903-29f2-4635-bddd-c10051728f47 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:58:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 09:58:13 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:58:13 user nova-compute[74342]:   <source dev="/dev/sdg"/>
Oct 16 09:58:13 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:58:13 user nova-compute[74342]:   <serial>d5e1cdfe-2361-44d6-9bf4-95c45daec303</serial>
Oct 16 09:58:13 user nova-compute[74342]: </disk>
Oct 16 09:58:13 user nova-compute[74342]:  {{(pid=74342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] No VIF found with MAC fa:16:3e:76:2a:2f, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b9f63d09-7ace-43df-9bd3-96e7459fc165 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "7f74c903-29f2-4635-bddd-c10051728f47" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.707s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:58:14 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance eeee39f2-9728-4114-8bd3-1d05f69a1215 is timed out.
Oct 16 09:58:14 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Successfully detached device vdc from instance eeee39f2-9728-4114-8bd3-1d05f69a1215 from the live domain config.
Oct 16 09:58:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ygxzELjY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:58:14 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:58:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c79580b7-2687-4267-b604-d0b1c05a1f01]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fe6c3034-6a67-4a91-8513-ffc0e5211bb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 09:58:14 user nova-compute[74342]: No targets found.
Oct 16 09:58:14 user nova-compute[74342]: iSNS:
Oct 16 09:58:14 user nova-compute[74342]: No targets found.
Oct 16 09:58:14 user nova-compute[74342]: STATIC:
Oct 16 09:58:14 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3
Oct 16 09:58:14 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:58:14 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:58:14 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303
Oct 16 09:58:14 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:58:14 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:58:14 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f
Oct 16 09:58:14 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:58:14 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:58:14 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43
Oct 16 09:58:14 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:58:14 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:58:14 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:fe6c3034-6a67-4a91-8513-ffc0e5211bb3
Oct 16 09:58:14 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:58:14 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:58:14 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8
Oct 16 09:58:14 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:58:14 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:58:14 user nova-compute[74342]: FIRMWARE:
Oct 16 09:58:14 user nova-compute[74342]: No targets found.
Oct 16 09:58:14 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 09:58:14 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 09:58:14 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[11233857-d4e8-454e-a130-e9448ec8ffa1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fe6c3034-6a67-4a91-8513-ffc0e5211bb3\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cd1a2eb-326d-4b18-a7b8-7c9199b97879]: (4, ('tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe6c3034-6a67-4a91-8513-ffc0e5211bb3 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)
Oct 16 09:58:14 user nova-compute[74342]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 09:58:14 user nova-compute[74342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:58:14 user nova-compute[74342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)
Oct 16 09:58:14 user nova-compute[74342]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe6c3034-6a67-4a91-8513-ffc0e5211bb3 (non-flash)
Oct 16 09:58:14 user nova-compute[74342]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 (non-flash)
Oct 16 09:58:14 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] iscsi session list stdout=tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 (non-flash)
Oct 16 09:58:14 user nova-compute[74342]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 09:58:14 user nova-compute[74342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:58:14 user nova-compute[74342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)
Oct 16 09:58:14 user nova-compute[74342]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fe6c3034-6a67-4a91-8513-ffc0e5211bb3 (non-flash)
Oct 16 09:58:14 user nova-compute[74342]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 (non-flash)
Oct 16 09:58:14 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b407bd7e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3'): ({'sde'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Removing single pathed devices sde {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d83b26f-21f5-4588-8c74-e082e99b7175]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9336efcf-51a6-47ac-829a-304e19583b04]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Flushing IO for device /dev/sde {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d54ee6b6-6248-4b4b-8f08-05e6bd4f4b99]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.046s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a3ea76-a7db-4892-b4b5-a7a654e413ab]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] SCSI volumes sde have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1c4313a-f63a-46e5-9680-e788c36036e5]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea2c5dc-ad34-4392-a3a5-95389589cff0]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3, portal: 172.16.0.220,3260]
Oct 16 09:58:14 user nova-compute[74342]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3, portal: 172.16.0.220,3260] successful.
Oct 16 09:58:14 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b69a69c8-ec6a-424f-9065-933e6b7997d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb1dbe6-7ae0-4083-a044-63471c65fde0]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] <== disconnect_volume: return (322ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:58:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 09:58:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "7f74c903-29f2-4635-bddd-c10051728f47" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:58:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "7f74c903-29f2-4635-bddd-c10051728f47" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:58:15 user nova-compute[74342]: INFO nova.compute.manager [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Detaching volume d5e1cdfe-2361-44d6-9bf4-95c45daec303
Oct 16 09:58:15 user nova-compute[74342]: INFO nova.virt.block_device [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Attempting to driver detach volume d5e1cdfe-2361-44d6-9bf4-95c45daec303 from mountpoint /dev/vdb
Oct 16 09:58:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Attempting to detach device vdb from instance 7f74c903-29f2-4635-bddd-c10051728f47 from the persistent domain config. {{(pid=74342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 09:58:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 09:58:15 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:58:15 user nova-compute[74342]:   <source dev="/dev/sdg"/>
Oct 16 09:58:15 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:58:15 user nova-compute[74342]:   <serial>d5e1cdfe-2361-44d6-9bf4-95c45daec303</serial>
Oct 16 09:58:15 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 09:58:15 user nova-compute[74342]: </disk>
Oct 16 09:58:15 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 09:58:15 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Successfully detached device vdb from instance 7f74c903-29f2-4635-bddd-c10051728f47 from the persistent domain config.
Oct 16 09:58:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7f74c903-29f2-4635-bddd-c10051728f47 from the live domain config. {{(pid=74342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 09:58:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 09:58:15 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:58:15 user nova-compute[74342]:   <source dev="/dev/sdg"/>
Oct 16 09:58:15 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:58:15 user nova-compute[74342]:   <serial>d5e1cdfe-2361-44d6-9bf4-95c45daec303</serial>
Oct 16 09:58:15 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 09:58:15 user nova-compute[74342]: </disk>
Oct 16 09:58:15 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 09:58:15 user nova-compute[74342]: DEBUG nova.objects.instance [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lazy-loading 'flavor' on Instance uuid eeee39f2-9728-4114-8bd3-1d05f69a1215 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:58:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f1f2b6a1-8601-4fc6-b62a-0b600331f99d tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "eeee39f2-9728-4114-8bd3-1d05f69a1215" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.868s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:58:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7f74c903-29f2-4635-bddd-c10051728f47 {{(pid=74342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 09:58:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:58:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:58:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 09:58:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 09:58:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 09:58:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:29 user nova-compute[74342]: DEBUG nova.compute.manager [req-04b22880-cc11-4950-8dc3-4c1c1cb3eeca req-efcb5768-bb25-4344-97f9-26e635759731 service nova] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Received event network-changed-75f58c77-45a5-4951-951c-4c0bb6ac8bf3 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:58:29 user nova-compute[74342]: DEBUG nova.compute.manager [req-04b22880-cc11-4950-8dc3-4c1c1cb3eeca req-efcb5768-bb25-4344-97f9-26e635759731 service nova] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Refreshing instance network info cache due to event network-changed-75f58c77-45a5-4951-951c-4c0bb6ac8bf3. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:58:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-04b22880-cc11-4950-8dc3-4c1c1cb3eeca req-efcb5768-bb25-4344-97f9-26e635759731 service nova] Acquiring lock "refresh_cache-98367a96-22f0-4edb-ab03-a8eb286b437b" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:58:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-04b22880-cc11-4950-8dc3-4c1c1cb3eeca req-efcb5768-bb25-4344-97f9-26e635759731 service nova] Acquired lock "refresh_cache-98367a96-22f0-4edb-ab03-a8eb286b437b" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:58:29 user nova-compute[74342]: DEBUG nova.network.neutron [req-04b22880-cc11-4950-8dc3-4c1c1cb3eeca req-efcb5768-bb25-4344-97f9-26e635759731 service nova] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Refreshing network info cache for port 75f58c77-45a5-4951-951c-4c0bb6ac8bf3 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:58:30 user nova-compute[74342]: DEBUG nova.network.neutron [req-04b22880-cc11-4950-8dc3-4c1c1cb3eeca req-efcb5768-bb25-4344-97f9-26e635759731 service nova] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Updated VIF entry in instance network info cache for port 75f58c77-45a5-4951-951c-4c0bb6ac8bf3. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:58:30 user nova-compute[74342]: DEBUG nova.network.neutron [req-04b22880-cc11-4950-8dc3-4c1c1cb3eeca req-efcb5768-bb25-4344-97f9-26e635759731 service nova] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Updating instance_info_cache with network_info: [{"id": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "address": "fa:16:3e:7a:58:71", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f58c77-45", "ovs_interfaceid": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:58:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-04b22880-cc11-4950-8dc3-4c1c1cb3eeca req-efcb5768-bb25-4344-97f9-26e635759731 service nova] Releasing lock "refresh_cache-98367a96-22f0-4edb-ab03-a8eb286b437b" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:58:31 user nova-compute[74342]: DEBUG nova.compute.manager [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Stashing vm_state: active {{(pid=74342) _prep_resize /opt/stack/nova/nova/compute/manager.py:5614}}
Oct 16 09:58:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:58:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:58:31 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:58:31 user nova-compute[74342]: INFO nova.compute.claims [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Claim successful on node user
Oct 16 09:58:31 user nova-compute[74342]: INFO nova.compute.resource_tracker [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Updating resource usage from migration 3a28f569-b70a-4cf0-8e82-243ef43ac167
Oct 16 09:58:32 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:58:32 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:58:32 user nova-compute[74342]: DEBUG nova.compute.manager [req-5643e85a-2d0a-45e8-a626-5e2bd4a988f4 req-41b92b76-028a-47d6-8182-e12ab336a4be service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Received event network-changed-480ecd6b-63b3-43be-8c76-98216f55e06a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:58:32 user nova-compute[74342]: DEBUG nova.compute.manager [req-5643e85a-2d0a-45e8-a626-5e2bd4a988f4 req-41b92b76-028a-47d6-8182-e12ab336a4be service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Refreshing instance network info cache due to event network-changed-480ecd6b-63b3-43be-8c76-98216f55e06a. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:58:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5643e85a-2d0a-45e8-a626-5e2bd4a988f4 req-41b92b76-028a-47d6-8182-e12ab336a4be service nova] Acquiring lock "refresh_cache-aa116cab-861b-459d-b1eb-6f07e5d71e30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:58:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5643e85a-2d0a-45e8-a626-5e2bd4a988f4 req-41b92b76-028a-47d6-8182-e12ab336a4be service nova] Acquired lock "refresh_cache-aa116cab-861b-459d-b1eb-6f07e5d71e30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:58:32 user nova-compute[74342]: DEBUG nova.network.neutron [req-5643e85a-2d0a-45e8-a626-5e2bd4a988f4 req-41b92b76-028a-47d6-8182-e12ab336a4be service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Refreshing network info cache for port 480ecd6b-63b3-43be-8c76-98216f55e06a {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:58:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.596s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:58:32 user nova-compute[74342]: INFO nova.compute.manager [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Migrating
Oct 16 09:58:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "refresh_cache-aa116cab-861b-459d-b1eb-6f07e5d71e30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:58:32 user nova-compute[74342]: DEBUG nova.network.neutron [req-5643e85a-2d0a-45e8-a626-5e2bd4a988f4 req-41b92b76-028a-47d6-8182-e12ab336a4be service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Updated VIF entry in instance network info cache for port 480ecd6b-63b3-43be-8c76-98216f55e06a. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:58:32 user nova-compute[74342]: DEBUG nova.network.neutron [req-5643e85a-2d0a-45e8-a626-5e2bd4a988f4 req-41b92b76-028a-47d6-8182-e12ab336a4be service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Updating instance_info_cache with network_info: [{"id": "480ecd6b-63b3-43be-8c76-98216f55e06a", "address": "fa:16:3e:5c:87:e5", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480ecd6b-63", "ovs_interfaceid": "480ecd6b-63b3-43be-8c76-98216f55e06a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:58:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5643e85a-2d0a-45e8-a626-5e2bd4a988f4 req-41b92b76-028a-47d6-8182-e12ab336a4be service nova] Releasing lock "refresh_cache-aa116cab-861b-459d-b1eb-6f07e5d71e30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:58:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquired lock "refresh_cache-aa116cab-861b-459d-b1eb-6f07e5d71e30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:58:32 user nova-compute[74342]: DEBUG nova.network.neutron [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:58:33 user nova-compute[74342]: DEBUG nova.network.neutron [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Updating instance_info_cache with network_info: [{"id": "480ecd6b-63b3-43be-8c76-98216f55e06a", "address": "fa:16:3e:5c:87:e5", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480ecd6b-63", "ovs_interfaceid": "480ecd6b-63b3-43be-8c76-98216f55e06a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:58:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Releasing lock "refresh_cache-aa116cab-861b-459d-b1eb-6f07e5d71e30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:58:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:33 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Starting migrate_disk_and_power_off {{(pid=74342) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Oct 16 09:58:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:33 user nova-compute[74342]: DEBUG nova.compute.manager [req-329ebf13-030a-4ba6-a936-580170b40c9e req-47eead65-15ea-4503-9d00-ce8dba39181a service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Received event network-vif-unplugged-480ecd6b-63b3-43be-8c76-98216f55e06a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:58:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-329ebf13-030a-4ba6-a936-580170b40c9e req-47eead65-15ea-4503-9d00-ce8dba39181a service nova] Acquiring lock "aa116cab-861b-459d-b1eb-6f07e5d71e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:58:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-329ebf13-030a-4ba6-a936-580170b40c9e req-47eead65-15ea-4503-9d00-ce8dba39181a service nova] Lock "aa116cab-861b-459d-b1eb-6f07e5d71e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:58:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-329ebf13-030a-4ba6-a936-580170b40c9e req-47eead65-15ea-4503-9d00-ce8dba39181a service nova] Lock "aa116cab-861b-459d-b1eb-6f07e5d71e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:58:33 user nova-compute[74342]: DEBUG nova.compute.manager [req-329ebf13-030a-4ba6-a936-580170b40c9e req-47eead65-15ea-4503-9d00-ce8dba39181a service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] No waiting events found dispatching network-vif-unplugged-480ecd6b-63b3-43be-8c76-98216f55e06a {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:58:33 user nova-compute[74342]: WARNING nova.compute.manager [req-329ebf13-030a-4ba6-a936-580170b40c9e req-47eead65-15ea-4503-9d00-ce8dba39181a service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Received unexpected event network-vif-unplugged-480ecd6b-63b3-43be-8c76-98216f55e06a for instance with vm_state active and task_state resize_migrating.
Oct 16 09:58:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:34 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Instance destroyed successfully.
Oct 16 09:58:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1222282830',display_name='tempest-ServerActionsTestOtherA-server-1222282830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1222282830',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5Nn7Cd9XA4JGuwKexWOVVgfutTMETbY1OUIw/2Lg/7f8J0Bw2Ei1JnC+VmVg9p5to1vwEeuuESoLWsMybdIS98JRtnBeQn9/1YcrhMFyK9tNXAGp/a4/hIqjXfamZ4kQ==',key_name='tempest-keypair-772403242',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:56:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='355bac247f9d4ea8b3c2f0d87453f4c1',ramdisk_id='',reservation_id='r-g85xdm18',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1004911708',owner_user_name='tempest-ServerActionsTestOtherA-1004911708-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:58:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3c728429a0a42789cfc0f1251d6f623',uuid=aa116cab-861b-459d-b1eb-6f07e5d71e30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "480ecd6b-63b3-43be-8c76-98216f55e06a", "address": "fa:16:3e:5c:87:e5", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-409788226-network", "vif_mac": "fa:16:3e:5c:87:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480ecd6b-63", "ovs_interfaceid": "480ecd6b-63b3-43be-8c76-98216f55e06a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Converting VIF {"id": "480ecd6b-63b3-43be-8c76-98216f55e06a", "address": "fa:16:3e:5c:87:e5", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-409788226-network", "vif_mac": "fa:16:3e:5c:87:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480ecd6b-63", "ovs_interfaceid": "480ecd6b-63b3-43be-8c76-98216f55e06a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:87:e5,bridge_name='br-int',has_traffic_filtering=True,id=480ecd6b-63b3-43be-8c76-98216f55e06a,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480ecd6b-63') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG os_vif [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:87:e5,bridge_name='br-int',has_traffic_filtering=True,id=480ecd6b-63b3-43be-8c76-98216f55e06a,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480ecd6b-63') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap480ecd6b-63, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e6c4679e-764e-437b-8917-f53501cd14ab) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:58:34 user nova-compute[74342]: INFO os_vif [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:87:e5,bridge_name='br-int',has_traffic_filtering=True,id=480ecd6b-63b3-43be-8c76-98216f55e06a,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480ecd6b-63')
Oct 16 09:58:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CoeJBEON', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:58:34 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:58:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6902bc6-6445-485c-b42f-a057818b2fad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 09:58:34 user nova-compute[74342]: No targets found.
Oct 16 09:58:34 user nova-compute[74342]: iSNS:
Oct 16 09:58:34 user nova-compute[74342]: No targets found.
Oct 16 09:58:34 user nova-compute[74342]: STATIC:
Oct 16 09:58:34 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303
Oct 16 09:58:34 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:58:34 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:58:34 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f
Oct 16 09:58:34 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:58:34 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:58:34 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43
Oct 16 09:58:34 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:58:34 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:58:34 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8
Oct 16 09:58:34 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:58:34 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:58:34 user nova-compute[74342]: FIRMWARE:
Oct 16 09:58:34 user nova-compute[74342]: No targets found.
Oct 16 09:58:34 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 09:58:34 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 09:58:34 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f7e6785-bdaa-4ea9-9639-ee5811ea7aa6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "4f3aa905-8eae-45cb-8019-0b991286fe42" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:58:34 user nova-compute[74342]: INFO nova.compute.manager [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Detaching volume 6e3a5814-40f6-46ab-aca8-2f0a72768a43
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0acb04-80c3-40fa-877f-cec0fe58caaa]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 09:58:34 user nova-compute[74342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:58:34 user nova-compute[74342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)
Oct 16 09:58:34 user nova-compute[74342]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 (non-flash)
Oct 16 09:58:34 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 09:58:34 user nova-compute[74342]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:58:34 user nova-compute[74342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)
Oct 16 09:58:34 user nova-compute[74342]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 (non-flash)
Oct 16 09:58:34 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b4077ecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8'): ({'sdc'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Removing single pathed devices sdc {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9611f153-f31c-4339-8ac6-eb1354b2c581]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26298cf-d4fa-4b1c-8d97-4cd1fc09d161]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Flushing IO for device /dev/sdc {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[17b8a5cb-f9d9-478d-b4f4-ca10ff7cee70]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:34 user nova-compute[74342]: INFO nova.virt.block_device [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Attempting to driver detach volume 6e3a5814-40f6-46ab-aca8-2f0a72768a43 from mountpoint /dev/vdb
Oct 16 09:58:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Attempting to detach device vdb from instance 4f3aa905-8eae-45cb-8019-0b991286fe42 from the persistent domain config. {{(pid=74342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 09:58:34 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:58:34 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 09:58:34 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:58:34 user nova-compute[74342]:   <serial>6e3a5814-40f6-46ab-aca8-2f0a72768a43</serial>
Oct 16 09:58:34 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 09:58:34 user nova-compute[74342]: </disk>
Oct 16 09:58:34 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 09:58:34 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Successfully detached device vdb from instance 4f3aa905-8eae-45cb-8019-0b991286fe42 from the persistent domain config.
Oct 16 09:58:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4f3aa905-8eae-45cb-8019-0b991286fe42 from the live domain config. {{(pid=74342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 09:58:34 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:58:34 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 09:58:34 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 09:58:34 user nova-compute[74342]:   <serial>6e3a5814-40f6-46ab-aca8-2f0a72768a43</serial>
Oct 16 09:58:34 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 09:58:34 user nova-compute[74342]: </disk>
Oct 16 09:58:34 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a229f94-257c-437b-8d5a-d7a155ed1fad]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] SCSI volumes sdc have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO92649e02-2d0100b4158d3b9a', '/dev/disk/by-id/scsi-23264303130306234', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_92649e02') {{(pid=85400) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7216697-0351-41ee-8cdc-7b71f4ba53ba]: (4, None) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f79fba-01af-4693-8d87-e99103ba7a27]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1d757b-9b91-419c-b06c-6c979e70ee1f]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8, portal: 172.16.0.220,3260]
Oct 16 09:58:34 user nova-compute[74342]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8, portal: 172.16.0.220,3260] successful.
Oct 16 09:58:34 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c0003c4-deeb-4623-b2db-2b725398885e]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] <== disconnect_volume: return (347ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:58:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4f3aa905-8eae-45cb-8019-0b991286fe42 {{(pid=74342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 09:58:35 user nova-compute[74342]: DEBUG nova.compute.manager [req-cd55bdb0-415d-468a-ab68-554dbb622b21 req-a59de14e-5051-415e-9003-613a322e2a2f service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Received event network-vif-plugged-480ecd6b-63b3-43be-8c76-98216f55e06a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:58:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-cd55bdb0-415d-468a-ab68-554dbb622b21 req-a59de14e-5051-415e-9003-613a322e2a2f service nova] Acquiring lock "aa116cab-861b-459d-b1eb-6f07e5d71e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:58:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-cd55bdb0-415d-468a-ab68-554dbb622b21 req-a59de14e-5051-415e-9003-613a322e2a2f service nova] Lock "aa116cab-861b-459d-b1eb-6f07e5d71e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:58:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-cd55bdb0-415d-468a-ab68-554dbb622b21 req-a59de14e-5051-415e-9003-613a322e2a2f service nova] Lock "aa116cab-861b-459d-b1eb-6f07e5d71e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:58:35 user nova-compute[74342]: DEBUG nova.compute.manager [req-cd55bdb0-415d-468a-ab68-554dbb622b21 req-a59de14e-5051-415e-9003-613a322e2a2f service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] No waiting events found dispatching network-vif-plugged-480ecd6b-63b3-43be-8c76-98216f55e06a {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:58:35 user nova-compute[74342]: WARNING nova.compute.manager [req-cd55bdb0-415d-468a-ab68-554dbb622b21 req-a59de14e-5051-415e-9003-613a322e2a2f service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Received unexpected event network-vif-plugged-480ecd6b-63b3-43be-8c76-98216f55e06a for instance with vm_state active and task_state resize_migrating.
Oct 16 09:58:35 user nova-compute[74342]: DEBUG nova.network.neutron [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Port 480ecd6b-63b3-43be-8c76-98216f55e06a binding to destination host user is already ACTIVE {{(pid=74342) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Oct 16 09:58:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "aa116cab-861b-459d-b1eb-6f07e5d71e30-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:58:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "aa116cab-861b-459d-b1eb-6f07e5d71e30-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:58:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "aa116cab-861b-459d-b1eb-6f07e5d71e30-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:58:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "refresh_cache-aa116cab-861b-459d-b1eb-6f07e5d71e30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:58:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquired lock "refresh_cache-aa116cab-861b-459d-b1eb-6f07e5d71e30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:58:35 user nova-compute[74342]: DEBUG nova.network.neutron [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:58:35 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7f74c903-29f2-4635-bddd-c10051728f47 is timed out.
Oct 16 09:58:35 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Successfully detached device vdb from instance 7f74c903-29f2-4635-bddd-c10051728f47 from the live domain config.
Oct 16 09:58:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 09:58:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QScWjxiy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:58:35 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:58:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:58:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:58:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b99bc4a-66c6-4f1e-b4cd-d6f3939f6119]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 09:58:35 user nova-compute[74342]: No targets found.
Oct 16 09:58:35 user nova-compute[74342]: iSNS:
Oct 16 09:58:35 user nova-compute[74342]: No targets found.
Oct 16 09:58:35 user nova-compute[74342]: STATIC:
Oct 16 09:58:35 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303
Oct 16 09:58:35 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:58:35 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:58:35 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f
Oct 16 09:58:35 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:58:35 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:58:35 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43
Oct 16 09:58:35 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:58:35 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:58:35 user nova-compute[74342]: FIRMWARE:
Oct 16 09:58:35 user nova-compute[74342]: No targets found.
Oct 16 09:58:35 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:58:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 09:58:35 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 09:58:35 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 09:58:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 09:58:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[960875a1-3782-4b1a-aad2-8de810c05ea4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4e65a7e-c45d-401c-9993-421fee43dedf]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:58:36 user nova-compute[74342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)
Oct 16 09:58:36 user nova-compute[74342]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 (non-flash)
Oct 16 09:58:36 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:58:36 user nova-compute[74342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)
Oct 16 09:58:36 user nova-compute[74342]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 (non-flash)
Oct 16 09:58:36 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b6039acb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303'): ({'sdg'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Removing single pathed devices sdg {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b61bbb-26c5-46d8-9df4-66fce5d3df33]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ffddddf-3651-454f-8916-9baa8edc3c4f]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Flushing IO for device /dev/sdg {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4efea7e3-ff40-4e86-9af0-19f601aac954]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7908f0-658d-4ffd-bae9-e1dbca7bf5ac]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] SCSI volumes sdg have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fcddb6b-911b-4507-bf76-65615b4fb7d2]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 -p 172.16.0.220:3260 --logout" returned: 0 in 0.045s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d320934-a97c-4c8c-a156-8015350c82fb]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303, portal: 172.16.0.220,3260]
Oct 16 09:58:36 user nova-compute[74342]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303, portal: 172.16.0.220,3260] successful.
Oct 16 09:58:36 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d5e1cdfe-2361-44d6-9bf4-95c45daec303 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cabd8a4-17e2-4453-bf07-18e67470dea7]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.286s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] <== disconnect_volume: return (287ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG nova.network.neutron [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Updating instance_info_cache with network_info: [{"id": "480ecd6b-63b3-43be-8c76-98216f55e06a", "address": "fa:16:3e:5c:87:e5", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480ecd6b-63", "ovs_interfaceid": "480ecd6b-63b3-43be-8c76-98216f55e06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Releasing lock "refresh_cache-aa116cab-861b-459d-b1eb-6f07e5d71e30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG os_brick.utils [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4abcf6ba-1b40-44f9-8449-fd47ab90bdc2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[667a5048-ec50-4922-ab8a-15d6b6186ff6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d77b5b3-b4b3-4b36-9cd0-5782392c4fbd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc9c97ea-b4ce-411a-83ae-c0eb7192e131]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:58:36 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:58:36 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e49b3c5-b59f-4008-be7b-9936c4511c9b]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:58:36 user nova-compute[74342]: DEBUG os_brick.utils [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:58:37 user nova-compute[74342]: DEBUG nova.objects.instance [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lazy-loading 'flavor' on Instance uuid 7f74c903-29f2-4635-bddd-c10051728f47 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:58:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ac91549c-595b-41f2-824b-0f7a3cb4529d tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "7f74c903-29f2-4635-bddd-c10051728f47" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.702s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:58:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4133d309-9286-4027-8931-deac3b1b7e17 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "eeee39f2-9728-4114-8bd3-1d05f69a1215" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4133d309-9286-4027-8931-deac3b1b7e17 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "eeee39f2-9728-4114-8bd3-1d05f69a1215" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4133d309-9286-4027-8931-deac3b1b7e17 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "eeee39f2-9728-4114-8bd3-1d05f69a1215-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4133d309-9286-4027-8931-deac3b1b7e17 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "eeee39f2-9728-4114-8bd3-1d05f69a1215-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4133d309-9286-4027-8931-deac3b1b7e17 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "eeee39f2-9728-4114-8bd3-1d05f69a1215-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:58:44 user nova-compute[74342]: INFO nova.compute.manager [None req-4133d309-9286-4027-8931-deac3b1b7e17 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Terminating instance
Oct 16 09:58:44 user nova-compute[74342]: DEBUG nova.compute.manager [None req-4133d309-9286-4027-8931-deac3b1b7e17 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG nova.compute.manager [req-8282b326-fb5e-42f8-aaaa-cdcb5dbfa636 req-e77fc4b3-2bbf-46b5-92ab-81f95d56ace1 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Received event network-vif-unplugged-2f21663b-c324-4ed7-80ff-fedf6e5631c8 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8282b326-fb5e-42f8-aaaa-cdcb5dbfa636 req-e77fc4b3-2bbf-46b5-92ab-81f95d56ace1 service nova] Acquiring lock "eeee39f2-9728-4114-8bd3-1d05f69a1215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8282b326-fb5e-42f8-aaaa-cdcb5dbfa636 req-e77fc4b3-2bbf-46b5-92ab-81f95d56ace1 service nova] Lock "eeee39f2-9728-4114-8bd3-1d05f69a1215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8282b326-fb5e-42f8-aaaa-cdcb5dbfa636 req-e77fc4b3-2bbf-46b5-92ab-81f95d56ace1 service nova] Lock "eeee39f2-9728-4114-8bd3-1d05f69a1215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG nova.compute.manager [req-8282b326-fb5e-42f8-aaaa-cdcb5dbfa636 req-e77fc4b3-2bbf-46b5-92ab-81f95d56ace1 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] No waiting events found dispatching network-vif-unplugged-2f21663b-c324-4ed7-80ff-fedf6e5631c8 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG nova.compute.manager [req-8282b326-fb5e-42f8-aaaa-cdcb5dbfa636 req-e77fc4b3-2bbf-46b5-92ab-81f95d56ace1 service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Received event network-vif-unplugged-2f21663b-c324-4ed7-80ff-fedf6e5631c8 for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:44 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Instance destroyed successfully.
Oct 16 09:58:44 user nova-compute[74342]: DEBUG nova.objects.instance [None req-4133d309-9286-4027-8931-deac3b1b7e17 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lazy-loading 'resources' on Instance uuid eeee39f2-9728-4114-8bd3-1d05f69a1215 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-4133d309-9286-4027-8931-deac3b1b7e17 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T09:51:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1957313876',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1957313876',id=22,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA73VdBJ5ylQREnZzo1DcCKTXomTVssllhy6Bsc/R9T/BngGDJaacG1M/H4yJnuSLGKGGYKR1zjZCaYpdn685spvq9Aw7a1FZR+w5BmYmqQ12LQgzJnL3CoZ3rsf0xXY0A==',key_name='tempest-keypair-1825544135',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:56:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a70b9ea5f3404a5690cd0a73db23f034',ramdisk_id='',reservation_id='r-1dw8qoh2',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-939526853',owner_user_name='tempest-AttachVolumeShelveTestJSON-939526853-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:56:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8bf8aa8ab2d4105ad0b1fd04247e3a0',uuid=eeee39f2-9728-4114-8bd3-1d05f69a1215,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "address": "fa:16:3e:7a:a5:ca", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f21663b-c3", "ovs_interfaceid": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-4133d309-9286-4027-8931-deac3b1b7e17 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Converting VIF {"id": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "address": "fa:16:3e:7a:a5:ca", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2f21663b-c3", "ovs_interfaceid": "2f21663b-c324-4ed7-80ff-fedf6e5631c8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-4133d309-9286-4027-8931-deac3b1b7e17 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:a5:ca,bridge_name='br-int',has_traffic_filtering=True,id=2f21663b-c324-4ed7-80ff-fedf6e5631c8,network=Network(bbeb1d70-a5dc-46d6-a0dd-240bf3018d31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f21663b-c3') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG os_vif [None req-4133d309-9286-4027-8931-deac3b1b7e17 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:a5:ca,bridge_name='br-int',has_traffic_filtering=True,id=2f21663b-c324-4ed7-80ff-fedf6e5631c8,network=Network(bbeb1d70-a5dc-46d6-a0dd-240bf3018d31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f21663b-c3') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2f21663b-c3, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1cdeac40-bc1e-41cb-9815-9c430c438434) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:44 user nova-compute[74342]: INFO os_vif [None req-4133d309-9286-4027-8931-deac3b1b7e17 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:a5:ca,bridge_name='br-int',has_traffic_filtering=True,id=2f21663b-c324-4ed7-80ff-fedf6e5631c8,network=Network(bbeb1d70-a5dc-46d6-a0dd-240bf3018d31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2f21663b-c3')
Oct 16 09:58:44 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-4133d309-9286-4027-8931-deac3b1b7e17 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Deleting instance files /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215_del
Oct 16 09:58:44 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-4133d309-9286-4027-8931-deac3b1b7e17 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Deletion of /opt/stack/data/nova/instances/eeee39f2-9728-4114-8bd3-1d05f69a1215_del complete
Oct 16 09:58:45 user nova-compute[74342]: INFO nova.compute.manager [None req-4133d309-9286-4027-8931-deac3b1b7e17 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Took 0.95 seconds to destroy the instance on the hypervisor.
Oct 16 09:58:45 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-4133d309-9286-4027-8931-deac3b1b7e17 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 09:58:45 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 09:58:45 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 09:58:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:45 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:58:45 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Took 0.82 seconds to deallocate network for instance.
Oct 16 09:58:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4133d309-9286-4027-8931-deac3b1b7e17 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:58:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4133d309-9286-4027-8931-deac3b1b7e17 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:58:46 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-4133d309-9286-4027-8931-deac3b1b7e17 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:58:46 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-4133d309-9286-4027-8931-deac3b1b7e17 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:58:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4133d309-9286-4027-8931-deac3b1b7e17 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:58:46 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-4133d309-9286-4027-8931-deac3b1b7e17 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Deleted allocations for instance eeee39f2-9728-4114-8bd3-1d05f69a1215
Oct 16 09:58:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4133d309-9286-4027-8931-deac3b1b7e17 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "eeee39f2-9728-4114-8bd3-1d05f69a1215" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.311s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:58:46 user nova-compute[74342]: DEBUG nova.compute.manager [req-665bcb5a-552c-4b4c-ad27-2d9a026a9b88 req-5cf9f422-5b0e-4f22-b7b9-1ff6433b893c service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Received event network-vif-plugged-2f21663b-c324-4ed7-80ff-fedf6e5631c8 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:58:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-665bcb5a-552c-4b4c-ad27-2d9a026a9b88 req-5cf9f422-5b0e-4f22-b7b9-1ff6433b893c service nova] Acquiring lock "eeee39f2-9728-4114-8bd3-1d05f69a1215-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:58:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-665bcb5a-552c-4b4c-ad27-2d9a026a9b88 req-5cf9f422-5b0e-4f22-b7b9-1ff6433b893c service nova] Lock "eeee39f2-9728-4114-8bd3-1d05f69a1215-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:58:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-665bcb5a-552c-4b4c-ad27-2d9a026a9b88 req-5cf9f422-5b0e-4f22-b7b9-1ff6433b893c service nova] Lock "eeee39f2-9728-4114-8bd3-1d05f69a1215-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:58:46 user nova-compute[74342]: DEBUG nova.compute.manager [req-665bcb5a-552c-4b4c-ad27-2d9a026a9b88 req-5cf9f422-5b0e-4f22-b7b9-1ff6433b893c service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] No waiting events found dispatching network-vif-plugged-2f21663b-c324-4ed7-80ff-fedf6e5631c8 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:58:46 user nova-compute[74342]: WARNING nova.compute.manager [req-665bcb5a-552c-4b4c-ad27-2d9a026a9b88 req-5cf9f422-5b0e-4f22-b7b9-1ff6433b893c service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Received unexpected event network-vif-plugged-2f21663b-c324-4ed7-80ff-fedf6e5631c8 for instance with vm_state deleted and task_state None.
Oct 16 09:58:46 user nova-compute[74342]: DEBUG nova.compute.manager [req-665bcb5a-552c-4b4c-ad27-2d9a026a9b88 req-5cf9f422-5b0e-4f22-b7b9-1ff6433b893c service nova] [instance: eeee39f2-9728-4114-8bd3-1d05f69a1215] Received event network-vif-deleted-2f21663b-c324-4ed7-80ff-fedf6e5631c8 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:58:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:50 user nova-compute[74342]: DEBUG nova.compute.manager [req-fd637edc-b784-4141-b46d-6db6bfaae4e1 req-03331acf-39d1-4988-9e90-cfbf5761c8a5 service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Received event network-changed-a82e4268-e1e1-494b-b505-2558fa7f535e {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:58:50 user nova-compute[74342]: DEBUG nova.compute.manager [req-fd637edc-b784-4141-b46d-6db6bfaae4e1 req-03331acf-39d1-4988-9e90-cfbf5761c8a5 service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Refreshing instance network info cache due to event network-changed-a82e4268-e1e1-494b-b505-2558fa7f535e. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:58:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-fd637edc-b784-4141-b46d-6db6bfaae4e1 req-03331acf-39d1-4988-9e90-cfbf5761c8a5 service nova] Acquiring lock "refresh_cache-575ff5fb-6cd7-4e84-b6de-c971129c7935" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:58:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-fd637edc-b784-4141-b46d-6db6bfaae4e1 req-03331acf-39d1-4988-9e90-cfbf5761c8a5 service nova] Acquired lock "refresh_cache-575ff5fb-6cd7-4e84-b6de-c971129c7935" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:58:50 user nova-compute[74342]: DEBUG nova.network.neutron [req-fd637edc-b784-4141-b46d-6db6bfaae4e1 req-03331acf-39d1-4988-9e90-cfbf5761c8a5 service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Refreshing network info cache for port a82e4268-e1e1-494b-b505-2558fa7f535e {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:58:51 user nova-compute[74342]: DEBUG nova.network.neutron [req-fd637edc-b784-4141-b46d-6db6bfaae4e1 req-03331acf-39d1-4988-9e90-cfbf5761c8a5 service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Updated VIF entry in instance network info cache for port a82e4268-e1e1-494b-b505-2558fa7f535e. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:58:51 user nova-compute[74342]: DEBUG nova.network.neutron [req-fd637edc-b784-4141-b46d-6db6bfaae4e1 req-03331acf-39d1-4988-9e90-cfbf5761c8a5 service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Updating instance_info_cache with network_info: [{"id": "a82e4268-e1e1-494b-b505-2558fa7f535e", "address": "fa:16:3e:13:f1:6f", "network": {"id": "46f96b88-d08a-4f28-bcbf-a630d369074a", "bridge": "br-int", "label": "tempest-TestShelveInstance-2043632303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52331a6c86c446d7bb5e9e849eebdd18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa82e4268-e1", "ovs_interfaceid": "a82e4268-e1e1-494b-b505-2558fa7f535e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:58:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-fd637edc-b784-4141-b46d-6db6bfaae4e1 req-03331acf-39d1-4988-9e90-cfbf5761c8a5 service nova] Releasing lock "refresh_cache-575ff5fb-6cd7-4e84-b6de-c971129c7935" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:58:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Acquiring lock "575ff5fb-6cd7-4e84-b6de-c971129c7935" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:58:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "575ff5fb-6cd7-4e84-b6de-c971129c7935" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:58:51 user nova-compute[74342]: INFO nova.compute.manager [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Shelve offloading
Oct 16 09:58:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:52 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Instance destroyed successfully.
Oct 16 09:58:52 user nova-compute[74342]: DEBUG nova.compute.manager [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:58:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Acquiring lock "refresh_cache-575ff5fb-6cd7-4e84-b6de-c971129c7935" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:58:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Acquired lock "refresh_cache-575ff5fb-6cd7-4e84-b6de-c971129c7935" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:58:52 user nova-compute[74342]: DEBUG nova.network.neutron [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:58:52 user nova-compute[74342]: DEBUG nova.network.neutron [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Updating instance_info_cache with network_info: [{"id": "a82e4268-e1e1-494b-b505-2558fa7f535e", "address": "fa:16:3e:13:f1:6f", "network": {"id": "46f96b88-d08a-4f28-bcbf-a630d369074a", "bridge": "br-int", "label": "tempest-TestShelveInstance-2043632303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52331a6c86c446d7bb5e9e849eebdd18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa82e4268-e1", "ovs_interfaceid": "a82e4268-e1e1-494b-b505-2558fa7f535e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:58:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Releasing lock "refresh_cache-575ff5fb-6cd7-4e84-b6de-c971129c7935" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:58:52 user nova-compute[74342]: DEBUG nova.compute.manager [req-165790bb-52cd-4ab7-9724-fe9d35428cfb req-768d2891-3825-43d9-8c36-c033f98e1962 service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Received event network-vif-unplugged-a82e4268-e1e1-494b-b505-2558fa7f535e {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:58:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-165790bb-52cd-4ab7-9724-fe9d35428cfb req-768d2891-3825-43d9-8c36-c033f98e1962 service nova] Acquiring lock "575ff5fb-6cd7-4e84-b6de-c971129c7935-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:58:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-165790bb-52cd-4ab7-9724-fe9d35428cfb req-768d2891-3825-43d9-8c36-c033f98e1962 service nova] Lock "575ff5fb-6cd7-4e84-b6de-c971129c7935-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:58:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-165790bb-52cd-4ab7-9724-fe9d35428cfb req-768d2891-3825-43d9-8c36-c033f98e1962 service nova] Lock "575ff5fb-6cd7-4e84-b6de-c971129c7935-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:58:52 user nova-compute[74342]: DEBUG nova.compute.manager [req-165790bb-52cd-4ab7-9724-fe9d35428cfb req-768d2891-3825-43d9-8c36-c033f98e1962 service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] No waiting events found dispatching network-vif-unplugged-a82e4268-e1e1-494b-b505-2558fa7f535e {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:58:52 user nova-compute[74342]: WARNING nova.compute.manager [req-165790bb-52cd-4ab7-9724-fe9d35428cfb req-768d2891-3825-43d9-8c36-c033f98e1962 service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Received unexpected event network-vif-unplugged-a82e4268-e1e1-494b-b505-2558fa7f535e for instance with vm_state active and task_state shelving.
Oct 16 09:58:52 user nova-compute[74342]: DEBUG nova.compute.manager [req-165790bb-52cd-4ab7-9724-fe9d35428cfb req-768d2891-3825-43d9-8c36-c033f98e1962 service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Received event network-vif-plugged-a82e4268-e1e1-494b-b505-2558fa7f535e {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:58:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-165790bb-52cd-4ab7-9724-fe9d35428cfb req-768d2891-3825-43d9-8c36-c033f98e1962 service nova] Acquiring lock "575ff5fb-6cd7-4e84-b6de-c971129c7935-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:58:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-165790bb-52cd-4ab7-9724-fe9d35428cfb req-768d2891-3825-43d9-8c36-c033f98e1962 service nova] Lock "575ff5fb-6cd7-4e84-b6de-c971129c7935-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:58:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-165790bb-52cd-4ab7-9724-fe9d35428cfb req-768d2891-3825-43d9-8c36-c033f98e1962 service nova] Lock "575ff5fb-6cd7-4e84-b6de-c971129c7935-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:58:52 user nova-compute[74342]: DEBUG nova.compute.manager [req-165790bb-52cd-4ab7-9724-fe9d35428cfb req-768d2891-3825-43d9-8c36-c033f98e1962 service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] No waiting events found dispatching network-vif-plugged-a82e4268-e1e1-494b-b505-2558fa7f535e {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:58:52 user nova-compute[74342]: WARNING nova.compute.manager [req-165790bb-52cd-4ab7-9724-fe9d35428cfb req-768d2891-3825-43d9-8c36-c033f98e1962 service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Received unexpected event network-vif-plugged-a82e4268-e1e1-494b-b505-2558fa7f535e for instance with vm_state active and task_state shelving.
Oct 16 09:58:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:53 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Instance destroyed successfully.
Oct 16 09:58:53 user nova-compute[74342]: DEBUG nova.objects.instance [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lazy-loading 'resources' on Instance uuid 575ff5fb-6cd7-4e84-b6de-c971129c7935 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:56:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-359637512',display_name='tempest-TestShelveInstance-server-359637512',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-359637512',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlgdxAD7+2/8I5Bmwwuxc9f9iE6qWVwSxmtHBDMK1V+4lFb8ymmohLRVrvUFwuOB4SKQFH8KIs71Bp4myXAMERD+6XX8zG+ywxbtrHDK1mSRcDXhNmnUm0DIioqGZROew==',key_name='tempest-TestShelveInstance-223238522',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:57:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52331a6c86c446d7bb5e9e849eebdd18',ramdisk_id='',reservation_id='r-8avw62ul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1417500607',owner_user_name='tempest-TestShelveInstance-1417500607-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:57:40Z,user_data=None,user_id='8b8ad29a34c84e95ac5513c5a670a753',uuid=575ff5fb-6cd7-4e84-b6de-c971129c7935,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a82e4268-e1e1-494b-b505-2558fa7f535e", "address": "fa:16:3e:13:f1:6f", "network": {"id": "46f96b88-d08a-4f28-bcbf-a630d369074a", "bridge": "br-int", "label": "tempest-TestShelveInstance-2043632303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52331a6c86c446d7bb5e9e849eebdd18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa82e4268-e1", "ovs_interfaceid": "a82e4268-e1e1-494b-b505-2558fa7f535e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Converting VIF {"id": "a82e4268-e1e1-494b-b505-2558fa7f535e", "address": "fa:16:3e:13:f1:6f", "network": {"id": "46f96b88-d08a-4f28-bcbf-a630d369074a", "bridge": "br-int", "label": "tempest-TestShelveInstance-2043632303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52331a6c86c446d7bb5e9e849eebdd18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa82e4268-e1", "ovs_interfaceid": "a82e4268-e1e1-494b-b505-2558fa7f535e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:f1:6f,bridge_name='br-int',has_traffic_filtering=True,id=a82e4268-e1e1-494b-b505-2558fa7f535e,network=Network(46f96b88-d08a-4f28-bcbf-a630d369074a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa82e4268-e1') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG os_vif [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:f1:6f,bridge_name='br-int',has_traffic_filtering=True,id=a82e4268-e1e1-494b-b505-2558fa7f535e,network=Network(46f96b88-d08a-4f28-bcbf-a630d369074a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa82e4268-e1') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa82e4268-e1, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG nova.compute.manager [req-a63c996b-8441-493f-9ba7-93ae05741540 req-97343b70-1c3d-480d-a8cf-d0d2cf8fcd74 service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Received event network-changed-a82e4268-e1e1-494b-b505-2558fa7f535e {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG nova.compute.manager [req-a63c996b-8441-493f-9ba7-93ae05741540 req-97343b70-1c3d-480d-a8cf-d0d2cf8fcd74 service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Refreshing instance network info cache due to event network-changed-a82e4268-e1e1-494b-b505-2558fa7f535e. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a63c996b-8441-493f-9ba7-93ae05741540 req-97343b70-1c3d-480d-a8cf-d0d2cf8fcd74 service nova] Acquiring lock "refresh_cache-575ff5fb-6cd7-4e84-b6de-c971129c7935" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a63c996b-8441-493f-9ba7-93ae05741540 req-97343b70-1c3d-480d-a8cf-d0d2cf8fcd74 service nova] Acquired lock "refresh_cache-575ff5fb-6cd7-4e84-b6de-c971129c7935" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG nova.network.neutron [req-a63c996b-8441-493f-9ba7-93ae05741540 req-97343b70-1c3d-480d-a8cf-d0d2cf8fcd74 service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Refreshing network info cache for port a82e4268-e1e1-494b-b505-2558fa7f535e {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b0fb9c48-5931-4b6a-b905-171cee8a84e6) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:58:53 user nova-compute[74342]: INFO os_vif [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:f1:6f,bridge_name='br-int',has_traffic_filtering=True,id=a82e4268-e1e1-494b-b505-2558fa7f535e,network=Network(46f96b88-d08a-4f28-bcbf-a630d369074a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa82e4268-e1')
Oct 16 09:58:53 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdvWcJrY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:58:53 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:58:53 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac2ef133-2321-40d2-80de-a035ceaf8fa6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 09:58:53 user nova-compute[74342]: No targets found.
Oct 16 09:58:53 user nova-compute[74342]: iSNS:
Oct 16 09:58:53 user nova-compute[74342]: No targets found.
Oct 16 09:58:53 user nova-compute[74342]: STATIC:
Oct 16 09:58:53 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f
Oct 16 09:58:53 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:58:53 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:58:53 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43
Oct 16 09:58:53 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:58:53 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:58:53 user nova-compute[74342]: FIRMWARE:
Oct 16 09:58:53 user nova-compute[74342]: No targets found.
Oct 16 09:58:53 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 09:58:53 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 09:58:53 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2379a28-4892-4b53-a58b-69db749976f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ceb841-0b89-42ae-bbd4-f6b980c9cdb2]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:58:53 user nova-compute[74342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)
Oct 16 09:58:53 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:58:53 user nova-compute[74342]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)
Oct 16 09:58:53 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b601c6d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f'): ({'sdd'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Removing single pathed devices sdd {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac0691a-4be3-438d-9cfc-500bb57c4cdf]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[50291e3f-58a5-40e2-a063-3f294e7ae04f]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Flushing IO for device /dev/sdd {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[57840827-cc9f-49e3-a1fc-28ca89cbe434]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.059s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bb5a307-d037-499c-98ca-0686b61e7658]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] SCSI volumes sdd have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba4c7b9-b2c1-4e92-9243-e0840e2cac0b]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[97de10ce-9185-4c83-ab14-e52b90350584]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f, portal: 172.16.0.220,3260]
Oct 16 09:58:53 user nova-compute[74342]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f, portal: 172.16.0.220,3260] successful.
Oct 16 09:58:53 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a209d723-e250-4adb-8b96-f5b7a11c09d9]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.363s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] <== disconnect_volume: return (364ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 09:58:53 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Deleting instance files /opt/stack/data/nova/instances/575ff5fb-6cd7-4e84-b6de-c971129c7935_del
Oct 16 09:58:53 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Deletion of /opt/stack/data/nova/instances/575ff5fb-6cd7-4e84-b6de-c971129c7935_del complete
Oct 16 09:58:53 user nova-compute[74342]: DEBUG nova.network.neutron [req-a63c996b-8441-493f-9ba7-93ae05741540 req-97343b70-1c3d-480d-a8cf-d0d2cf8fcd74 service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Updated VIF entry in instance network info cache for port a82e4268-e1e1-494b-b505-2558fa7f535e. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG nova.network.neutron [req-a63c996b-8441-493f-9ba7-93ae05741540 req-97343b70-1c3d-480d-a8cf-d0d2cf8fcd74 service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Updating instance_info_cache with network_info: [{"id": "a82e4268-e1e1-494b-b505-2558fa7f535e", "address": "fa:16:3e:13:f1:6f", "network": {"id": "46f96b88-d08a-4f28-bcbf-a630d369074a", "bridge": null, "label": "tempest-TestShelveInstance-2043632303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52331a6c86c446d7bb5e9e849eebdd18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa82e4268-e1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:58:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a63c996b-8441-493f-9ba7-93ae05741540 req-97343b70-1c3d-480d-a8cf-d0d2cf8fcd74 service nova] Releasing lock "refresh_cache-575ff5fb-6cd7-4e84-b6de-c971129c7935" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f74c903-29f2-4635-bddd-c10051728f47/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:54 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4f3aa905-8eae-45cb-8019-0b991286fe42 is timed out.
Oct 16 09:58:54 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Successfully detached device vdb from instance 4f3aa905-8eae-45cb-8019-0b991286fe42 from the live domain config.
Oct 16 09:58:54 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tMGZkgah', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:58:54 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:58:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f74c903-29f2-4635-bddd-c10051728f47/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f74c903-29f2-4635-bddd-c10051728f47/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Starting finish_migration {{(pid=74342) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Instance directory exists: not creating {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 16 09:58:54 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Creating image(s)
Oct 16 09:58:54 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Did not create local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Ensure instance console log exists: /opt/stack/data/nova/instances/aa116cab-861b-459d-b1eb-6f07e5d71e30/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Start _get_guest_xml network_info=[{"id": "480ecd6b-63b3-43be-8c76-98216f55e06a", "address": "fa:16:3e:5c:87:e5", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-409788226-network", "vif_mac": "fa:16:3e:5c:87:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480ecd6b-63", "ovs_interfaceid": "480ecd6b-63b3-43be-8c76-98216f55e06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'attachment_id': 'f17467bc-f53e-4d9d-bda7-7ce4206c129e', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CoeJBEON', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'aa116cab-861b-459d-b1eb-6f07e5d71e30', 'attached_at': '2023-10-16T09:58:55.000000', 'detached_at': '', 'volume_id': 'e645e4f7-6f67-4461-a2e7-8195c5b246a8', 'serial': 'e645e4f7-6f67-4461-a2e7-8195c5b246a8'}, 'volume_type': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc502029-1a4e-4fcc-bf4d-90891f505375]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 09:58:54 user nova-compute[74342]: No targets found.
Oct 16 09:58:54 user nova-compute[74342]: iSNS:
Oct 16 09:58:54 user nova-compute[74342]: No targets found.
Oct 16 09:58:54 user nova-compute[74342]: STATIC:
Oct 16 09:58:54 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43
Oct 16 09:58:54 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 09:58:54 user nova-compute[74342]:                 Iface Name: default
Oct 16 09:58:54 user nova-compute[74342]: FIRMWARE:
Oct 16 09:58:54 user nova-compute[74342]: No targets found.
Oct 16 09:58:54 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 09:58:54 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 09:58:54 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:54 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:58:54 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:58:54 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9727825-7cfb-449b-81ed-1798cb77520e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:40:01Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CoeJBEON', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:58:54 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:58:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:58:54 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Deleted allocations for instance 575ff5fb-6cd7-4e84-b6de-c971129c7935
Oct 16 09:58:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e108f05-0192-4b00-83ac-cf309bc95c5a]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:58:54 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 (non-flash)
Oct 16 09:58:54 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b60131240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43'): ({'sdb'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Removing single pathed devices sdb {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 09:58:54 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7f74c903-29f2-4635-bddd-c10051728f47/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[989e021b-fbce-4d39-a040-22c10744ad1b]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG nova.objects.instance [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lazy-loading 'numa_topology' on Instance uuid 575ff5fb-6cd7-4e84-b6de-c971129c7935 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[45b0dc92-301e-44fd-9056-c3d01b2b6774]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Flushing IO for device /dev/sdb {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG nova.objects.base [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Object Instance<575ff5fb-6cd7-4e84-b6de-c971129c7935> lazy-loaded attributes: resources,numa_topology {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[588ab478-b061-4079-9f5c-6c237cc9536c]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[18cdcaf0-e665-4cdd-ac1f-6aff0d1b74bb]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b70aba0c-8012-4bce-9f1f-aa1a8e1ca9c1]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[998fd0be-5f38-47c2-9677-b8c9b9c96bba]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43, portal: 172.16.0.220,3260]
Oct 16 09:58:55 user nova-compute[74342]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43, portal: 172.16.0.220,3260] successful.
Oct 16 09:58:55 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6e3a5814-40f6-46ab-aca8-2f0a72768a43 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f54bb7a-16ff-4ebd-b1a6-2fc0ec7a806f]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.527s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] <== disconnect_volume: return (528ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.344s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:58:55 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:58:55 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b9d2c8-a5df-4135-9c1f-2d5ed6e3a1fb]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 09:58:55 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2ac64d-1279-43f9-998e-77063eadf99c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8] added
Oct 16 09:58:55 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[44643540-41e3-49ba-956b-01de0042529e]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c2791a-67f8-408c-bbc1-ad354e4a98a3]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.408s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CoeJBEON {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CoeJBEON" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfa4dcf-58ad-4691-b45f-b3987af15333]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CoeJBEON'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32b2c54-c68a-4d01-9bf9-b18372953c70]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7d6db1a8-b13e-4380-ad5d-e5c9cd12f8c6 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "575ff5fb-6cd7-4e84-b6de-c971129c7935" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.148s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d3b731-cc69-4b48-b02f-60c3e46492f1]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 09:58:55 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 09:58:55 user nova-compute[74342]:  {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:58:55 user nova-compute[74342]: WARNING os_brick.initiator.connectors.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 09:58:55 user nova-compute[74342]: 
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[078f3d5d-7528-4046-aff3-d14eebfcfd87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8, portal: 172.16.0.220,3260]
Oct 16 09:58:55 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8, portal: 172.16.0.220,3260] successful.
Oct 16 09:58:55 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[81396af3-f0c2-4350-8128-6e04fb880e99]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bd6468-1aa8-4901-88bf-a857a55017c7]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 09:58:55 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 09:58:55 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] HCTL ('33', '-', '-', 0) found on session 27 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec54ee10-a5d7-4b69-8e76-16ae93d53039]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Searching for a device in session 27 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CoeJBEON', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG nova.objects.instance [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'flavor' on Instance uuid 4f3aa905-8eae-45cb-8019-0b991286fe42 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.417s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] <== connect_volume: return (1766ms) {'type': 'block', 'scsi_wwn': '23264303130306234', 'path': '/dev/sdb'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23264303130306234', 'path': '/dev/sdb'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 09:58:56 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:58:56 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:58:56 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8317MB free_disk=25.241668701171875GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-19daebea-0850-4279-957b-c54e2cb99be9 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.655s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1222282830',display_name='tempest-ServerActionsTestOtherA-server-1222282830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1222282830',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5Nn7Cd9XA4JGuwKexWOVVgfutTMETbY1OUIw/2Lg/7f8J0Bw2Ei1JnC+VmVg9p5to1vwEeuuESoLWsMybdIS98JRtnBeQn9/1YcrhMFyK9tNXAGp/a4/hIqjXfamZ4kQ==',key_name='tempest-keypair-772403242',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:56:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='355bac247f9d4ea8b3c2f0d87453f4c1',ramdisk_id='',reservation_id='r-g85xdm18',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1004911708',owner_user_name='tempest-ServerActionsTestOtherA-1004911708-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:58:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3c728429a0a42789cfc0f1251d6f623',uuid=aa116cab-861b-459d-b1eb-6f07e5d71e30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "480ecd6b-63b3-43be-8c76-98216f55e06a", "address": "fa:16:3e:5c:87:e5", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-409788226-network", "vif_mac": "fa:16:3e:5c:87:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480ecd6b-63", "ovs_interfaceid": "480ecd6b-63b3-43be-8c76-98216f55e06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Converting VIF {"id": "480ecd6b-63b3-43be-8c76-98216f55e06a", "address": "fa:16:3e:5c:87:e5", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-409788226-network", "vif_mac": "fa:16:3e:5c:87:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480ecd6b-63", "ovs_interfaceid": "480ecd6b-63b3-43be-8c76-98216f55e06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:87:e5,bridge_name='br-int',has_traffic_filtering=True,id=480ecd6b-63b3-43be-8c76-98216f55e06a,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480ecd6b-63') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:58:56 user nova-compute[74342]:   <uuid>aa116cab-861b-459d-b1eb-6f07e5d71e30</uuid>
Oct 16 09:58:56 user nova-compute[74342]:   <name>instance-0000001a</name>
Oct 16 09:58:56 user nova-compute[74342]:   <memory>2097152</memory>
Oct 16 09:58:56 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:58:56 user nova-compute[74342]:   <metadata>
Oct 16 09:58:56 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:58:56 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:58:56 user nova-compute[74342]:       <nova:name>tempest-ServerActionsTestOtherA-server-1222282830</nova:name>
Oct 16 09:58:56 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:58:54</nova:creationTime>
Oct 16 09:58:56 user nova-compute[74342]:       <nova:flavor name="m1.small">
Oct 16 09:58:56 user nova-compute[74342]:         <nova:memory>2048</nova:memory>
Oct 16 09:58:56 user nova-compute[74342]:         <nova:disk>20</nova:disk>
Oct 16 09:58:56 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:58:56 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:58:56 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:58:56 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:58:56 user nova-compute[74342]:       <nova:owner>
Oct 16 09:58:56 user nova-compute[74342]:         <nova:user uuid="e3c728429a0a42789cfc0f1251d6f623">tempest-ServerActionsTestOtherA-1004911708-project-member</nova:user>
Oct 16 09:58:56 user nova-compute[74342]:         <nova:project uuid="355bac247f9d4ea8b3c2f0d87453f4c1">tempest-ServerActionsTestOtherA-1004911708</nova:project>
Oct 16 09:58:56 user nova-compute[74342]:       </nova:owner>
Oct 16 09:58:56 user nova-compute[74342]:       <nova:ports>
Oct 16 09:58:56 user nova-compute[74342]:         <nova:port uuid="480ecd6b-63b3-43be-8c76-98216f55e06a">
Oct 16 09:58:56 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 16 09:58:56 user nova-compute[74342]:         </nova:port>
Oct 16 09:58:56 user nova-compute[74342]:       </nova:ports>
Oct 16 09:58:56 user nova-compute[74342]:     </nova:instance>
Oct 16 09:58:56 user nova-compute[74342]:   </metadata>
Oct 16 09:58:56 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:58:56 user nova-compute[74342]:     <system>
Oct 16 09:58:56 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:58:56 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:58:56 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:58:56 user nova-compute[74342]:       <entry name="serial">aa116cab-861b-459d-b1eb-6f07e5d71e30</entry>
Oct 16 09:58:56 user nova-compute[74342]:       <entry name="uuid">aa116cab-861b-459d-b1eb-6f07e5d71e30</entry>
Oct 16 09:58:56 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:58:56 user nova-compute[74342]:     </system>
Oct 16 09:58:56 user nova-compute[74342]:   </sysinfo>
Oct 16 09:58:56 user nova-compute[74342]:   <os>
Oct 16 09:58:56 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:58:56 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:58:56 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:58:56 user nova-compute[74342]:   </os>
Oct 16 09:58:56 user nova-compute[74342]:   <features>
Oct 16 09:58:56 user nova-compute[74342]:     <acpi/>
Oct 16 09:58:56 user nova-compute[74342]:     <apic/>
Oct 16 09:58:56 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:58:56 user nova-compute[74342]:   </features>
Oct 16 09:58:56 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:58:56 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:58:56 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:58:56 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:58:56 user nova-compute[74342]:   </clock>
Oct 16 09:58:56 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:58:56 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:58:56 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:58:56 user nova-compute[74342]:   </cpu>
Oct 16 09:58:56 user nova-compute[74342]:   <devices>
Oct 16 09:58:56 user nova-compute[74342]:     <disk type="block" device="disk">
Oct 16 09:58:56 user nova-compute[74342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:58:56 user nova-compute[74342]:       <source dev="/dev/sdb"/>
Oct 16 09:58:56 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:58:56 user nova-compute[74342]:       <serial>e645e4f7-6f67-4461-a2e7-8195c5b246a8</serial>
Oct 16 09:58:56 user nova-compute[74342]:     </disk>
Oct 16 09:58:56 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:58:56 user nova-compute[74342]:       <mac address="fa:16:3e:5c:87:e5"/>
Oct 16 09:58:56 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:58:56 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:58:56 user nova-compute[74342]:       <target dev="tap480ecd6b-63"/>
Oct 16 09:58:56 user nova-compute[74342]:     </interface>
Oct 16 09:58:56 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:58:56 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/aa116cab-861b-459d-b1eb-6f07e5d71e30/console.log" append="off"/>
Oct 16 09:58:56 user nova-compute[74342]:     </serial>
Oct 16 09:58:56 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:58:56 user nova-compute[74342]:     <video>
Oct 16 09:58:56 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:58:56 user nova-compute[74342]:     </video>
Oct 16 09:58:56 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:58:56 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:58:56 user nova-compute[74342]:     </rng>
Oct 16 09:58:56 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:58:56 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:58:56 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:58:56 user nova-compute[74342]:     </memballoon>
Oct 16 09:58:56 user nova-compute[74342]:   </devices>
Oct 16 09:58:56 user nova-compute[74342]: </domain>
Oct 16 09:58:56 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1222282830',display_name='tempest-ServerActionsTestOtherA-server-1222282830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1222282830',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5Nn7Cd9XA4JGuwKexWOVVgfutTMETbY1OUIw/2Lg/7f8J0Bw2Ei1JnC+VmVg9p5to1vwEeuuESoLWsMybdIS98JRtnBeQn9/1YcrhMFyK9tNXAGp/a4/hIqjXfamZ4kQ==',key_name='tempest-keypair-772403242',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:56:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='355bac247f9d4ea8b3c2f0d87453f4c1',ramdisk_id='',reservation_id='r-g85xdm18',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1004911708',owner_user_name='tempest-ServerActionsTestOtherA-1004911708-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:58:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3c728429a0a42789cfc0f1251d6f623',uuid=aa116cab-861b-459d-b1eb-6f07e5d71e30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "480ecd6b-63b3-43be-8c76-98216f55e06a", "address": "fa:16:3e:5c:87:e5", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-409788226-network", "vif_mac": "fa:16:3e:5c:87:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480ecd6b-63", "ovs_interfaceid": "480ecd6b-63b3-43be-8c76-98216f55e06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Converting VIF {"id": "480ecd6b-63b3-43be-8c76-98216f55e06a", "address": "fa:16:3e:5c:87:e5", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-409788226-network", "vif_mac": "fa:16:3e:5c:87:e5"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480ecd6b-63", "ovs_interfaceid": "480ecd6b-63b3-43be-8c76-98216f55e06a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5c:87:e5,bridge_name='br-int',has_traffic_filtering=True,id=480ecd6b-63b3-43be-8c76-98216f55e06a,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480ecd6b-63') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG os_vif [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:87:e5,bridge_name='br-int',has_traffic_filtering=True,id=480ecd6b-63b3-43be-8c76-98216f55e06a,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480ecd6b-63') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a84785d8-40ca-54c5-9179-a57ab04d183c', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap480ecd6b-63, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap480ecd6b-63, col_values=(('qos', UUID('34eccd99-be6d-4592-82ff-e168ab0a4012')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap480ecd6b-63, col_values=(('external_ids', {'iface-id': '480ecd6b-63b3-43be-8c76-98216f55e06a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5c:87:e5', 'vm-uuid': 'aa116cab-861b-459d-b1eb-6f07e5d71e30'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:56 user nova-compute[74342]: INFO os_vif [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5c:87:e5,bridge_name='br-int',has_traffic_filtering=True,id=480ecd6b-63b3-43be-8c76-98216f55e06a,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480ecd6b-63')
Oct 16 09:58:56 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Applying migration context for instance aa116cab-861b-459d-b1eb-6f07e5d71e30 as it has an incoming, in-progress migration 3a28f569-b70a-4cf0-8e82-243ef43ac167. Migration status is post-migrating {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 16 09:58:56 user nova-compute[74342]: INFO nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Updating resource usage from migration 3a28f569-b70a-4cf0-8e82-243ef43ac167
Oct 16 09:58:56 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 98367a96-22f0-4edb-ab03-a8eb286b437b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 4f3aa905-8eae-45cb-8019-0b991286fe42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7f74c903-29f2-4635-bddd-c10051728f47 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance d7607dcc-e70e-42fb-9421-c5f630706241 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Migration 3a28f569-b70a-4cf0-8e82-243ef43ac167 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance aa116cab-861b-459d-b1eb-6f07e5d71e30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2ae91aad-ae7a-4f69-8d49-8235959c07c2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "4f3aa905-8eae-45cb-8019-0b991286fe42" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2ae91aad-ae7a-4f69-8d49-8235959c07c2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG nova.compute.manager [None req-2ae91aad-ae7a-4f69-8d49-8235959c07c2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] No VIF found with MAC fa:16:3e:5c:87:e5, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG nova.compute.manager [None req-2ae91aad-ae7a-4f69-8d49-8235959c07c2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=74342) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Oct 16 09:58:56 user nova-compute[74342]: DEBUG nova.objects.instance [None req-2ae91aad-ae7a-4f69-8d49-8235959c07c2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'flavor' on Instance uuid 4f3aa905-8eae-45cb-8019-0b991286fe42 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:58:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:57 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:58:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:57 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:58:57 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 09:58:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.524s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:58:57 user nova-compute[74342]: DEBUG nova.compute.manager [req-5cd5e1f3-cee7-4fe7-a26d-f4ff4f851b91 req-88577bae-5e6b-4ce3-bdd3-608063fb46a3 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Received event network-vif-unplugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:58:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5cd5e1f3-cee7-4fe7-a26d-f4ff4f851b91 req-88577bae-5e6b-4ce3-bdd3-608063fb46a3 service nova] Acquiring lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:58:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5cd5e1f3-cee7-4fe7-a26d-f4ff4f851b91 req-88577bae-5e6b-4ce3-bdd3-608063fb46a3 service nova] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:58:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5cd5e1f3-cee7-4fe7-a26d-f4ff4f851b91 req-88577bae-5e6b-4ce3-bdd3-608063fb46a3 service nova] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:58:57 user nova-compute[74342]: DEBUG nova.compute.manager [req-5cd5e1f3-cee7-4fe7-a26d-f4ff4f851b91 req-88577bae-5e6b-4ce3-bdd3-608063fb46a3 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] No waiting events found dispatching network-vif-unplugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:58:57 user nova-compute[74342]: WARNING nova.compute.manager [req-5cd5e1f3-cee7-4fe7-a26d-f4ff4f851b91 req-88577bae-5e6b-4ce3-bdd3-608063fb46a3 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Received unexpected event network-vif-unplugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 for instance with vm_state active and task_state powering-off.
Oct 16 09:58:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:58 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:58:58 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:58:58 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Instance destroyed successfully.
Oct 16 09:58:58 user nova-compute[74342]: DEBUG nova.compute.manager [None req-2ae91aad-ae7a-4f69-8d49-8235959c07c2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:58:58 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:58:58 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 09:58:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2ae91aad-ae7a-4f69-8d49-8235959c07c2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.447s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:58:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-4f3aa905-8eae-45cb-8019-0b991286fe42" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:58:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-4f3aa905-8eae-45cb-8019-0b991286fe42" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:58:58 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 09:58:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:58 user nova-compute[74342]: DEBUG nova.compute.manager [req-4276e6d4-50a4-4888-8797-8df3b0144bfc req-1820b32d-6d50-465a-b3df-cd822000ad6c service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Received event network-vif-plugged-480ecd6b-63b3-43be-8c76-98216f55e06a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:58:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4276e6d4-50a4-4888-8797-8df3b0144bfc req-1820b32d-6d50-465a-b3df-cd822000ad6c service nova] Acquiring lock "aa116cab-861b-459d-b1eb-6f07e5d71e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:58:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4276e6d4-50a4-4888-8797-8df3b0144bfc req-1820b32d-6d50-465a-b3df-cd822000ad6c service nova] Lock "aa116cab-861b-459d-b1eb-6f07e5d71e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:58:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4276e6d4-50a4-4888-8797-8df3b0144bfc req-1820b32d-6d50-465a-b3df-cd822000ad6c service nova] Lock "aa116cab-861b-459d-b1eb-6f07e5d71e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:58:58 user nova-compute[74342]: DEBUG nova.compute.manager [req-4276e6d4-50a4-4888-8797-8df3b0144bfc req-1820b32d-6d50-465a-b3df-cd822000ad6c service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] No waiting events found dispatching network-vif-plugged-480ecd6b-63b3-43be-8c76-98216f55e06a {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:58:58 user nova-compute[74342]: WARNING nova.compute.manager [req-4276e6d4-50a4-4888-8797-8df3b0144bfc req-1820b32d-6d50-465a-b3df-cd822000ad6c service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Received unexpected event network-vif-plugged-480ecd6b-63b3-43be-8c76-98216f55e06a for instance with vm_state active and task_state resize_finish.
Oct 16 09:58:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:58:59 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Updating instance_info_cache with network_info: [{"id": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "address": "fa:16:3e:82:00:ac", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4258aa-96", "ovs_interfaceid": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:58:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-4f3aa905-8eae-45cb-8019-0b991286fe42" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:58:59 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 09:58:59 user nova-compute[74342]: DEBUG nova.compute.manager [req-73eea6e6-f924-4505-8d2e-9503e82de5a1 req-11d340c4-9e0f-41bf-b029-fdcf6821bcf2 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Received event network-vif-plugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:58:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-73eea6e6-f924-4505-8d2e-9503e82de5a1 req-11d340c4-9e0f-41bf-b029-fdcf6821bcf2 service nova] Acquiring lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:58:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-73eea6e6-f924-4505-8d2e-9503e82de5a1 req-11d340c4-9e0f-41bf-b029-fdcf6821bcf2 service nova] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:58:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-73eea6e6-f924-4505-8d2e-9503e82de5a1 req-11d340c4-9e0f-41bf-b029-fdcf6821bcf2 service nova] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:58:59 user nova-compute[74342]: DEBUG nova.compute.manager [req-73eea6e6-f924-4505-8d2e-9503e82de5a1 req-11d340c4-9e0f-41bf-b029-fdcf6821bcf2 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] No waiting events found dispatching network-vif-plugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:58:59 user nova-compute[74342]: WARNING nova.compute.manager [req-73eea6e6-f924-4505-8d2e-9503e82de5a1 req-11d340c4-9e0f-41bf-b029-fdcf6821bcf2 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Received unexpected event network-vif-plugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 for instance with vm_state stopped and task_state None.
Oct 16 09:59:00 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:59:00 user nova-compute[74342]: DEBUG nova.compute.manager [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:59:00 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Instance running successfully.
Oct 16 09:59:00 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Failed to set time: agent not configured {{(pid=74342) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Oct 16 09:59:00 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-01ee4556-d5e6-423b-9a91-9fbc76e540e2 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] finish_migration finished successfully. {{(pid=74342) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Oct 16 09:59:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Acquiring lock "e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:59:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:59:00 user nova-compute[74342]: DEBUG nova.compute.manager [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:59:01 user nova-compute[74342]: DEBUG nova.compute.manager [req-8e892095-2555-423e-8b73-99f9e4131eef req-9a2d0e07-f1bc-4b61-b5fa-1dac5fea9b9c service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Received event network-vif-plugged-480ecd6b-63b3-43be-8c76-98216f55e06a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:59:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8e892095-2555-423e-8b73-99f9e4131eef req-9a2d0e07-f1bc-4b61-b5fa-1dac5fea9b9c service nova] Acquiring lock "aa116cab-861b-459d-b1eb-6f07e5d71e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:59:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8e892095-2555-423e-8b73-99f9e4131eef req-9a2d0e07-f1bc-4b61-b5fa-1dac5fea9b9c service nova] Lock "aa116cab-861b-459d-b1eb-6f07e5d71e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:59:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8e892095-2555-423e-8b73-99f9e4131eef req-9a2d0e07-f1bc-4b61-b5fa-1dac5fea9b9c service nova] Lock "aa116cab-861b-459d-b1eb-6f07e5d71e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:59:01 user nova-compute[74342]: DEBUG nova.compute.manager [req-8e892095-2555-423e-8b73-99f9e4131eef req-9a2d0e07-f1bc-4b61-b5fa-1dac5fea9b9c service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] No waiting events found dispatching network-vif-plugged-480ecd6b-63b3-43be-8c76-98216f55e06a {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:59:01 user nova-compute[74342]: WARNING nova.compute.manager [req-8e892095-2555-423e-8b73-99f9e4131eef req-9a2d0e07-f1bc-4b61-b5fa-1dac5fea9b9c service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Received unexpected event network-vif-plugged-480ecd6b-63b3-43be-8c76-98216f55e06a for instance with vm_state active and task_state resize_finish.
Oct 16 09:59:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:59:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:59:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:59:01 user nova-compute[74342]: INFO nova.compute.claims [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Claim successful on node user
Oct 16 09:59:01 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:59:01 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:59:01 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:59:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.412s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:59:01 user nova-compute[74342]: DEBUG nova.compute.manager [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:59:01 user nova-compute[74342]: DEBUG nova.compute.manager [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:59:01 user nova-compute[74342]: DEBUG nova.network.neutron [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:59:01 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:59:01 user nova-compute[74342]: DEBUG nova.compute.manager [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:59:01 user nova-compute[74342]: DEBUG nova.policy [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '21ee41cd47eb4493ac26a4199e8b5902', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e8a3c19c78264cc7a4083e20cf4598ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:59:01 user nova-compute[74342]: DEBUG nova.compute.manager [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 09:59:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:59:01 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Creating image(s)
Oct 16 09:59:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Acquiring lock "/opt/stack/data/nova/instances/e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:59:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "/opt/stack/data/nova/instances/e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:59:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "/opt/stack/data/nova/instances/e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:59:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.265s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:59:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:59:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.237s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8/disk 1073741824" returned: 0 in 0.072s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.320s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:59:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.219s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:02 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 09:59:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:02 user nova-compute[74342]: DEBUG nova.network.neutron [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Successfully created port: 1c9f1265-73b2-4072-b664-f994d0c17646 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:59:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:02 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Cannot resize image /opt/stack/data/nova/instances/e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 09:59:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 09:59:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Ensure instance console log exists: /opt/stack/data/nova/instances/e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:59:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:59:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.009s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:59:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:59:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:03 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:59:03 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:59:03 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 09:59:03 user nova-compute[74342]: DEBUG nova.network.neutron [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Successfully updated port: 1c9f1265-73b2-4072-b664-f994d0c17646 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:59:03 user nova-compute[74342]: DEBUG nova.compute.manager [req-eb8002a0-e89b-47c7-b173-29edbbdee8d4 req-a6ed7939-60be-461a-8fdf-d71728cacf7c service nova] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Received event network-changed-1c9f1265-73b2-4072-b664-f994d0c17646 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:59:03 user nova-compute[74342]: DEBUG nova.compute.manager [req-eb8002a0-e89b-47c7-b173-29edbbdee8d4 req-a6ed7939-60be-461a-8fdf-d71728cacf7c service nova] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Refreshing instance network info cache due to event network-changed-1c9f1265-73b2-4072-b664-f994d0c17646. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:59:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-eb8002a0-e89b-47c7-b173-29edbbdee8d4 req-a6ed7939-60be-461a-8fdf-d71728cacf7c service nova] Acquiring lock "refresh_cache-e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:59:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-eb8002a0-e89b-47c7-b173-29edbbdee8d4 req-a6ed7939-60be-461a-8fdf-d71728cacf7c service nova] Acquired lock "refresh_cache-e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:59:03 user nova-compute[74342]: DEBUG nova.network.neutron [req-eb8002a0-e89b-47c7-b173-29edbbdee8d4 req-a6ed7939-60be-461a-8fdf-d71728cacf7c service nova] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Refreshing network info cache for port 1c9f1265-73b2-4072-b664-f994d0c17646 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:59:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Acquiring lock "refresh_cache-e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:59:03 user nova-compute[74342]: DEBUG nova.network.neutron [req-eb8002a0-e89b-47c7-b173-29edbbdee8d4 req-a6ed7939-60be-461a-8fdf-d71728cacf7c service nova] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:59:03 user nova-compute[74342]: DEBUG nova.network.neutron [req-eb8002a0-e89b-47c7-b173-29edbbdee8d4 req-a6ed7939-60be-461a-8fdf-d71728cacf7c service nova] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:59:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-eb8002a0-e89b-47c7-b173-29edbbdee8d4 req-a6ed7939-60be-461a-8fdf-d71728cacf7c service nova] Releasing lock "refresh_cache-e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Acquired lock "refresh_cache-e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG nova.network.neutron [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG nova.network.neutron [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG nova.network.neutron [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Updating instance_info_cache with network_info: [{"id": "1c9f1265-73b2-4072-b664-f994d0c17646", "address": "fa:16:3e:83:8e:bb", "network": {"id": "19a96357-4b1f-4da6-a8f4-795a37500116", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1856971527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8a3c19c78264cc7a4083e20cf4598ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c9f1265-73", "ovs_interfaceid": "1c9f1265-73b2-4072-b664-f994d0c17646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Releasing lock "refresh_cache-e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG nova.compute.manager [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Instance network_info: |[{"id": "1c9f1265-73b2-4072-b664-f994d0c17646", "address": "fa:16:3e:83:8e:bb", "network": {"id": "19a96357-4b1f-4da6-a8f4-795a37500116", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1856971527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8a3c19c78264cc7a4083e20cf4598ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c9f1265-73", "ovs_interfaceid": "1c9f1265-73b2-4072-b664-f994d0c17646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Start _get_guest_xml network_info=[{"id": "1c9f1265-73b2-4072-b664-f994d0c17646", "address": "fa:16:3e:83:8e:bb", "network": {"id": "19a96357-4b1f-4da6-a8f4-795a37500116", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1856971527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8a3c19c78264cc7a4083e20cf4598ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c9f1265-73", "ovs_interfaceid": "1c9f1265-73b2-4072-b664-f994d0c17646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:59:04 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:59:04 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:59:04 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:59:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1001651707',display_name='tempest-ServersNegativeTestJSON-server-1001651707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1001651707',id=31,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8a3c19c78264cc7a4083e20cf4598ec',ramdisk_id='',reservation_id='r-3iqt39vm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2110827578',owner_user_name='tempest-ServersNegativeTestJSON-2110827578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:59:02Z,user_data=None,user_id='21ee41cd47eb4493ac26a4199e8b5902',uuid=e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c9f1265-73b2-4072-b664-f994d0c17646", "address": "fa:16:3e:83:8e:bb", "network": {"id": "19a96357-4b1f-4da6-a8f4-795a37500116", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1856971527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8a3c19c78264cc7a4083e20cf4598ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c9f1265-73", "ovs_interfaceid": "1c9f1265-73b2-4072-b664-f994d0c17646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Converting VIF {"id": "1c9f1265-73b2-4072-b664-f994d0c17646", "address": "fa:16:3e:83:8e:bb", "network": {"id": "19a96357-4b1f-4da6-a8f4-795a37500116", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1856971527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8a3c19c78264cc7a4083e20cf4598ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c9f1265-73", "ovs_interfaceid": "1c9f1265-73b2-4072-b664-f994d0c17646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:8e:bb,bridge_name='br-int',has_traffic_filtering=True,id=1c9f1265-73b2-4072-b664-f994d0c17646,network=Network(19a96357-4b1f-4da6-a8f4-795a37500116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c9f1265-73') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG nova.objects.instance [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lazy-loading 'pci_devices' on Instance uuid e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:59:04 user nova-compute[74342]:   <uuid>e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8</uuid>
Oct 16 09:59:04 user nova-compute[74342]:   <name>instance-0000001f</name>
Oct 16 09:59:04 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:59:04 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:59:04 user nova-compute[74342]:   <metadata>
Oct 16 09:59:04 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:59:04 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:59:04 user nova-compute[74342]:       <nova:name>tempest-ServersNegativeTestJSON-server-1001651707</nova:name>
Oct 16 09:59:04 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:59:04</nova:creationTime>
Oct 16 09:59:04 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:59:04 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:59:04 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:59:04 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:59:04 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:59:04 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:59:04 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:59:04 user nova-compute[74342]:       <nova:owner>
Oct 16 09:59:04 user nova-compute[74342]:         <nova:user uuid="21ee41cd47eb4493ac26a4199e8b5902">tempest-ServersNegativeTestJSON-2110827578-project-member</nova:user>
Oct 16 09:59:04 user nova-compute[74342]:         <nova:project uuid="e8a3c19c78264cc7a4083e20cf4598ec">tempest-ServersNegativeTestJSON-2110827578</nova:project>
Oct 16 09:59:04 user nova-compute[74342]:       </nova:owner>
Oct 16 09:59:04 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:59:04 user nova-compute[74342]:       <nova:ports>
Oct 16 09:59:04 user nova-compute[74342]:         <nova:port uuid="1c9f1265-73b2-4072-b664-f994d0c17646">
Oct 16 09:59:04 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 09:59:04 user nova-compute[74342]:         </nova:port>
Oct 16 09:59:04 user nova-compute[74342]:       </nova:ports>
Oct 16 09:59:04 user nova-compute[74342]:     </nova:instance>
Oct 16 09:59:04 user nova-compute[74342]:   </metadata>
Oct 16 09:59:04 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:59:04 user nova-compute[74342]:     <system>
Oct 16 09:59:04 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:59:04 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:59:04 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:59:04 user nova-compute[74342]:       <entry name="serial">e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8</entry>
Oct 16 09:59:04 user nova-compute[74342]:       <entry name="uuid">e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8</entry>
Oct 16 09:59:04 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:59:04 user nova-compute[74342]:     </system>
Oct 16 09:59:04 user nova-compute[74342]:   </sysinfo>
Oct 16 09:59:04 user nova-compute[74342]:   <os>
Oct 16 09:59:04 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:59:04 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:59:04 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:59:04 user nova-compute[74342]:   </os>
Oct 16 09:59:04 user nova-compute[74342]:   <features>
Oct 16 09:59:04 user nova-compute[74342]:     <acpi/>
Oct 16 09:59:04 user nova-compute[74342]:     <apic/>
Oct 16 09:59:04 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:59:04 user nova-compute[74342]:   </features>
Oct 16 09:59:04 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:59:04 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:59:04 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:59:04 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:59:04 user nova-compute[74342]:   </clock>
Oct 16 09:59:04 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:59:04 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:59:04 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:59:04 user nova-compute[74342]:   </cpu>
Oct 16 09:59:04 user nova-compute[74342]:   <devices>
Oct 16 09:59:04 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 09:59:04 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 09:59:04 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8/disk"/>
Oct 16 09:59:04 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:59:04 user nova-compute[74342]:     </disk>
Oct 16 09:59:04 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:59:04 user nova-compute[74342]:       <mac address="fa:16:3e:83:8e:bb"/>
Oct 16 09:59:04 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:59:04 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:59:04 user nova-compute[74342]:       <target dev="tap1c9f1265-73"/>
Oct 16 09:59:04 user nova-compute[74342]:     </interface>
Oct 16 09:59:04 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:59:04 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8/console.log" append="off"/>
Oct 16 09:59:04 user nova-compute[74342]:     </serial>
Oct 16 09:59:04 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:59:04 user nova-compute[74342]:     <video>
Oct 16 09:59:04 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:59:04 user nova-compute[74342]:     </video>
Oct 16 09:59:04 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:59:04 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:59:04 user nova-compute[74342]:     </rng>
Oct 16 09:59:04 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:59:04 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:59:04 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:59:04 user nova-compute[74342]:     </memballoon>
Oct 16 09:59:04 user nova-compute[74342]:   </devices>
Oct 16 09:59:04 user nova-compute[74342]: </domain>
Oct 16 09:59:04 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:59:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1001651707',display_name='tempest-ServersNegativeTestJSON-server-1001651707',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1001651707',id=31,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e8a3c19c78264cc7a4083e20cf4598ec',ramdisk_id='',reservation_id='r-3iqt39vm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-2110827578',owner_user_name='tempest-ServersNegativeTestJSON-2110827578-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:59:02Z,user_data=None,user_id='21ee41cd47eb4493ac26a4199e8b5902',uuid=e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1c9f1265-73b2-4072-b664-f994d0c17646", "address": "fa:16:3e:83:8e:bb", "network": {"id": "19a96357-4b1f-4da6-a8f4-795a37500116", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1856971527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8a3c19c78264cc7a4083e20cf4598ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c9f1265-73", "ovs_interfaceid": "1c9f1265-73b2-4072-b664-f994d0c17646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Converting VIF {"id": "1c9f1265-73b2-4072-b664-f994d0c17646", "address": "fa:16:3e:83:8e:bb", "network": {"id": "19a96357-4b1f-4da6-a8f4-795a37500116", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1856971527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8a3c19c78264cc7a4083e20cf4598ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c9f1265-73", "ovs_interfaceid": "1c9f1265-73b2-4072-b664-f994d0c17646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:8e:bb,bridge_name='br-int',has_traffic_filtering=True,id=1c9f1265-73b2-4072-b664-f994d0c17646,network=Network(19a96357-4b1f-4da6-a8f4-795a37500116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c9f1265-73') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG os_vif [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:8e:bb,bridge_name='br-int',has_traffic_filtering=True,id=1c9f1265-73b2-4072-b664-f994d0c17646,network=Network(19a96357-4b1f-4da6-a8f4-795a37500116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c9f1265-73') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3832e029-f8b9-55f6-93ae-c1e373b6f9d0', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1c9f1265-73, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1c9f1265-73, col_values=(('qos', UUID('8a59b568-e945-437e-b76c-b9f8f401a73f')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1c9f1265-73, col_values=(('external_ids', {'iface-id': '1c9f1265-73b2-4072-b664-f994d0c17646', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:83:8e:bb', 'vm-uuid': 'e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:59:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:04 user nova-compute[74342]: INFO os_vif [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:8e:bb,bridge_name='br-int',has_traffic_filtering=True,id=1c9f1265-73b2-4072-b664-f994d0c17646,network=Network(19a96357-4b1f-4da6-a8f4-795a37500116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c9f1265-73')
Oct 16 09:59:05 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:59:05 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] No VIF found with MAC fa:16:3e:83:8e:bb, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:59:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-90be177d-98b9-435f-965e-d1fa6b69ae13 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "7f74c903-29f2-4635-bddd-c10051728f47" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:59:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-90be177d-98b9-435f-965e-d1fa6b69ae13 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "7f74c903-29f2-4635-bddd-c10051728f47" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:59:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-90be177d-98b9-435f-965e-d1fa6b69ae13 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "7f74c903-29f2-4635-bddd-c10051728f47-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:59:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-90be177d-98b9-435f-965e-d1fa6b69ae13 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "7f74c903-29f2-4635-bddd-c10051728f47-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:59:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-90be177d-98b9-435f-965e-d1fa6b69ae13 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "7f74c903-29f2-4635-bddd-c10051728f47-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:59:05 user nova-compute[74342]: INFO nova.compute.manager [None req-90be177d-98b9-435f-965e-d1fa6b69ae13 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Terminating instance
Oct 16 09:59:05 user nova-compute[74342]: DEBUG nova.compute.manager [None req-90be177d-98b9-435f-965e-d1fa6b69ae13 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 09:59:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:06 user nova-compute[74342]: DEBUG nova.compute.manager [req-e9d8c8c0-4850-49cc-b210-0b15b15363ac req-c03ca7dd-9d7f-486b-8e11-b7656e7da6cf service nova] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Received event network-vif-unplugged-bebf3999-cde8-46de-93e3-f80489f3b8bf {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:59:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e9d8c8c0-4850-49cc-b210-0b15b15363ac req-c03ca7dd-9d7f-486b-8e11-b7656e7da6cf service nova] Acquiring lock "7f74c903-29f2-4635-bddd-c10051728f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:59:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e9d8c8c0-4850-49cc-b210-0b15b15363ac req-c03ca7dd-9d7f-486b-8e11-b7656e7da6cf service nova] Lock "7f74c903-29f2-4635-bddd-c10051728f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:59:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e9d8c8c0-4850-49cc-b210-0b15b15363ac req-c03ca7dd-9d7f-486b-8e11-b7656e7da6cf service nova] Lock "7f74c903-29f2-4635-bddd-c10051728f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:59:06 user nova-compute[74342]: DEBUG nova.compute.manager [req-e9d8c8c0-4850-49cc-b210-0b15b15363ac req-c03ca7dd-9d7f-486b-8e11-b7656e7da6cf service nova] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] No waiting events found dispatching network-vif-unplugged-bebf3999-cde8-46de-93e3-f80489f3b8bf {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:59:06 user nova-compute[74342]: DEBUG nova.compute.manager [req-e9d8c8c0-4850-49cc-b210-0b15b15363ac req-c03ca7dd-9d7f-486b-8e11-b7656e7da6cf service nova] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Received event network-vif-unplugged-bebf3999-cde8-46de-93e3-f80489f3b8bf for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 09:59:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "9dc7115b-8a02-4ef4-9d44-6590c9fded3e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:59:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "9dc7115b-8a02-4ef4-9d44-6590c9fded3e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:59:06 user nova-compute[74342]: DEBUG nova.compute.manager [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:59:06 user nova-compute[74342]: DEBUG nova.compute.manager [req-8d148564-a60f-4a08-98f7-0819c4996012 req-68985d96-42be-40a7-b644-e744cd9d6212 service nova] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Received event network-vif-plugged-1c9f1265-73b2-4072-b664-f994d0c17646 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:59:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8d148564-a60f-4a08-98f7-0819c4996012 req-68985d96-42be-40a7-b644-e744cd9d6212 service nova] Acquiring lock "e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:59:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8d148564-a60f-4a08-98f7-0819c4996012 req-68985d96-42be-40a7-b644-e744cd9d6212 service nova] Lock "e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:59:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8d148564-a60f-4a08-98f7-0819c4996012 req-68985d96-42be-40a7-b644-e744cd9d6212 service nova] Lock "e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:59:06 user nova-compute[74342]: DEBUG nova.compute.manager [req-8d148564-a60f-4a08-98f7-0819c4996012 req-68985d96-42be-40a7-b644-e744cd9d6212 service nova] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] No waiting events found dispatching network-vif-plugged-1c9f1265-73b2-4072-b664-f994d0c17646 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:59:06 user nova-compute[74342]: WARNING nova.compute.manager [req-8d148564-a60f-4a08-98f7-0819c4996012 req-68985d96-42be-40a7-b644-e744cd9d6212 service nova] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Received unexpected event network-vif-plugged-1c9f1265-73b2-4072-b664-f994d0c17646 for instance with vm_state building and task_state spawning.
Oct 16 09:59:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:59:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:59:06 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:59:06 user nova-compute[74342]: INFO nova.compute.claims [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Claim successful on node user
Oct 16 09:59:07 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Instance destroyed successfully.
Oct 16 09:59:07 user nova-compute[74342]: DEBUG nova.objects.instance [None req-90be177d-98b9-435f-965e-d1fa6b69ae13 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lazy-loading 'resources' on Instance uuid 7f74c903-29f2-4635-bddd-c10051728f47 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-90be177d-98b9-435f-965e-d1fa6b69ae13 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:55:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2078792788',display_name='tempest-AttachVolumeNegativeTest-server-2078792788',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2078792788',id=28,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBInoBCPz9u2gBUSLQuKukwVqGTqT/mVhiDa4+pwzySVSH1A8xw0OT4AdWKB5q6I4uArxvy8t1xLxHLZpEbjPPI5o7rmJaZMcn1iQf5tHmgNerWmZyJM4P+2E8u3++TUA0Q==',key_name='tempest-keypair-232959929',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:56:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08329cd0ad7d42a1999ca4f407d93245',ramdisk_id='',reservation_id='r-hwpz4jvv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-119585701',owner_user_name='tempest-AttachVolumeNegativeTest-119585701-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:56:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee02f6ad1d9749948f43fb432685d067',uuid=7f74c903-29f2-4635-bddd-c10051728f47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bebf3999-cde8-46de-93e3-f80489f3b8bf", "address": "fa:16:3e:76:2a:2f", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbebf3999-cd", "ovs_interfaceid": "bebf3999-cde8-46de-93e3-f80489f3b8bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-90be177d-98b9-435f-965e-d1fa6b69ae13 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Converting VIF {"id": "bebf3999-cde8-46de-93e3-f80489f3b8bf", "address": "fa:16:3e:76:2a:2f", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbebf3999-cd", "ovs_interfaceid": "bebf3999-cde8-46de-93e3-f80489f3b8bf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-90be177d-98b9-435f-965e-d1fa6b69ae13 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:2a:2f,bridge_name='br-int',has_traffic_filtering=True,id=bebf3999-cde8-46de-93e3-f80489f3b8bf,network=Network(023e393d-f8ef-42f1-8879-6259a82218cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbebf3999-cd') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG os_vif [None req-90be177d-98b9-435f-965e-d1fa6b69ae13 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:2a:2f,bridge_name='br-int',has_traffic_filtering=True,id=bebf3999-cde8-46de-93e3-f80489f3b8bf,network=Network(023e393d-f8ef-42f1-8879-6259a82218cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbebf3999-cd') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbebf3999-cd, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25498ca7-996b-4fbc-9888-9951eec9ede7) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:07 user nova-compute[74342]: INFO os_vif [None req-90be177d-98b9-435f-965e-d1fa6b69ae13 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:2a:2f,bridge_name='br-int',has_traffic_filtering=True,id=bebf3999-cde8-46de-93e3-f80489f3b8bf,network=Network(023e393d-f8ef-42f1-8879-6259a82218cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbebf3999-cd')
Oct 16 09:59:07 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-90be177d-98b9-435f-965e-d1fa6b69ae13 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Deleting instance files /opt/stack/data/nova/instances/7f74c903-29f2-4635-bddd-c10051728f47_del
Oct 16 09:59:07 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-90be177d-98b9-435f-965e-d1fa6b69ae13 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Deletion of /opt/stack/data/nova/instances/7f74c903-29f2-4635-bddd-c10051728f47_del complete
Oct 16 09:59:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG nova.compute.manager [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG nova.compute.manager [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG nova.network.neutron [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:59:07 user nova-compute[74342]: INFO nova.compute.manager [None req-90be177d-98b9-435f-965e-d1fa6b69ae13 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Took 1.71 seconds to destroy the instance on the hypervisor.
Oct 16 09:59:07 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-90be177d-98b9-435f-965e-d1fa6b69ae13 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 09:59:07 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:59:07 user nova-compute[74342]: DEBUG nova.compute.manager [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:59:07 user nova-compute[74342]: INFO nova.virt.block_device [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Booting with volume 6238337b-9041-4805-bc92-cc3e22047342 at /dev/vda
Oct 16 09:59:07 user nova-compute[74342]: DEBUG nova.policy [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2cac31e799b743359b93943b68b38acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799c265b3d14465a9ca6bd7d5e8a4488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG os_brick.utils [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c79443e-c28d-47ec-a2a6-2dbeeead8313]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20bf88b-4e4b-494b-86d9-593e20bed830]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc85633-7d76-4212-afda-c2ed6319aeaa]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[241ccc90-b166-4b25-bc93-344b373b9024]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 09:59:07 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 09:59:07 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[08dafcd9-377f-4599-ae38-1f8f0d0b54de]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG os_brick.utils [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:59:07 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Updating existing volume attachment record: a9e4669c-63ad-4abd-b1a0-3d150b5e69a9 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 09:59:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:08 user nova-compute[74342]: DEBUG nova.compute.manager [req-375ea957-5065-41a8-9dc6-b48e38d2ba9c req-3451a04a-31a6-459c-bbf5-44e1709dc35f service nova] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Received event network-vif-plugged-bebf3999-cde8-46de-93e3-f80489f3b8bf {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:59:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-375ea957-5065-41a8-9dc6-b48e38d2ba9c req-3451a04a-31a6-459c-bbf5-44e1709dc35f service nova] Acquiring lock "7f74c903-29f2-4635-bddd-c10051728f47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:59:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-375ea957-5065-41a8-9dc6-b48e38d2ba9c req-3451a04a-31a6-459c-bbf5-44e1709dc35f service nova] Lock "7f74c903-29f2-4635-bddd-c10051728f47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:59:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-375ea957-5065-41a8-9dc6-b48e38d2ba9c req-3451a04a-31a6-459c-bbf5-44e1709dc35f service nova] Lock "7f74c903-29f2-4635-bddd-c10051728f47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:59:08 user nova-compute[74342]: DEBUG nova.compute.manager [req-375ea957-5065-41a8-9dc6-b48e38d2ba9c req-3451a04a-31a6-459c-bbf5-44e1709dc35f service nova] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] No waiting events found dispatching network-vif-plugged-bebf3999-cde8-46de-93e3-f80489f3b8bf {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:59:08 user nova-compute[74342]: WARNING nova.compute.manager [req-375ea957-5065-41a8-9dc6-b48e38d2ba9c req-3451a04a-31a6-459c-bbf5-44e1709dc35f service nova] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Received unexpected event network-vif-plugged-bebf3999-cde8-46de-93e3-f80489f3b8bf for instance with vm_state active and task_state deleting.
Oct 16 09:59:08 user nova-compute[74342]: DEBUG nova.compute.manager [req-41de046b-1405-46f4-b42b-3e3ef16dda86 req-4fb68357-8234-4277-bf5c-c3f3ccaa3a79 service nova] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Received event network-vif-plugged-1c9f1265-73b2-4072-b664-f994d0c17646 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:59:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-41de046b-1405-46f4-b42b-3e3ef16dda86 req-4fb68357-8234-4277-bf5c-c3f3ccaa3a79 service nova] Acquiring lock "e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:59:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-41de046b-1405-46f4-b42b-3e3ef16dda86 req-4fb68357-8234-4277-bf5c-c3f3ccaa3a79 service nova] Lock "e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:59:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-41de046b-1405-46f4-b42b-3e3ef16dda86 req-4fb68357-8234-4277-bf5c-c3f3ccaa3a79 service nova] Lock "e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:59:08 user nova-compute[74342]: DEBUG nova.compute.manager [req-41de046b-1405-46f4-b42b-3e3ef16dda86 req-4fb68357-8234-4277-bf5c-c3f3ccaa3a79 service nova] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] No waiting events found dispatching network-vif-plugged-1c9f1265-73b2-4072-b664-f994d0c17646 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:59:08 user nova-compute[74342]: WARNING nova.compute.manager [req-41de046b-1405-46f4-b42b-3e3ef16dda86 req-4fb68357-8234-4277-bf5c-c3f3ccaa3a79 service nova] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Received unexpected event network-vif-plugged-1c9f1265-73b2-4072-b664-f994d0c17646 for instance with vm_state building and task_state spawning.
Oct 16 09:59:08 user nova-compute[74342]: DEBUG nova.network.neutron [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Successfully created port: 2175722a-e6dd-4b7f-ab62-e3974274f81a {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:59:09 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:59:09 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Took 1.51 seconds to deallocate network for instance.
Oct 16 09:59:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-90be177d-98b9-435f-965e-d1fa6b69ae13 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:59:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-90be177d-98b9-435f-965e-d1fa6b69ae13 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:59:09 user nova-compute[74342]: DEBUG nova.compute.manager [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:59:09 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:59:09 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Instance spawned successfully.
Oct 16 09:59:09 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:59:09 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:59:09 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:59:09 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:59:09 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:59:09 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:59:09 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:59:09 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-90be177d-98b9-435f-965e-d1fa6b69ae13 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:59:09 user nova-compute[74342]: INFO nova.compute.manager [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Took 7.82 seconds to spawn the instance on the hypervisor.
Oct 16 09:59:09 user nova-compute[74342]: DEBUG nova.compute.manager [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:59:09 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-90be177d-98b9-435f-965e-d1fa6b69ae13 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:59:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-90be177d-98b9-435f-965e-d1fa6b69ae13 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.376s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:59:09 user nova-compute[74342]: INFO nova.compute.manager [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Took 8.65 seconds to build instance.
Oct 16 09:59:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-390b95f6-354c-4d25-9122-f1bb681f3925 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.767s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:59:09 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-90be177d-98b9-435f-965e-d1fa6b69ae13 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Deleted allocations for instance 7f74c903-29f2-4635-bddd-c10051728f47
Oct 16 09:59:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-90be177d-98b9-435f-965e-d1fa6b69ae13 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "7f74c903-29f2-4635-bddd-c10051728f47" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.011s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:59:10 user nova-compute[74342]: DEBUG nova.network.neutron [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Successfully updated port: 2175722a-e6dd-4b7f-ab62-e3974274f81a {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:59:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "refresh_cache-9dc7115b-8a02-4ef4-9d44-6590c9fded3e" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:59:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquired lock "refresh_cache-9dc7115b-8a02-4ef4-9d44-6590c9fded3e" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:59:10 user nova-compute[74342]: DEBUG nova.network.neutron [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:59:10 user nova-compute[74342]: DEBUG nova.network.neutron [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:59:10 user nova-compute[74342]: DEBUG nova.compute.manager [req-4f9baf30-2021-4d35-8783-88addf94df30 req-07aeffae-bd1f-4ede-a8bb-f5dad86975a6 service nova] [instance: 7f74c903-29f2-4635-bddd-c10051728f47] Received event network-vif-deleted-bebf3999-cde8-46de-93e3-f80489f3b8bf {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:59:10 user nova-compute[74342]: DEBUG nova.compute.manager [req-4f9baf30-2021-4d35-8783-88addf94df30 req-07aeffae-bd1f-4ede-a8bb-f5dad86975a6 service nova] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Received event network-changed-2175722a-e6dd-4b7f-ab62-e3974274f81a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:59:10 user nova-compute[74342]: DEBUG nova.compute.manager [req-4f9baf30-2021-4d35-8783-88addf94df30 req-07aeffae-bd1f-4ede-a8bb-f5dad86975a6 service nova] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Refreshing instance network info cache due to event network-changed-2175722a-e6dd-4b7f-ab62-e3974274f81a. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:59:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4f9baf30-2021-4d35-8783-88addf94df30 req-07aeffae-bd1f-4ede-a8bb-f5dad86975a6 service nova] Acquiring lock "refresh_cache-9dc7115b-8a02-4ef4-9d44-6590c9fded3e" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:59:10 user nova-compute[74342]: DEBUG nova.network.neutron [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Updating instance_info_cache with network_info: [{"id": "2175722a-e6dd-4b7f-ab62-e3974274f81a", "address": "fa:16:3e:f0:12:7d", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2175722a-e6", "ovs_interfaceid": "2175722a-e6dd-4b7f-ab62-e3974274f81a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:59:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Releasing lock "refresh_cache-9dc7115b-8a02-4ef4-9d44-6590c9fded3e" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:59:10 user nova-compute[74342]: DEBUG nova.compute.manager [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Instance network_info: |[{"id": "2175722a-e6dd-4b7f-ab62-e3974274f81a", "address": "fa:16:3e:f0:12:7d", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2175722a-e6", "ovs_interfaceid": "2175722a-e6dd-4b7f-ab62-e3974274f81a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:59:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4f9baf30-2021-4d35-8783-88addf94df30 req-07aeffae-bd1f-4ede-a8bb-f5dad86975a6 service nova] Acquired lock "refresh_cache-9dc7115b-8a02-4ef4-9d44-6590c9fded3e" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:59:10 user nova-compute[74342]: DEBUG nova.network.neutron [req-4f9baf30-2021-4d35-8783-88addf94df30 req-07aeffae-bd1f-4ede-a8bb-f5dad86975a6 service nova] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Refreshing network info cache for port 2175722a-e6dd-4b7f-ab62-e3974274f81a {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:59:10 user nova-compute[74342]: DEBUG nova.network.neutron [req-4f9baf30-2021-4d35-8783-88addf94df30 req-07aeffae-bd1f-4ede-a8bb-f5dad86975a6 service nova] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Updated VIF entry in instance network info cache for port 2175722a-e6dd-4b7f-ab62-e3974274f81a. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:59:10 user nova-compute[74342]: DEBUG nova.network.neutron [req-4f9baf30-2021-4d35-8783-88addf94df30 req-07aeffae-bd1f-4ede-a8bb-f5dad86975a6 service nova] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Updating instance_info_cache with network_info: [{"id": "2175722a-e6dd-4b7f-ab62-e3974274f81a", "address": "fa:16:3e:f0:12:7d", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2175722a-e6", "ovs_interfaceid": "2175722a-e6dd-4b7f-ab62-e3974274f81a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:59:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4f9baf30-2021-4d35-8783-88addf94df30 req-07aeffae-bd1f-4ede-a8bb-f5dad86975a6 service nova] Releasing lock "refresh_cache-9dc7115b-8a02-4ef4-9d44-6590c9fded3e" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:59:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG nova.compute.manager [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:59:25 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Creating image(s)
Oct 16 09:59:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Did not create local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Ensure instance console log exists: /opt/stack/data/nova/instances/9dc7115b-8a02-4ef4-9d44-6590c9fded3e/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Start _get_guest_xml network_info=[{"id": "2175722a-e6dd-4b7f-ab62-e3974274f81a", "address": "fa:16:3e:f0:12:7d", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2175722a-e6", "ovs_interfaceid": "2175722a-e6dd-4b7f-ab62-e3974274f81a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'attachment_id': 'a9e4669c-63ad-4abd-b1a0-3d150b5e69a9', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TSBlviZk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '9dc7115b-8a02-4ef4-9d44-6590c9fded3e', 'attached_at': '', 'detached_at': '', 'volume_id': '6238337b-9041-4805-bc92-cc3e22047342', 'serial': '6238337b-9041-4805-bc92-cc3e22047342'}, 'volume_type': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:59:25 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:59:25 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:59:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TSBlviZk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 09:59:25 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:59:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:59:25 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 09:59:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 09:59:25 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[00487e49-06a7-4211-a176-25cf40f8f92d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 09:59:25 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3553ac64-6924-4265-9320-e705b534935e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342] added
Oct 16 09:59:25 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d24074-0d20-4fe8-86fb-4769206c87d5]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e856c8e-b4f2-4ed5-8b83-b0dfcb7de7ec]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TSBlviZk {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TSBlviZk" returned: 0 in 0.028s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dde659c-f737-4690-a9d2-27c9b4f9284c]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TSBlviZk'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb08e2e3-5a24-41ed-804b-f7e8b09605f3]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb08acd-1fc4-4290-b290-730a1e460af0]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 09:59:25 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 09:59:25 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7b8e01-00e5-4bf1-8a3e-1d6542108d41]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342, portal: 172.16.0.220,3260]
Oct 16 09:59:25 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342, portal: 172.16.0.220,3260] successful.
Oct 16 09:59:25 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[539a28fd-f6bb-41bb-82f6-4e82e82af743]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf56c4f-6a74-45ba-b7c7-70e2f1d5ff77]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 09:59:25 user nova-compute[74342]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)
Oct 16 09:59:25 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 09:59:25 user nova-compute[74342]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)
Oct 16 09:59:25 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57ac905-047c-45d8-808e-c91c68f09243]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 09:59:25 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: None {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:59:26 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 09:59:26 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TSBlviZk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 09:59:26 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 09:59:26 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23338623864636639', 'path': '/dev/sdc'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 09:59:26 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23338623864636639', 'path': '/dev/sdc'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 09:59:26 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:59:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1968296748',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1968296748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1968296748',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnx9nLbf02/dLhwYC0EJ1MiVF8ijprGcOZdaUesCRKKvwWxWSqxsg/YaUGHmlKxGjomdI0Y1S2XlaZiEiIhTdufI1s6+tfi0Dz/JTgKeXKLq1uA3AbTSoOFwoSH4tL5Fg==',key_name='tempest-keypair-1848953359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='799c265b3d14465a9ca6bd7d5e8a4488',ramdisk_id='',reservation_id='r-s47t0181',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-158744824',owner_user_name='tempest-TestVolumeBootPattern-158744824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:59:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cac31e799b743359b93943b68b38acf',uuid=9dc7115b-8a02-4ef4-9d44-6590c9fded3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2175722a-e6dd-4b7f-ab62-e3974274f81a", "address": "fa:16:3e:f0:12:7d", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2175722a-e6", "ovs_interfaceid": "2175722a-e6dd-4b7f-ab62-e3974274f81a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:59:26 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converting VIF {"id": "2175722a-e6dd-4b7f-ab62-e3974274f81a", "address": "fa:16:3e:f0:12:7d", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2175722a-e6", "ovs_interfaceid": "2175722a-e6dd-4b7f-ab62-e3974274f81a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:59:26 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:12:7d,bridge_name='br-int',has_traffic_filtering=True,id=2175722a-e6dd-4b7f-ab62-e3974274f81a,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2175722a-e6') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:59:26 user nova-compute[74342]: DEBUG nova.objects.instance [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lazy-loading 'pci_devices' on Instance uuid 9dc7115b-8a02-4ef4-9d44-6590c9fded3e {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:59:27 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:59:27 user nova-compute[74342]:   <uuid>9dc7115b-8a02-4ef4-9d44-6590c9fded3e</uuid>
Oct 16 09:59:27 user nova-compute[74342]:   <name>instance-00000020</name>
Oct 16 09:59:27 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:59:27 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:59:27 user nova-compute[74342]:   <metadata>
Oct 16 09:59:27 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:59:27 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:59:27 user nova-compute[74342]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1968296748</nova:name>
Oct 16 09:59:27 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:59:25</nova:creationTime>
Oct 16 09:59:27 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:59:27 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:59:27 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:59:27 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:59:27 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:59:27 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:59:27 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:59:27 user nova-compute[74342]:       <nova:owner>
Oct 16 09:59:27 user nova-compute[74342]:         <nova:user uuid="2cac31e799b743359b93943b68b38acf">tempest-TestVolumeBootPattern-158744824-project-member</nova:user>
Oct 16 09:59:27 user nova-compute[74342]:         <nova:project uuid="799c265b3d14465a9ca6bd7d5e8a4488">tempest-TestVolumeBootPattern-158744824</nova:project>
Oct 16 09:59:27 user nova-compute[74342]:       </nova:owner>
Oct 16 09:59:27 user nova-compute[74342]:       <nova:ports>
Oct 16 09:59:27 user nova-compute[74342]:         <nova:port uuid="2175722a-e6dd-4b7f-ab62-e3974274f81a">
Oct 16 09:59:27 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 16 09:59:27 user nova-compute[74342]:         </nova:port>
Oct 16 09:59:27 user nova-compute[74342]:       </nova:ports>
Oct 16 09:59:27 user nova-compute[74342]:     </nova:instance>
Oct 16 09:59:27 user nova-compute[74342]:   </metadata>
Oct 16 09:59:27 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:59:27 user nova-compute[74342]:     <system>
Oct 16 09:59:27 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:59:27 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:59:27 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:59:27 user nova-compute[74342]:       <entry name="serial">9dc7115b-8a02-4ef4-9d44-6590c9fded3e</entry>
Oct 16 09:59:27 user nova-compute[74342]:       <entry name="uuid">9dc7115b-8a02-4ef4-9d44-6590c9fded3e</entry>
Oct 16 09:59:27 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:59:27 user nova-compute[74342]:     </system>
Oct 16 09:59:27 user nova-compute[74342]:   </sysinfo>
Oct 16 09:59:27 user nova-compute[74342]:   <os>
Oct 16 09:59:27 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:59:27 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:59:27 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:59:27 user nova-compute[74342]:   </os>
Oct 16 09:59:27 user nova-compute[74342]:   <features>
Oct 16 09:59:27 user nova-compute[74342]:     <acpi/>
Oct 16 09:59:27 user nova-compute[74342]:     <apic/>
Oct 16 09:59:27 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:59:27 user nova-compute[74342]:   </features>
Oct 16 09:59:27 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:59:27 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:59:27 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:59:27 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:59:27 user nova-compute[74342]:   </clock>
Oct 16 09:59:27 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:59:27 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:59:27 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:59:27 user nova-compute[74342]:   </cpu>
Oct 16 09:59:27 user nova-compute[74342]:   <devices>
Oct 16 09:59:27 user nova-compute[74342]:     <disk type="block" device="disk">
Oct 16 09:59:27 user nova-compute[74342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 09:59:27 user nova-compute[74342]:       <source dev="/dev/sdc"/>
Oct 16 09:59:27 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:59:27 user nova-compute[74342]:       <serial>6238337b-9041-4805-bc92-cc3e22047342</serial>
Oct 16 09:59:27 user nova-compute[74342]:     </disk>
Oct 16 09:59:27 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:59:27 user nova-compute[74342]:       <mac address="fa:16:3e:f0:12:7d"/>
Oct 16 09:59:27 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:59:27 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:59:27 user nova-compute[74342]:       <target dev="tap2175722a-e6"/>
Oct 16 09:59:27 user nova-compute[74342]:     </interface>
Oct 16 09:59:27 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:59:27 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/9dc7115b-8a02-4ef4-9d44-6590c9fded3e/console.log" append="off"/>
Oct 16 09:59:27 user nova-compute[74342]:     </serial>
Oct 16 09:59:27 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:59:27 user nova-compute[74342]:     <video>
Oct 16 09:59:27 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:59:27 user nova-compute[74342]:     </video>
Oct 16 09:59:27 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:59:27 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:59:27 user nova-compute[74342]:     </rng>
Oct 16 09:59:27 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:59:27 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:59:27 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:59:27 user nova-compute[74342]:     </memballoon>
Oct 16 09:59:27 user nova-compute[74342]:   </devices>
Oct 16 09:59:27 user nova-compute[74342]: </domain>
Oct 16 09:59:27 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:59:27 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:59:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1968296748',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1968296748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1968296748',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnx9nLbf02/dLhwYC0EJ1MiVF8ijprGcOZdaUesCRKKvwWxWSqxsg/YaUGHmlKxGjomdI0Y1S2XlaZiEiIhTdufI1s6+tfi0Dz/JTgKeXKLq1uA3AbTSoOFwoSH4tL5Fg==',key_name='tempest-keypair-1848953359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='799c265b3d14465a9ca6bd7d5e8a4488',ramdisk_id='',reservation_id='r-s47t0181',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-158744824',owner_user_name='tempest-TestVolumeBootPattern-158744824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:59:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cac31e799b743359b93943b68b38acf',uuid=9dc7115b-8a02-4ef4-9d44-6590c9fded3e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2175722a-e6dd-4b7f-ab62-e3974274f81a", "address": "fa:16:3e:f0:12:7d", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2175722a-e6", "ovs_interfaceid": "2175722a-e6dd-4b7f-ab62-e3974274f81a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:59:27 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converting VIF {"id": "2175722a-e6dd-4b7f-ab62-e3974274f81a", "address": "fa:16:3e:f0:12:7d", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2175722a-e6", "ovs_interfaceid": "2175722a-e6dd-4b7f-ab62-e3974274f81a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:59:27 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:12:7d,bridge_name='br-int',has_traffic_filtering=True,id=2175722a-e6dd-4b7f-ab62-e3974274f81a,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2175722a-e6') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:59:27 user nova-compute[74342]: DEBUG os_vif [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:12:7d,bridge_name='br-int',has_traffic_filtering=True,id=2175722a-e6dd-4b7f-ab62-e3974274f81a,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2175722a-e6') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:59:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:59:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:59:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a013511-2fd5-5145-94a7-a17897991d68', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:59:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:59:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2175722a-e6, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:59:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2175722a-e6, col_values=(('qos', UUID('e9bae8d1-1240-4866-a38f-a72cf70427af')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:59:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2175722a-e6, col_values=(('external_ids', {'iface-id': '2175722a-e6dd-4b7f-ab62-e3974274f81a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:12:7d', 'vm-uuid': '9dc7115b-8a02-4ef4-9d44-6590c9fded3e'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:59:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:59:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:27 user nova-compute[74342]: INFO os_vif [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:12:7d,bridge_name='br-int',has_traffic_filtering=True,id=2175722a-e6dd-4b7f-ab62-e3974274f81a,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2175722a-e6')
Oct 16 09:59:27 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:59:27 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] No VIF found with MAC fa:16:3e:f0:12:7d, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:59:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:28 user nova-compute[74342]: DEBUG nova.compute.manager [req-9a10ba98-e4c5-4af4-bb0f-baed3558551d req-75a8f5fe-9518-439a-950d-b8865bb98191 service nova] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Received event network-vif-plugged-2175722a-e6dd-4b7f-ab62-e3974274f81a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:59:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9a10ba98-e4c5-4af4-bb0f-baed3558551d req-75a8f5fe-9518-439a-950d-b8865bb98191 service nova] Acquiring lock "9dc7115b-8a02-4ef4-9d44-6590c9fded3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:59:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9a10ba98-e4c5-4af4-bb0f-baed3558551d req-75a8f5fe-9518-439a-950d-b8865bb98191 service nova] Lock "9dc7115b-8a02-4ef4-9d44-6590c9fded3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:59:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9a10ba98-e4c5-4af4-bb0f-baed3558551d req-75a8f5fe-9518-439a-950d-b8865bb98191 service nova] Lock "9dc7115b-8a02-4ef4-9d44-6590c9fded3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:59:28 user nova-compute[74342]: DEBUG nova.compute.manager [req-9a10ba98-e4c5-4af4-bb0f-baed3558551d req-75a8f5fe-9518-439a-950d-b8865bb98191 service nova] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] No waiting events found dispatching network-vif-plugged-2175722a-e6dd-4b7f-ab62-e3974274f81a {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:59:28 user nova-compute[74342]: WARNING nova.compute.manager [req-9a10ba98-e4c5-4af4-bb0f-baed3558551d req-75a8f5fe-9518-439a-950d-b8865bb98191 service nova] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Received unexpected event network-vif-plugged-2175722a-e6dd-4b7f-ab62-e3974274f81a for instance with vm_state building and task_state spawning.
Oct 16 09:59:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:30 user nova-compute[74342]: DEBUG nova.compute.manager [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:59:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:59:30 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Instance spawned successfully.
Oct 16 09:59:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:59:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:59:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:59:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:59:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:59:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:59:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:59:30 user nova-compute[74342]: INFO nova.compute.manager [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Took 5.08 seconds to spawn the instance on the hypervisor.
Oct 16 09:59:30 user nova-compute[74342]: DEBUG nova.compute.manager [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:59:30 user nova-compute[74342]: DEBUG nova.compute.manager [req-ee90abdb-7ed4-4e9b-aaa4-276f8c1ec572 req-7a59a765-5f4b-4c34-af8f-516591378347 service nova] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Received event network-vif-plugged-2175722a-e6dd-4b7f-ab62-e3974274f81a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:59:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ee90abdb-7ed4-4e9b-aaa4-276f8c1ec572 req-7a59a765-5f4b-4c34-af8f-516591378347 service nova] Acquiring lock "9dc7115b-8a02-4ef4-9d44-6590c9fded3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:59:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ee90abdb-7ed4-4e9b-aaa4-276f8c1ec572 req-7a59a765-5f4b-4c34-af8f-516591378347 service nova] Lock "9dc7115b-8a02-4ef4-9d44-6590c9fded3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:59:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ee90abdb-7ed4-4e9b-aaa4-276f8c1ec572 req-7a59a765-5f4b-4c34-af8f-516591378347 service nova] Lock "9dc7115b-8a02-4ef4-9d44-6590c9fded3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:59:30 user nova-compute[74342]: DEBUG nova.compute.manager [req-ee90abdb-7ed4-4e9b-aaa4-276f8c1ec572 req-7a59a765-5f4b-4c34-af8f-516591378347 service nova] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] No waiting events found dispatching network-vif-plugged-2175722a-e6dd-4b7f-ab62-e3974274f81a {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:59:30 user nova-compute[74342]: WARNING nova.compute.manager [req-ee90abdb-7ed4-4e9b-aaa4-276f8c1ec572 req-7a59a765-5f4b-4c34-af8f-516591378347 service nova] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Received unexpected event network-vif-plugged-2175722a-e6dd-4b7f-ab62-e3974274f81a for instance with vm_state building and task_state spawning.
Oct 16 09:59:30 user nova-compute[74342]: INFO nova.compute.manager [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Took 23.91 seconds to build instance.
Oct 16 09:59:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-542403cb-e542-45a6-8eaa-8a51059f526c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "9dc7115b-8a02-4ef4-9d44-6590c9fded3e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.089s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:59:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:59:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:59:38 user nova-compute[74342]: DEBUG nova.compute.manager [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 09:59:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:59:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:59:38 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 09:59:38 user nova-compute[74342]: INFO nova.compute.claims [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Claim successful on node user
Oct 16 09:59:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:38 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:59:38 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:59:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.382s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:59:38 user nova-compute[74342]: DEBUG nova.compute.manager [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 09:59:38 user nova-compute[74342]: DEBUG nova.compute.manager [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 09:59:38 user nova-compute[74342]: DEBUG nova.network.neutron [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 09:59:38 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 09:59:38 user nova-compute[74342]: DEBUG nova.compute.manager [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 09:59:38 user nova-compute[74342]: DEBUG nova.policy [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c8bf8aa8ab2d4105ad0b1fd04247e3a0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a70b9ea5f3404a5690cd0a73db23f034', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 09:59:38 user nova-compute[74342]: DEBUG nova.compute.manager [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 09:59:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 09:59:38 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Creating image(s)
Oct 16 09:59:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:59:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "/opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:59:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "/opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:59:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.176s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:59:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:59:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.182s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk 1073741824" returned: 0 in 0.052s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:59:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:39 user nova-compute[74342]: DEBUG nova.network.neutron [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Successfully created port: 6bd9a0d7-fd42-4686-b4a8-af790582008d {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 09:59:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.182s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:39 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 09:59:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:39 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Cannot resize image /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 09:59:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 09:59:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Ensure instance console log exists: /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 09:59:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:59:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:59:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:59:39 user nova-compute[74342]: DEBUG nova.network.neutron [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Successfully updated port: 6bd9a0d7-fd42-4686-b4a8-af790582008d {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 09:59:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "refresh_cache-f0f4fa14-f586-47f0-a79e-4ee095c9fb39" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:59:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquired lock "refresh_cache-f0f4fa14-f586-47f0-a79e-4ee095c9fb39" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:59:39 user nova-compute[74342]: DEBUG nova.network.neutron [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 09:59:39 user nova-compute[74342]: DEBUG nova.compute.manager [req-58ff6817-cb64-487e-ac3e-6a3ec8a8d2f2 req-965871d3-243b-4d86-96e1-65d2b9df523c service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Received event network-changed-6bd9a0d7-fd42-4686-b4a8-af790582008d {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:59:39 user nova-compute[74342]: DEBUG nova.compute.manager [req-58ff6817-cb64-487e-ac3e-6a3ec8a8d2f2 req-965871d3-243b-4d86-96e1-65d2b9df523c service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Refreshing instance network info cache due to event network-changed-6bd9a0d7-fd42-4686-b4a8-af790582008d. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 09:59:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-58ff6817-cb64-487e-ac3e-6a3ec8a8d2f2 req-965871d3-243b-4d86-96e1-65d2b9df523c service nova] Acquiring lock "refresh_cache-f0f4fa14-f586-47f0-a79e-4ee095c9fb39" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 09:59:39 user nova-compute[74342]: DEBUG nova.network.neutron [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.network.neutron [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Updating instance_info_cache with network_info: [{"id": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "address": "fa:16:3e:80:ef:28", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9a0d7-fd", "ovs_interfaceid": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Releasing lock "refresh_cache-f0f4fa14-f586-47f0-a79e-4ee095c9fb39" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.compute.manager [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Instance network_info: |[{"id": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "address": "fa:16:3e:80:ef:28", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9a0d7-fd", "ovs_interfaceid": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-58ff6817-cb64-487e-ac3e-6a3ec8a8d2f2 req-965871d3-243b-4d86-96e1-65d2b9df523c service nova] Acquired lock "refresh_cache-f0f4fa14-f586-47f0-a79e-4ee095c9fb39" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.network.neutron [req-58ff6817-cb64-487e-ac3e-6a3ec8a8d2f2 req-965871d3-243b-4d86-96e1-65d2b9df523c service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Refreshing network info cache for port 6bd9a0d7-fd42-4686-b4a8-af790582008d {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Start _get_guest_xml network_info=[{"id": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "address": "fa:16:3e:80:ef:28", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9a0d7-fd", "ovs_interfaceid": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 09:59:40 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:59:40 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:59:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-727193916',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-727193916',id=33,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPrRDSK3jvDbnQw/5jWArlxh2TAUgBAtuKsNHsVciPvzxhAfuT7d3dBJZcZofN8JgfQLBmHOImdCmqkbGxOEwutBU9f8xpybWUVPbbfi1MZkmOV5UxkGtk3p/ZJL9mGwg==',key_name='tempest-keypair-150707378',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a70b9ea5f3404a5690cd0a73db23f034',ramdisk_id='',reservation_id='r-0e1oe4y4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-939526853',owner_user_name='tempest-AttachVolumeShelveTestJSON-939526853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:59:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8bf8aa8ab2d4105ad0b1fd04247e3a0',uuid=f0f4fa14-f586-47f0-a79e-4ee095c9fb39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "address": "fa:16:3e:80:ef:28", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9a0d7-fd", "ovs_interfaceid": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Converting VIF {"id": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "address": "fa:16:3e:80:ef:28", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9a0d7-fd", "ovs_interfaceid": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:ef:28,bridge_name='br-int',has_traffic_filtering=True,id=6bd9a0d7-fd42-4686-b4a8-af790582008d,network=Network(bbeb1d70-a5dc-46d6-a0dd-240bf3018d31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd9a0d7-fd') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.objects.instance [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lazy-loading 'pci_devices' on Instance uuid f0f4fa14-f586-47f0-a79e-4ee095c9fb39 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] End _get_guest_xml xml=<domain type="kvm">
Oct 16 09:59:40 user nova-compute[74342]:   <uuid>f0f4fa14-f586-47f0-a79e-4ee095c9fb39</uuid>
Oct 16 09:59:40 user nova-compute[74342]:   <name>instance-00000021</name>
Oct 16 09:59:40 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 09:59:40 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 09:59:40 user nova-compute[74342]:   <metadata>
Oct 16 09:59:40 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 09:59:40 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 09:59:40 user nova-compute[74342]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-727193916</nova:name>
Oct 16 09:59:40 user nova-compute[74342]:       <nova:creationTime>2023-10-16 09:59:40</nova:creationTime>
Oct 16 09:59:40 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 09:59:40 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 09:59:40 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 09:59:40 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 09:59:40 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 09:59:40 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 09:59:40 user nova-compute[74342]:       </nova:flavor>
Oct 16 09:59:40 user nova-compute[74342]:       <nova:owner>
Oct 16 09:59:40 user nova-compute[74342]:         <nova:user uuid="c8bf8aa8ab2d4105ad0b1fd04247e3a0">tempest-AttachVolumeShelveTestJSON-939526853-project-member</nova:user>
Oct 16 09:59:40 user nova-compute[74342]:         <nova:project uuid="a70b9ea5f3404a5690cd0a73db23f034">tempest-AttachVolumeShelveTestJSON-939526853</nova:project>
Oct 16 09:59:40 user nova-compute[74342]:       </nova:owner>
Oct 16 09:59:40 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 09:59:40 user nova-compute[74342]:       <nova:ports>
Oct 16 09:59:40 user nova-compute[74342]:         <nova:port uuid="6bd9a0d7-fd42-4686-b4a8-af790582008d">
Oct 16 09:59:40 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 16 09:59:40 user nova-compute[74342]:         </nova:port>
Oct 16 09:59:40 user nova-compute[74342]:       </nova:ports>
Oct 16 09:59:40 user nova-compute[74342]:     </nova:instance>
Oct 16 09:59:40 user nova-compute[74342]:   </metadata>
Oct 16 09:59:40 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 09:59:40 user nova-compute[74342]:     <system>
Oct 16 09:59:40 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 09:59:40 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 09:59:40 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 09:59:40 user nova-compute[74342]:       <entry name="serial">f0f4fa14-f586-47f0-a79e-4ee095c9fb39</entry>
Oct 16 09:59:40 user nova-compute[74342]:       <entry name="uuid">f0f4fa14-f586-47f0-a79e-4ee095c9fb39</entry>
Oct 16 09:59:40 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 09:59:40 user nova-compute[74342]:     </system>
Oct 16 09:59:40 user nova-compute[74342]:   </sysinfo>
Oct 16 09:59:40 user nova-compute[74342]:   <os>
Oct 16 09:59:40 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 09:59:40 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 09:59:40 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 09:59:40 user nova-compute[74342]:   </os>
Oct 16 09:59:40 user nova-compute[74342]:   <features>
Oct 16 09:59:40 user nova-compute[74342]:     <acpi/>
Oct 16 09:59:40 user nova-compute[74342]:     <apic/>
Oct 16 09:59:40 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 09:59:40 user nova-compute[74342]:   </features>
Oct 16 09:59:40 user nova-compute[74342]:   <clock offset="utc">
Oct 16 09:59:40 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 09:59:40 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 09:59:40 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 09:59:40 user nova-compute[74342]:   </clock>
Oct 16 09:59:40 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 09:59:40 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 09:59:40 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 09:59:40 user nova-compute[74342]:   </cpu>
Oct 16 09:59:40 user nova-compute[74342]:   <devices>
Oct 16 09:59:40 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 09:59:40 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 09:59:40 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk"/>
Oct 16 09:59:40 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 09:59:40 user nova-compute[74342]:     </disk>
Oct 16 09:59:40 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 09:59:40 user nova-compute[74342]:       <mac address="fa:16:3e:80:ef:28"/>
Oct 16 09:59:40 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:59:40 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 09:59:40 user nova-compute[74342]:       <target dev="tap6bd9a0d7-fd"/>
Oct 16 09:59:40 user nova-compute[74342]:     </interface>
Oct 16 09:59:40 user nova-compute[74342]:     <serial type="pty">
Oct 16 09:59:40 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/console.log" append="off"/>
Oct 16 09:59:40 user nova-compute[74342]:     </serial>
Oct 16 09:59:40 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 09:59:40 user nova-compute[74342]:     <video>
Oct 16 09:59:40 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 09:59:40 user nova-compute[74342]:     </video>
Oct 16 09:59:40 user nova-compute[74342]:     <rng model="virtio">
Oct 16 09:59:40 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 09:59:40 user nova-compute[74342]:     </rng>
Oct 16 09:59:40 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 09:59:40 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 09:59:40 user nova-compute[74342]:       <stats period="10"/>
Oct 16 09:59:40 user nova-compute[74342]:     </memballoon>
Oct 16 09:59:40 user nova-compute[74342]:   </devices>
Oct 16 09:59:40 user nova-compute[74342]: </domain>
Oct 16 09:59:40 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:59:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-727193916',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-727193916',id=33,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPrRDSK3jvDbnQw/5jWArlxh2TAUgBAtuKsNHsVciPvzxhAfuT7d3dBJZcZofN8JgfQLBmHOImdCmqkbGxOEwutBU9f8xpybWUVPbbfi1MZkmOV5UxkGtk3p/ZJL9mGwg==',key_name='tempest-keypair-150707378',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a70b9ea5f3404a5690cd0a73db23f034',ramdisk_id='',reservation_id='r-0e1oe4y4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-939526853',owner_user_name='tempest-AttachVolumeShelveTestJSON-939526853-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:59:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8bf8aa8ab2d4105ad0b1fd04247e3a0',uuid=f0f4fa14-f586-47f0-a79e-4ee095c9fb39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "address": "fa:16:3e:80:ef:28", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9a0d7-fd", "ovs_interfaceid": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Converting VIF {"id": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "address": "fa:16:3e:80:ef:28", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9a0d7-fd", "ovs_interfaceid": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:ef:28,bridge_name='br-int',has_traffic_filtering=True,id=6bd9a0d7-fd42-4686-b4a8-af790582008d,network=Network(bbeb1d70-a5dc-46d6-a0dd-240bf3018d31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd9a0d7-fd') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG os_vif [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:ef:28,bridge_name='br-int',has_traffic_filtering=True,id=6bd9a0d7-fd42-4686-b4a8-af790582008d,network=Network(bbeb1d70-a5dc-46d6-a0dd-240bf3018d31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd9a0d7-fd') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b086fbd-cb1b-5bef-872c-160fc5cfcd60', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6bd9a0d7-fd, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6bd9a0d7-fd, col_values=(('qos', UUID('11555bdb-6727-441b-bcac-5e4fdd7256ac')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6bd9a0d7-fd, col_values=(('external_ids', {'iface-id': '6bd9a0d7-fd42-4686-b4a8-af790582008d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:ef:28', 'vm-uuid': 'f0f4fa14-f586-47f0-a79e-4ee095c9fb39'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:40 user nova-compute[74342]: INFO os_vif [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:ef:28,bridge_name='br-int',has_traffic_filtering=True,id=6bd9a0d7-fd42-4686-b4a8-af790582008d,network=Network(bbeb1d70-a5dc-46d6-a0dd-240bf3018d31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd9a0d7-fd')
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] No VIF found with MAC fa:16:3e:80:ef:28, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.network.neutron [req-58ff6817-cb64-487e-ac3e-6a3ec8a8d2f2 req-965871d3-243b-4d86-96e1-65d2b9df523c service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Updated VIF entry in instance network info cache for port 6bd9a0d7-fd42-4686-b4a8-af790582008d. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG nova.network.neutron [req-58ff6817-cb64-487e-ac3e-6a3ec8a8d2f2 req-965871d3-243b-4d86-96e1-65d2b9df523c service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Updating instance_info_cache with network_info: [{"id": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "address": "fa:16:3e:80:ef:28", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9a0d7-fd", "ovs_interfaceid": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 09:59:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-58ff6817-cb64-487e-ac3e-6a3ec8a8d2f2 req-965871d3-243b-4d86-96e1-65d2b9df523c service nova] Releasing lock "refresh_cache-f0f4fa14-f586-47f0-a79e-4ee095c9fb39" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 09:59:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:42 user nova-compute[74342]: DEBUG nova.compute.manager [req-3af2e326-3395-4c00-8e53-a135f2db730e req-a0b699a3-0d64-49cd-93fb-b3679065ea92 service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Received event network-vif-plugged-6bd9a0d7-fd42-4686-b4a8-af790582008d {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:59:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-3af2e326-3395-4c00-8e53-a135f2db730e req-a0b699a3-0d64-49cd-93fb-b3679065ea92 service nova] Acquiring lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:59:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-3af2e326-3395-4c00-8e53-a135f2db730e req-a0b699a3-0d64-49cd-93fb-b3679065ea92 service nova] Lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:59:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-3af2e326-3395-4c00-8e53-a135f2db730e req-a0b699a3-0d64-49cd-93fb-b3679065ea92 service nova] Lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:59:42 user nova-compute[74342]: DEBUG nova.compute.manager [req-3af2e326-3395-4c00-8e53-a135f2db730e req-a0b699a3-0d64-49cd-93fb-b3679065ea92 service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] No waiting events found dispatching network-vif-plugged-6bd9a0d7-fd42-4686-b4a8-af790582008d {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:59:42 user nova-compute[74342]: WARNING nova.compute.manager [req-3af2e326-3395-4c00-8e53-a135f2db730e req-a0b699a3-0d64-49cd-93fb-b3679065ea92 service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Received unexpected event network-vif-plugged-6bd9a0d7-fd42-4686-b4a8-af790582008d for instance with vm_state building and task_state spawning.
Oct 16 09:59:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:44 user nova-compute[74342]: DEBUG nova.compute.manager [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 09:59:44 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 09:59:44 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Instance spawned successfully.
Oct 16 09:59:44 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 09:59:44 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:59:44 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:59:44 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:59:44 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:59:44 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:59:44 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 09:59:44 user nova-compute[74342]: INFO nova.compute.manager [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Took 5.53 seconds to spawn the instance on the hypervisor.
Oct 16 09:59:44 user nova-compute[74342]: DEBUG nova.compute.manager [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 09:59:44 user nova-compute[74342]: DEBUG nova.compute.manager [req-2f56d3fc-7140-4ac0-8987-619555dc5f1f req-85f77025-a564-43b4-b78e-3497681f4b2e service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Received event network-vif-plugged-6bd9a0d7-fd42-4686-b4a8-af790582008d {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 09:59:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-2f56d3fc-7140-4ac0-8987-619555dc5f1f req-85f77025-a564-43b4-b78e-3497681f4b2e service nova] Acquiring lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:59:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-2f56d3fc-7140-4ac0-8987-619555dc5f1f req-85f77025-a564-43b4-b78e-3497681f4b2e service nova] Lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:59:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-2f56d3fc-7140-4ac0-8987-619555dc5f1f req-85f77025-a564-43b4-b78e-3497681f4b2e service nova] Lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:59:44 user nova-compute[74342]: DEBUG nova.compute.manager [req-2f56d3fc-7140-4ac0-8987-619555dc5f1f req-85f77025-a564-43b4-b78e-3497681f4b2e service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] No waiting events found dispatching network-vif-plugged-6bd9a0d7-fd42-4686-b4a8-af790582008d {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 09:59:44 user nova-compute[74342]: WARNING nova.compute.manager [req-2f56d3fc-7140-4ac0-8987-619555dc5f1f req-85f77025-a564-43b4-b78e-3497681f4b2e service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Received unexpected event network-vif-plugged-6bd9a0d7-fd42-4686-b4a8-af790582008d for instance with vm_state building and task_state spawning.
Oct 16 09:59:44 user nova-compute[74342]: INFO nova.compute.manager [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Took 6.27 seconds to build instance.
Oct 16 09:59:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-89203a47-0633-42be-93bc-712339c5b133 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.372s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:59:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:55 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:59:55 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:56 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:59:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:59:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:59:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:59:56 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 09:59:56 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:59:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:57 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 09:59:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk --force-share --output=json" returned: 0 in 0.312s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 09:59:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 09:59:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 09:59:59 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:59:59 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 09:59:59 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=7989MB free_disk=25.227249145507812GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 09:59:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 09:59:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 09:59:59 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Applying migration context for instance aa116cab-861b-459d-b1eb-6f07e5d71e30 as it has an incoming, in-progress migration 3a28f569-b70a-4cf0-8e82-243ef43ac167. Migration status is finished {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Oct 16 09:59:59 user nova-compute[74342]: INFO nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Updating resource usage from migration 3a28f569-b70a-4cf0-8e82-243ef43ac167
Oct 16 09:59:59 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 98367a96-22f0-4edb-ab03-a8eb286b437b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:59:59 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 4f3aa905-8eae-45cb-8019-0b991286fe42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:59:59 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance d7607dcc-e70e-42fb-9421-c5f630706241 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:59:59 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Migration 3a28f569-b70a-4cf0-8e82-243ef43ac167 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Oct 16 09:59:59 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance aa116cab-861b-459d-b1eb-6f07e5d71e30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:59:59 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:59:59 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 9dc7115b-8a02-4ef4-9d44-6590c9fded3e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:59:59 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance f0f4fa14-f586-47f0-a79e-4ee095c9fb39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 09:59:59 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 09:59:59 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 09:59:59 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 09:59:59 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 09:59:59 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 09:59:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.406s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 09:59:59 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 09:59:59 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Cleaning up deleted instances {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 09:59:59 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] There are 1 instances to clean {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 09:59:59 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Instance has had 2 of 5 cleanup attempts {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 16 09:59:59 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Deletion of /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd_resize failed
Oct 16 10:00:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:00:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:00:00 user nova-compute[74342]: DEBUG nova.compute.manager [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 10:00:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:00:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:00:00 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 10:00:00 user nova-compute[74342]: INFO nova.compute.claims [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Claim successful on node user
Oct 16 10:00:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:00 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:00:00 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:00:00 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:00:00 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:00:00 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:00:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.420s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:00:00 user nova-compute[74342]: DEBUG nova.compute.manager [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 10:00:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-aa116cab-861b-459d-b1eb-6f07e5d71e30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:00:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-aa116cab-861b-459d-b1eb-6f07e5d71e30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:00:00 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:00:00 user nova-compute[74342]: DEBUG nova.compute.manager [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 10:00:00 user nova-compute[74342]: DEBUG nova.network.neutron [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 10:00:00 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 10:00:00 user nova-compute[74342]: DEBUG nova.compute.manager [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG nova.policy [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ee02f6ad1d9749948f43fb432685d067', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '08329cd0ad7d42a1999ca4f407d93245', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG nova.compute.manager [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 10:00:01 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Creating image(s)
Oct 16 10:00:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "/opt/stack/data/nova/instances/ab64281f-b3fe-47ef-bd5f-796d03aa131f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "/opt/stack/data/nova/instances/ab64281f-b3fe-47ef-bd5f-796d03aa131f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "/opt/stack/data/nova/instances/ab64281f-b3fe-47ef-bd5f-796d03aa131f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.170s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Updating instance_info_cache with network_info: [{"id": "480ecd6b-63b3-43be-8c76-98216f55e06a", "address": "fa:16:3e:5c:87:e5", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480ecd6b-63", "ovs_interfaceid": "480ecd6b-63b3-43be-8c76-98216f55e06a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.192s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/ab64281f-b3fe-47ef-bd5f-796d03aa131f/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-aa116cab-861b-459d-b1eb-6f07e5d71e30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/ab64281f-b3fe-47ef-bd5f-796d03aa131f/disk 1073741824" returned: 0 in 0.055s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.280s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ab64281f-b3fe-47ef-bd5f-796d03aa131f/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab64281f-b3fe-47ef-bd5f-796d03aa131f/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG nova.network.neutron [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Successfully created port: a6ce3a63-d00a-4640-9b69-db6d8da564e6 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab64281f-b3fe-47ef-bd5f-796d03aa131f/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Cannot resize image /opt/stack/data/nova/instances/ab64281f-b3fe-47ef-bd5f-796d03aa131f/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Ensure instance console log exists: /opt/stack/data/nova/instances/ab64281f-b3fe-47ef-bd5f-796d03aa131f/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:00:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:00:02 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:00:02 user nova-compute[74342]: DEBUG nova.network.neutron [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Successfully updated port: a6ce3a63-d00a-4640-9b69-db6d8da564e6 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 10:00:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "refresh_cache-ab64281f-b3fe-47ef-bd5f-796d03aa131f" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:00:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquired lock "refresh_cache-ab64281f-b3fe-47ef-bd5f-796d03aa131f" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:00:02 user nova-compute[74342]: DEBUG nova.network.neutron [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:00:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-5436120e-6939-4a48-872c-b01c266ccd0e req-8a0eace5-70b1-4e6a-9638-b4d09d04a90f service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Received event network-changed-a6ce3a63-d00a-4640-9b69-db6d8da564e6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:00:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-5436120e-6939-4a48-872c-b01c266ccd0e req-8a0eace5-70b1-4e6a-9638-b4d09d04a90f service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Refreshing instance network info cache due to event network-changed-a6ce3a63-d00a-4640-9b69-db6d8da564e6. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:00:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5436120e-6939-4a48-872c-b01c266ccd0e req-8a0eace5-70b1-4e6a-9638-b4d09d04a90f service nova] Acquiring lock "refresh_cache-ab64281f-b3fe-47ef-bd5f-796d03aa131f" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:00:02 user nova-compute[74342]: DEBUG nova.network.neutron [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.network.neutron [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Updating instance_info_cache with network_info: [{"id": "a6ce3a63-d00a-4640-9b69-db6d8da564e6", "address": "fa:16:3e:e7:78:bf", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ce3a63-d0", "ovs_interfaceid": "a6ce3a63-d00a-4640-9b69-db6d8da564e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Releasing lock "refresh_cache-ab64281f-b3fe-47ef-bd5f-796d03aa131f" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.compute.manager [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Instance network_info: |[{"id": "a6ce3a63-d00a-4640-9b69-db6d8da564e6", "address": "fa:16:3e:e7:78:bf", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ce3a63-d0", "ovs_interfaceid": "a6ce3a63-d00a-4640-9b69-db6d8da564e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5436120e-6939-4a48-872c-b01c266ccd0e req-8a0eace5-70b1-4e6a-9638-b4d09d04a90f service nova] Acquired lock "refresh_cache-ab64281f-b3fe-47ef-bd5f-796d03aa131f" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.network.neutron [req-5436120e-6939-4a48-872c-b01c266ccd0e req-8a0eace5-70b1-4e6a-9638-b4d09d04a90f service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Refreshing network info cache for port a6ce3a63-d00a-4640-9b69-db6d8da564e6 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Start _get_guest_xml network_info=[{"id": "a6ce3a63-d00a-4640-9b69-db6d8da564e6", "address": "fa:16:3e:e7:78:bf", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ce3a63-d0", "ovs_interfaceid": "a6ce3a63-d00a-4640-9b69-db6d8da564e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 10:00:03 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:00:03 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:59:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2023456661',display_name='tempest-AttachVolumeNegativeTest-server-2023456661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2023456661',id=34,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqHCTcwaIAP4WBWLs0a6BXyZQbP/BKDm7JFXQwYYrt36OlHQDwjr8IPjYqky0BV3aQfQB9vEhxA8t3wGfiSjC5gd0VoYF5ZL2SBehPKwTvO5HI+85xuc+qarUsiR9hIag==',key_name='tempest-keypair-902064826',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08329cd0ad7d42a1999ca4f407d93245',ramdisk_id='',reservation_id='r-0j2it1j4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-119585701',owner_user_name='tempest-AttachVolumeNegativeTest-119585701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:00:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee02f6ad1d9749948f43fb432685d067',uuid=ab64281f-b3fe-47ef-bd5f-796d03aa131f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6ce3a63-d00a-4640-9b69-db6d8da564e6", "address": "fa:16:3e:e7:78:bf", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ce3a63-d0", "ovs_interfaceid": "a6ce3a63-d00a-4640-9b69-db6d8da564e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Converting VIF {"id": "a6ce3a63-d00a-4640-9b69-db6d8da564e6", "address": "fa:16:3e:e7:78:bf", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ce3a63-d0", "ovs_interfaceid": "a6ce3a63-d00a-4640-9b69-db6d8da564e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:78:bf,bridge_name='br-int',has_traffic_filtering=True,id=a6ce3a63-d00a-4640-9b69-db6d8da564e6,network=Network(023e393d-f8ef-42f1-8879-6259a82218cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6ce3a63-d0') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.objects.instance [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lazy-loading 'pci_devices' on Instance uuid ab64281f-b3fe-47ef-bd5f-796d03aa131f {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] End _get_guest_xml xml=<domain type="kvm">
Oct 16 10:00:03 user nova-compute[74342]:   <uuid>ab64281f-b3fe-47ef-bd5f-796d03aa131f</uuid>
Oct 16 10:00:03 user nova-compute[74342]:   <name>instance-00000022</name>
Oct 16 10:00:03 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 10:00:03 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 10:00:03 user nova-compute[74342]:   <metadata>
Oct 16 10:00:03 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 10:00:03 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 10:00:03 user nova-compute[74342]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2023456661</nova:name>
Oct 16 10:00:03 user nova-compute[74342]:       <nova:creationTime>2023-10-16 10:00:03</nova:creationTime>
Oct 16 10:00:03 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 10:00:03 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 10:00:03 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 10:00:03 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 10:00:03 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 10:00:03 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 10:00:03 user nova-compute[74342]:       </nova:flavor>
Oct 16 10:00:03 user nova-compute[74342]:       <nova:owner>
Oct 16 10:00:03 user nova-compute[74342]:         <nova:user uuid="ee02f6ad1d9749948f43fb432685d067">tempest-AttachVolumeNegativeTest-119585701-project-member</nova:user>
Oct 16 10:00:03 user nova-compute[74342]:         <nova:project uuid="08329cd0ad7d42a1999ca4f407d93245">tempest-AttachVolumeNegativeTest-119585701</nova:project>
Oct 16 10:00:03 user nova-compute[74342]:       </nova:owner>
Oct 16 10:00:03 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 10:00:03 user nova-compute[74342]:       <nova:ports>
Oct 16 10:00:03 user nova-compute[74342]:         <nova:port uuid="a6ce3a63-d00a-4640-9b69-db6d8da564e6">
Oct 16 10:00:03 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 16 10:00:03 user nova-compute[74342]:         </nova:port>
Oct 16 10:00:03 user nova-compute[74342]:       </nova:ports>
Oct 16 10:00:03 user nova-compute[74342]:     </nova:instance>
Oct 16 10:00:03 user nova-compute[74342]:   </metadata>
Oct 16 10:00:03 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 10:00:03 user nova-compute[74342]:     <system>
Oct 16 10:00:03 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 10:00:03 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 10:00:03 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 10:00:03 user nova-compute[74342]:       <entry name="serial">ab64281f-b3fe-47ef-bd5f-796d03aa131f</entry>
Oct 16 10:00:03 user nova-compute[74342]:       <entry name="uuid">ab64281f-b3fe-47ef-bd5f-796d03aa131f</entry>
Oct 16 10:00:03 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 10:00:03 user nova-compute[74342]:     </system>
Oct 16 10:00:03 user nova-compute[74342]:   </sysinfo>
Oct 16 10:00:03 user nova-compute[74342]:   <os>
Oct 16 10:00:03 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 10:00:03 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 10:00:03 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 10:00:03 user nova-compute[74342]:   </os>
Oct 16 10:00:03 user nova-compute[74342]:   <features>
Oct 16 10:00:03 user nova-compute[74342]:     <acpi/>
Oct 16 10:00:03 user nova-compute[74342]:     <apic/>
Oct 16 10:00:03 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 10:00:03 user nova-compute[74342]:   </features>
Oct 16 10:00:03 user nova-compute[74342]:   <clock offset="utc">
Oct 16 10:00:03 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 10:00:03 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 10:00:03 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 10:00:03 user nova-compute[74342]:   </clock>
Oct 16 10:00:03 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 10:00:03 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 10:00:03 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 10:00:03 user nova-compute[74342]:   </cpu>
Oct 16 10:00:03 user nova-compute[74342]:   <devices>
Oct 16 10:00:03 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 10:00:03 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 10:00:03 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/ab64281f-b3fe-47ef-bd5f-796d03aa131f/disk"/>
Oct 16 10:00:03 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 10:00:03 user nova-compute[74342]:     </disk>
Oct 16 10:00:03 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 10:00:03 user nova-compute[74342]:       <mac address="fa:16:3e:e7:78:bf"/>
Oct 16 10:00:03 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:00:03 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 10:00:03 user nova-compute[74342]:       <target dev="tapa6ce3a63-d0"/>
Oct 16 10:00:03 user nova-compute[74342]:     </interface>
Oct 16 10:00:03 user nova-compute[74342]:     <serial type="pty">
Oct 16 10:00:03 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/ab64281f-b3fe-47ef-bd5f-796d03aa131f/console.log" append="off"/>
Oct 16 10:00:03 user nova-compute[74342]:     </serial>
Oct 16 10:00:03 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 10:00:03 user nova-compute[74342]:     <video>
Oct 16 10:00:03 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:00:03 user nova-compute[74342]:     </video>
Oct 16 10:00:03 user nova-compute[74342]:     <rng model="virtio">
Oct 16 10:00:03 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 10:00:03 user nova-compute[74342]:     </rng>
Oct 16 10:00:03 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 10:00:03 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 10:00:03 user nova-compute[74342]:       <stats period="10"/>
Oct 16 10:00:03 user nova-compute[74342]:     </memballoon>
Oct 16 10:00:03 user nova-compute[74342]:   </devices>
Oct 16 10:00:03 user nova-compute[74342]: </domain>
Oct 16 10:00:03 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:59:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2023456661',display_name='tempest-AttachVolumeNegativeTest-server-2023456661',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2023456661',id=34,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqHCTcwaIAP4WBWLs0a6BXyZQbP/BKDm7JFXQwYYrt36OlHQDwjr8IPjYqky0BV3aQfQB9vEhxA8t3wGfiSjC5gd0VoYF5ZL2SBehPKwTvO5HI+85xuc+qarUsiR9hIag==',key_name='tempest-keypair-902064826',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='08329cd0ad7d42a1999ca4f407d93245',ramdisk_id='',reservation_id='r-0j2it1j4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-119585701',owner_user_name='tempest-AttachVolumeNegativeTest-119585701-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:00:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee02f6ad1d9749948f43fb432685d067',uuid=ab64281f-b3fe-47ef-bd5f-796d03aa131f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a6ce3a63-d00a-4640-9b69-db6d8da564e6", "address": "fa:16:3e:e7:78:bf", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ce3a63-d0", "ovs_interfaceid": "a6ce3a63-d00a-4640-9b69-db6d8da564e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Converting VIF {"id": "a6ce3a63-d00a-4640-9b69-db6d8da564e6", "address": "fa:16:3e:e7:78:bf", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ce3a63-d0", "ovs_interfaceid": "a6ce3a63-d00a-4640-9b69-db6d8da564e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:78:bf,bridge_name='br-int',has_traffic_filtering=True,id=a6ce3a63-d00a-4640-9b69-db6d8da564e6,network=Network(023e393d-f8ef-42f1-8879-6259a82218cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6ce3a63-d0') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG os_vif [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:78:bf,bridge_name='br-int',has_traffic_filtering=True,id=a6ce3a63-d00a-4640-9b69-db6d8da564e6,network=Network(023e393d-f8ef-42f1-8879-6259a82218cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6ce3a63-d0') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd073e433-203a-5888-8c54-26cae82384ff', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa6ce3a63-d0, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa6ce3a63-d0, col_values=(('qos', UUID('208783d6-f786-4c48-be3a-13fefb4ca24d')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa6ce3a63-d0, col_values=(('external_ids', {'iface-id': 'a6ce3a63-d00a-4640-9b69-db6d8da564e6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:78:bf', 'vm-uuid': 'ab64281f-b3fe-47ef-bd5f-796d03aa131f'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:03 user nova-compute[74342]: INFO os_vif [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:78:bf,bridge_name='br-int',has_traffic_filtering=True,id=a6ce3a63-d00a-4640-9b69-db6d8da564e6,network=Network(023e393d-f8ef-42f1-8879-6259a82218cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6ce3a63-d0')
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] No VIF found with MAC fa:16:3e:e7:78:bf, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.network.neutron [req-5436120e-6939-4a48-872c-b01c266ccd0e req-8a0eace5-70b1-4e6a-9638-b4d09d04a90f service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Updated VIF entry in instance network info cache for port a6ce3a63-d00a-4640-9b69-db6d8da564e6. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG nova.network.neutron [req-5436120e-6939-4a48-872c-b01c266ccd0e req-8a0eace5-70b1-4e6a-9638-b4d09d04a90f service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Updating instance_info_cache with network_info: [{"id": "a6ce3a63-d00a-4640-9b69-db6d8da564e6", "address": "fa:16:3e:e7:78:bf", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ce3a63-d0", "ovs_interfaceid": "a6ce3a63-d00a-4640-9b69-db6d8da564e6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:00:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5436120e-6939-4a48-872c-b01c266ccd0e req-8a0eace5-70b1-4e6a-9638-b4d09d04a90f service nova] Releasing lock "refresh_cache-ab64281f-b3fe-47ef-bd5f-796d03aa131f" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:00:04 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:00:04 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:00:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:04 user nova-compute[74342]: DEBUG nova.compute.manager [req-01d70e65-d9df-4f79-a6e2-cf3cc53053b1 req-53f4a1f7-01da-4553-a797-096cc3424e7a service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Received event network-vif-plugged-a6ce3a63-d00a-4640-9b69-db6d8da564e6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:00:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-01d70e65-d9df-4f79-a6e2-cf3cc53053b1 req-53f4a1f7-01da-4553-a797-096cc3424e7a service nova] Acquiring lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:00:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-01d70e65-d9df-4f79-a6e2-cf3cc53053b1 req-53f4a1f7-01da-4553-a797-096cc3424e7a service nova] Lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:00:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-01d70e65-d9df-4f79-a6e2-cf3cc53053b1 req-53f4a1f7-01da-4553-a797-096cc3424e7a service nova] Lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:00:04 user nova-compute[74342]: DEBUG nova.compute.manager [req-01d70e65-d9df-4f79-a6e2-cf3cc53053b1 req-53f4a1f7-01da-4553-a797-096cc3424e7a service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] No waiting events found dispatching network-vif-plugged-a6ce3a63-d00a-4640-9b69-db6d8da564e6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:00:04 user nova-compute[74342]: WARNING nova.compute.manager [req-01d70e65-d9df-4f79-a6e2-cf3cc53053b1 req-53f4a1f7-01da-4553-a797-096cc3424e7a service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Received unexpected event network-vif-plugged-a6ce3a63-d00a-4640-9b69-db6d8da564e6 for instance with vm_state building and task_state spawning.
Oct 16 10:00:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:05 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:00:05 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:00:06 user nova-compute[74342]: DEBUG nova.compute.manager [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 10:00:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 10:00:06 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Instance spawned successfully.
Oct 16 10:00:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 10:00:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:00:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:00:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:00:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:00:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:00:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:00:06 user nova-compute[74342]: DEBUG nova.compute.manager [req-0f2c1d6d-e3dd-4549-a67f-2f4576b1ea4b req-e7cf23d6-4c19-4611-aee0-6fa23064d2fb service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Received event network-vif-plugged-a6ce3a63-d00a-4640-9b69-db6d8da564e6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:00:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0f2c1d6d-e3dd-4549-a67f-2f4576b1ea4b req-e7cf23d6-4c19-4611-aee0-6fa23064d2fb service nova] Acquiring lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:00:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0f2c1d6d-e3dd-4549-a67f-2f4576b1ea4b req-e7cf23d6-4c19-4611-aee0-6fa23064d2fb service nova] Lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:00:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0f2c1d6d-e3dd-4549-a67f-2f4576b1ea4b req-e7cf23d6-4c19-4611-aee0-6fa23064d2fb service nova] Lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:00:06 user nova-compute[74342]: DEBUG nova.compute.manager [req-0f2c1d6d-e3dd-4549-a67f-2f4576b1ea4b req-e7cf23d6-4c19-4611-aee0-6fa23064d2fb service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] No waiting events found dispatching network-vif-plugged-a6ce3a63-d00a-4640-9b69-db6d8da564e6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:00:06 user nova-compute[74342]: WARNING nova.compute.manager [req-0f2c1d6d-e3dd-4549-a67f-2f4576b1ea4b req-e7cf23d6-4c19-4611-aee0-6fa23064d2fb service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Received unexpected event network-vif-plugged-a6ce3a63-d00a-4640-9b69-db6d8da564e6 for instance with vm_state building and task_state spawning.
Oct 16 10:00:07 user nova-compute[74342]: INFO nova.compute.manager [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Took 5.99 seconds to spawn the instance on the hypervisor.
Oct 16 10:00:07 user nova-compute[74342]: DEBUG nova.compute.manager [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:00:07 user nova-compute[74342]: INFO nova.compute.manager [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Took 6.78 seconds to build instance.
Oct 16 10:00:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-26de4878-0bce-474f-941c-00f4b4cc54bb tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.879s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:00:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:08 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:00:11 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:00:11 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74342) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 10:00:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:00:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:00:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:00:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:00:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d2fa9235-f568-4c7d-ab8a-68ed7515e3aa tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "aa116cab-861b-459d-b1eb-6f07e5d71e30" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:00:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d2fa9235-f568-4c7d-ab8a-68ed7515e3aa tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "aa116cab-861b-459d-b1eb-6f07e5d71e30" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:00:21 user nova-compute[74342]: DEBUG nova.compute.manager [None req-d2fa9235-f568-4c7d-ab8a-68ed7515e3aa tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Going to confirm migration 2 {{(pid=74342) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4773}}
Oct 16 10:00:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d2fa9235-f568-4c7d-ab8a-68ed7515e3aa tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "refresh_cache-aa116cab-861b-459d-b1eb-6f07e5d71e30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:00:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d2fa9235-f568-4c7d-ab8a-68ed7515e3aa tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquired lock "refresh_cache-aa116cab-861b-459d-b1eb-6f07e5d71e30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:00:21 user nova-compute[74342]: DEBUG nova.network.neutron [None req-d2fa9235-f568-4c7d-ab8a-68ed7515e3aa tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:00:21 user nova-compute[74342]: DEBUG nova.objects.instance [None req-d2fa9235-f568-4c7d-ab8a-68ed7515e3aa tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lazy-loading 'info_cache' on Instance uuid aa116cab-861b-459d-b1eb-6f07e5d71e30 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:00:22 user nova-compute[74342]: DEBUG nova.network.neutron [None req-d2fa9235-f568-4c7d-ab8a-68ed7515e3aa tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Updating instance_info_cache with network_info: [{"id": "480ecd6b-63b3-43be-8c76-98216f55e06a", "address": "fa:16:3e:5c:87:e5", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480ecd6b-63", "ovs_interfaceid": "480ecd6b-63b3-43be-8c76-98216f55e06a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:00:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d2fa9235-f568-4c7d-ab8a-68ed7515e3aa tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Releasing lock "refresh_cache-aa116cab-861b-459d-b1eb-6f07e5d71e30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:00:22 user nova-compute[74342]: DEBUG nova.objects.instance [None req-d2fa9235-f568-4c7d-ab8a-68ed7515e3aa tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lazy-loading 'migration_context' on Instance uuid aa116cab-861b-459d-b1eb-6f07e5d71e30 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:00:22 user nova-compute[74342]: DEBUG nova.objects.base [None req-d2fa9235-f568-4c7d-ab8a-68ed7515e3aa tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Object Instance<aa116cab-861b-459d-b1eb-6f07e5d71e30> lazy-loaded attributes: info_cache,migration_context {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:00:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d2fa9235-f568-4c7d-ab8a-68ed7515e3aa tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:00:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d2fa9235-f568-4c7d-ab8a-68ed7515e3aa tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:00:22 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-d2fa9235-f568-4c7d-ab8a-68ed7515e3aa tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:00:22 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-d2fa9235-f568-4c7d-ab8a-68ed7515e3aa tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:00:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d2fa9235-f568-4c7d-ab8a-68ed7515e3aa tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.330s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:00:22 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-d2fa9235-f568-4c7d-ab8a-68ed7515e3aa tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Deleted allocation for migration 3a28f569-b70a-4cf0-8e82-243ef43ac167
Oct 16 10:00:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d2fa9235-f568-4c7d-ab8a-68ed7515e3aa tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "aa116cab-861b-459d-b1eb-6f07e5d71e30" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.369s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:00:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Triggering sync for uuid 98367a96-22f0-4edb-ab03-a8eb286b437b {{(pid=74342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Triggering sync for uuid 4f3aa905-8eae-45cb-8019-0b991286fe42 {{(pid=74342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Triggering sync for uuid aa116cab-861b-459d-b1eb-6f07e5d71e30 {{(pid=74342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Triggering sync for uuid d7607dcc-e70e-42fb-9421-c5f630706241 {{(pid=74342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Triggering sync for uuid e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8 {{(pid=74342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Triggering sync for uuid 9dc7115b-8a02-4ef4-9d44-6590c9fded3e {{(pid=74342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Triggering sync for uuid f0f4fa14-f586-47f0-a79e-4ee095c9fb39 {{(pid=74342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Triggering sync for uuid ab64281f-b3fe-47ef-bd5f-796d03aa131f {{(pid=74342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "98367a96-22f0-4edb-ab03-a8eb286b437b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "98367a96-22f0-4edb-ab03-a8eb286b437b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "4f3aa905-8eae-45cb-8019-0b991286fe42" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "aa116cab-861b-459d-b1eb-6f07e5d71e30" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "aa116cab-861b-459d-b1eb-6f07e5d71e30" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "d7607dcc-e70e-42fb-9421-c5f630706241" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "d7607dcc-e70e-42fb-9421-c5f630706241" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "9dc7115b-8a02-4ef4-9d44-6590c9fded3e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "9dc7115b-8a02-4ef4-9d44-6590c9fded3e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "98367a96-22f0-4edb-ab03-a8eb286b437b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "d7607dcc-e70e-42fb-9421-c5f630706241" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.057s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "aa116cab-861b-459d-b1eb-6f07e5d71e30" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.103s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:00:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "9dc7115b-8a02-4ef4-9d44-6590c9fded3e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.104s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:00:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:00:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5009 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:00:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:00:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:00:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Acquiring lock "575ff5fb-6cd7-4e84-b6de-c971129c7935" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:00:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "575ff5fb-6cd7-4e84-b6de-c971129c7935" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:00:43 user nova-compute[74342]: INFO nova.compute.manager [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Unshelving
Oct 16 10:00:43 user nova-compute[74342]: INFO nova.virt.block_device [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Booting with volume 85fe9beb-cfb8-452d-8f97-249915dd854f at /dev/vda
Oct 16 10:00:43 user nova-compute[74342]: DEBUG os_brick.utils [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:00:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:00:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:00:43 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[552238ad-05f8-4feb-8f2c-133b65ee06b8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:00:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:00:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:00:43 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[611e22dc-8d23-4f18-a893-3eef5ff00629]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:00:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:00:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:00:43 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d3a56dc-7fee-47a7-b510-bb4ed4a724cb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:00:43 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa1bd0f-a419-490c-8948-d49d29462245]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:00:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:00:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:00:43 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 10:00:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:00:43 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:00:43 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 10:00:43 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ac972a-b261-4dff-beaf-d1939cf3e12d]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:00:43 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 10:00:43 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 10:00:43 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 10:00:43 user nova-compute[74342]: DEBUG os_brick.utils [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:00:43 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Updating existing volume attachment record: 10e15455-ad74-4690-a4d7-64d92471b3cb {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 10:00:47 user nova-compute[74342]: DEBUG nova.objects.instance [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'flavor' on Instance uuid 4f3aa905-8eae-45cb-8019-0b991286fe42 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:00:47 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "refresh_cache-4f3aa905-8eae-45cb-8019-0b991286fe42" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:00:47 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquired lock "refresh_cache-4f3aa905-8eae-45cb-8019-0b991286fe42" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:00:47 user nova-compute[74342]: DEBUG nova.network.neutron [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:00:47 user nova-compute[74342]: DEBUG nova.objects.instance [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'info_cache' on Instance uuid 4f3aa905-8eae-45cb-8019-0b991286fe42 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:00:47 user nova-compute[74342]: DEBUG nova.objects.base [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Object Instance<4f3aa905-8eae-45cb-8019-0b991286fe42> lazy-loaded attributes: flavor,info_cache {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.network.neutron [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Updating instance_info_cache with network_info: [{"id": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "address": "fa:16:3e:82:00:ac", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4258aa-96", "ovs_interfaceid": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Releasing lock "refresh_cache-4f3aa905-8eae-45cb-8019-0b991286fe42" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:00:48 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Instance destroyed successfully.
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.objects.instance [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'resources' on Instance uuid 4f3aa905-8eae-45cb-8019-0b991286fe42 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.objects.base [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Object Instance<4f3aa905-8eae-45cb-8019-0b991286fe42> lazy-loaded attributes: flavor,info_cache,resources {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1589424972',display_name='tempest-AttachVolumeTestJSON-server-1589424972',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1589424972',id=24,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBO8M7UyZeyQg1aYm+ByuTDEoeaBTTsQAFljuagcRlcGDhfx2FLzwqTOwmYqO1+0IHWLuSXoneV6tc1mCRPSiL9W+Jq0YYyfdyDE26TRgq7GChyXwYOsK9694M/+yJ6Kw==',key_name='tempest-keypair-1616245480',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:52:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c28511c6c42147db9a0992cf40e044bb',ramdisk_id='',reservation_id='r-tipl03lh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-965713551',owner_user_name='tempest-AttachVolumeTestJSON-965713551-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:58:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc0dfbfdb77347cda95ba991d37c311d',uuid=4f3aa905-8eae-45cb-8019-0b991286fe42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "address": "fa:16:3e:82:00:ac", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4258aa-96", "ovs_interfaceid": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Converting VIF {"id": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "address": "fa:16:3e:82:00:ac", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4258aa-96", "ovs_interfaceid": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:00:ac,bridge_name='br-int',has_traffic_filtering=True,id=0e4258aa-9686-4cf1-9d1a-5bf61e7ba193,network=Network(54ba0b2e-1a1f-44a4-ba26-8a96960d4165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e4258aa-96') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG os_vif [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:00:ac,bridge_name='br-int',has_traffic_filtering=True,id=0e4258aa-9686-4cf1-9d1a-5bf61e7ba193,network=Network(54ba0b2e-1a1f-44a4-ba26-8a96960d4165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e4258aa-96') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e4258aa-96, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=21daed4c-a474-4155-97fa-07d0d95a103b) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:48 user nova-compute[74342]: INFO os_vif [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:00:ac,bridge_name='br-int',has_traffic_filtering=True,id=0e4258aa-9686-4cf1-9d1a-5bf61e7ba193,network=Network(54ba0b2e-1a1f-44a4-ba26-8a96960d4165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e4258aa-96')
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Start _get_guest_xml network_info=[{"id": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "address": "fa:16:3e:82:00:ac", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4258aa-96", "ovs_interfaceid": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.objects.instance [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'numa_topology' on Instance uuid 4f3aa905-8eae-45cb-8019-0b991286fe42 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.objects.base [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Object Instance<4f3aa905-8eae-45cb-8019-0b991286fe42> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:00:48 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:00:48 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.objects.instance [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4f3aa905-8eae-45cb-8019-0b991286fe42 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.objects.base [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Object Instance<4f3aa905-8eae-45cb-8019-0b991286fe42> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1589424972',display_name='tempest-AttachVolumeTestJSON-server-1589424972',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1589424972',id=24,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBO8M7UyZeyQg1aYm+ByuTDEoeaBTTsQAFljuagcRlcGDhfx2FLzwqTOwmYqO1+0IHWLuSXoneV6tc1mCRPSiL9W+Jq0YYyfdyDE26TRgq7GChyXwYOsK9694M/+yJ6Kw==',key_name='tempest-keypair-1616245480',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:52:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='c28511c6c42147db9a0992cf40e044bb',ramdisk_id='',reservation_id='r-tipl03lh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-965713551',owner_user_name='tempest-AttachVolumeTestJSON-965713551-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:58:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc0dfbfdb77347cda95ba991d37c311d',uuid=4f3aa905-8eae-45cb-8019-0b991286fe42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "address": "fa:16:3e:82:00:ac", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4258aa-96", "ovs_interfaceid": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Converting VIF {"id": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "address": "fa:16:3e:82:00:ac", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4258aa-96", "ovs_interfaceid": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:00:ac,bridge_name='br-int',has_traffic_filtering=True,id=0e4258aa-9686-4cf1-9d1a-5bf61e7ba193,network=Network(54ba0b2e-1a1f-44a4-ba26-8a96960d4165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e4258aa-96') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.objects.instance [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'pci_devices' on Instance uuid 4f3aa905-8eae-45cb-8019-0b991286fe42 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.objects.base [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Object Instance<4f3aa905-8eae-45cb-8019-0b991286fe42> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] End _get_guest_xml xml=<domain type="kvm">
Oct 16 10:00:48 user nova-compute[74342]:   <uuid>4f3aa905-8eae-45cb-8019-0b991286fe42</uuid>
Oct 16 10:00:48 user nova-compute[74342]:   <name>instance-00000018</name>
Oct 16 10:00:48 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 10:00:48 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 10:00:48 user nova-compute[74342]:   <metadata>
Oct 16 10:00:48 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 10:00:48 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 10:00:48 user nova-compute[74342]:       <nova:name>tempest-AttachVolumeTestJSON-server-1589424972</nova:name>
Oct 16 10:00:48 user nova-compute[74342]:       <nova:creationTime>2023-10-16 10:00:48</nova:creationTime>
Oct 16 10:00:48 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 10:00:48 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 10:00:48 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 10:00:48 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 10:00:48 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 10:00:48 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 10:00:48 user nova-compute[74342]:       </nova:flavor>
Oct 16 10:00:48 user nova-compute[74342]:       <nova:owner>
Oct 16 10:00:48 user nova-compute[74342]:         <nova:user uuid="bc0dfbfdb77347cda95ba991d37c311d">tempest-AttachVolumeTestJSON-965713551-project-member</nova:user>
Oct 16 10:00:48 user nova-compute[74342]:         <nova:project uuid="c28511c6c42147db9a0992cf40e044bb">tempest-AttachVolumeTestJSON-965713551</nova:project>
Oct 16 10:00:48 user nova-compute[74342]:       </nova:owner>
Oct 16 10:00:48 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 10:00:48 user nova-compute[74342]:       <nova:ports>
Oct 16 10:00:48 user nova-compute[74342]:         <nova:port uuid="0e4258aa-9686-4cf1-9d1a-5bf61e7ba193">
Oct 16 10:00:48 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 16 10:00:48 user nova-compute[74342]:         </nova:port>
Oct 16 10:00:48 user nova-compute[74342]:       </nova:ports>
Oct 16 10:00:48 user nova-compute[74342]:     </nova:instance>
Oct 16 10:00:48 user nova-compute[74342]:   </metadata>
Oct 16 10:00:48 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 10:00:48 user nova-compute[74342]:     <system>
Oct 16 10:00:48 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 10:00:48 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 10:00:48 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 10:00:48 user nova-compute[74342]:       <entry name="serial">4f3aa905-8eae-45cb-8019-0b991286fe42</entry>
Oct 16 10:00:48 user nova-compute[74342]:       <entry name="uuid">4f3aa905-8eae-45cb-8019-0b991286fe42</entry>
Oct 16 10:00:48 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 10:00:48 user nova-compute[74342]:     </system>
Oct 16 10:00:48 user nova-compute[74342]:   </sysinfo>
Oct 16 10:00:48 user nova-compute[74342]:   <os>
Oct 16 10:00:48 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 10:00:48 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 10:00:48 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 10:00:48 user nova-compute[74342]:   </os>
Oct 16 10:00:48 user nova-compute[74342]:   <features>
Oct 16 10:00:48 user nova-compute[74342]:     <acpi/>
Oct 16 10:00:48 user nova-compute[74342]:     <apic/>
Oct 16 10:00:48 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 10:00:48 user nova-compute[74342]:   </features>
Oct 16 10:00:48 user nova-compute[74342]:   <clock offset="utc">
Oct 16 10:00:48 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 10:00:48 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 10:00:48 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 10:00:48 user nova-compute[74342]:   </clock>
Oct 16 10:00:48 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 10:00:48 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 10:00:48 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 10:00:48 user nova-compute[74342]:   </cpu>
Oct 16 10:00:48 user nova-compute[74342]:   <devices>
Oct 16 10:00:48 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 10:00:48 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 10:00:48 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk"/>
Oct 16 10:00:48 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 10:00:48 user nova-compute[74342]:     </disk>
Oct 16 10:00:48 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 10:00:48 user nova-compute[74342]:       <mac address="fa:16:3e:82:00:ac"/>
Oct 16 10:00:48 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:00:48 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 10:00:48 user nova-compute[74342]:       <target dev="tap0e4258aa-96"/>
Oct 16 10:00:48 user nova-compute[74342]:     </interface>
Oct 16 10:00:48 user nova-compute[74342]:     <serial type="pty">
Oct 16 10:00:48 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/console.log" append="off"/>
Oct 16 10:00:48 user nova-compute[74342]:     </serial>
Oct 16 10:00:48 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 10:00:48 user nova-compute[74342]:     <video>
Oct 16 10:00:48 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:00:48 user nova-compute[74342]:     </video>
Oct 16 10:00:48 user nova-compute[74342]:     <rng model="virtio">
Oct 16 10:00:48 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 10:00:48 user nova-compute[74342]:     </rng>
Oct 16 10:00:48 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 10:00:48 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 10:00:48 user nova-compute[74342]:       <stats period="10"/>
Oct 16 10:00:48 user nova-compute[74342]:     </memballoon>
Oct 16 10:00:48 user nova-compute[74342]:   </devices>
Oct 16 10:00:48 user nova-compute[74342]: </domain>
Oct 16 10:00:48 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.objects.instance [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4f3aa905-8eae-45cb-8019-0b991286fe42 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG nova.objects.base [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Object Instance<4f3aa905-8eae-45cb-8019-0b991286fe42> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:00:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:00:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.169s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:00:49 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 10:00:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:00:49 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:00:49 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Cannot resize image /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 10:00:49 user nova-compute[74342]: DEBUG nova.objects.instance [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'migration_context' on Instance uuid 4f3aa905-8eae-45cb-8019-0b991286fe42 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:00:49 user nova-compute[74342]: DEBUG nova.objects.base [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Object Instance<4f3aa905-8eae-45cb-8019-0b991286fe42> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:00:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1589424972',display_name='tempest-AttachVolumeTestJSON-server-1589424972',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1589424972',id=24,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBO8M7UyZeyQg1aYm+ByuTDEoeaBTTsQAFljuagcRlcGDhfx2FLzwqTOwmYqO1+0IHWLuSXoneV6tc1mCRPSiL9W+Jq0YYyfdyDE26TRgq7GChyXwYOsK9694M/+yJ6Kw==',key_name='tempest-keypair-1616245480',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:52:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='c28511c6c42147db9a0992cf40e044bb',ramdisk_id='',reservation_id='r-tipl03lh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-965713551',owner_user_name='tempest-AttachVolumeTestJSON-965713551-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T09:58:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc0dfbfdb77347cda95ba991d37c311d',uuid=4f3aa905-8eae-45cb-8019-0b991286fe42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "address": "fa:16:3e:82:00:ac", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4258aa-96", "ovs_interfaceid": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 10:00:49 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Converting VIF {"id": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "address": "fa:16:3e:82:00:ac", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4258aa-96", "ovs_interfaceid": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:00:49 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:00:ac,bridge_name='br-int',has_traffic_filtering=True,id=0e4258aa-9686-4cf1-9d1a-5bf61e7ba193,network=Network(54ba0b2e-1a1f-44a4-ba26-8a96960d4165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e4258aa-96') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:00:49 user nova-compute[74342]: DEBUG os_vif [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:00:ac,bridge_name='br-int',has_traffic_filtering=True,id=0e4258aa-9686-4cf1-9d1a-5bf61e7ba193,network=Network(54ba0b2e-1a1f-44a4-ba26-8a96960d4165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e4258aa-96') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 10:00:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:00:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 10:00:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5f6e4084-f495-51ae-9896-e97b4ee7087d', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:00:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:00:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0e4258aa-96, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:00:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0e4258aa-96, col_values=(('qos', UUID('0a6e906b-83bf-494d-b3b8-a5f6d300a828')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:00:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0e4258aa-96, col_values=(('external_ids', {'iface-id': '0e4258aa-9686-4cf1-9d1a-5bf61e7ba193', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:00:ac', 'vm-uuid': '4f3aa905-8eae-45cb-8019-0b991286fe42'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:00:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:00:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:49 user nova-compute[74342]: INFO os_vif [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:00:ac,bridge_name='br-int',has_traffic_filtering=True,id=0e4258aa-9686-4cf1-9d1a-5bf61e7ba193,network=Network(54ba0b2e-1a1f-44a4-ba26-8a96960d4165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e4258aa-96')
Oct 16 10:00:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:50 user nova-compute[74342]: DEBUG nova.compute.manager [req-995ce4aa-9693-480f-9382-89e3448009bd req-7515b60e-3b38-46cd-9185-d7972514b545 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Received event network-vif-plugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:00:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-995ce4aa-9693-480f-9382-89e3448009bd req-7515b60e-3b38-46cd-9185-d7972514b545 service nova] Acquiring lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:00:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-995ce4aa-9693-480f-9382-89e3448009bd req-7515b60e-3b38-46cd-9185-d7972514b545 service nova] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:00:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-995ce4aa-9693-480f-9382-89e3448009bd req-7515b60e-3b38-46cd-9185-d7972514b545 service nova] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:00:50 user nova-compute[74342]: DEBUG nova.compute.manager [req-995ce4aa-9693-480f-9382-89e3448009bd req-7515b60e-3b38-46cd-9185-d7972514b545 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] No waiting events found dispatching network-vif-plugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:00:50 user nova-compute[74342]: WARNING nova.compute.manager [req-995ce4aa-9693-480f-9382-89e3448009bd req-7515b60e-3b38-46cd-9185-d7972514b545 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Received unexpected event network-vif-plugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 for instance with vm_state stopped and task_state powering-on.
Oct 16 10:00:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ce510c96-f7bc-4036-a3a2-0b1a56fcb575 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Acquiring lock "e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:00:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ce510c96-f7bc-4036-a3a2-0b1a56fcb575 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:00:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ce510c96-f7bc-4036-a3a2-0b1a56fcb575 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Acquiring lock "e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:00:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ce510c96-f7bc-4036-a3a2-0b1a56fcb575 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:00:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ce510c96-f7bc-4036-a3a2-0b1a56fcb575 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:00:51 user nova-compute[74342]: INFO nova.compute.manager [None req-ce510c96-f7bc-4036-a3a2-0b1a56fcb575 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Terminating instance
Oct 16 10:00:51 user nova-compute[74342]: DEBUG nova.compute.manager [None req-ce510c96-f7bc-4036-a3a2-0b1a56fcb575 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 10:00:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:51 user nova-compute[74342]: DEBUG nova.compute.manager [req-11be5d4a-6c5c-443d-bb2a-d8de0b2a0846 req-aa755167-619f-46b9-88a0-eaf4a3189812 service nova] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Received event network-vif-unplugged-1c9f1265-73b2-4072-b664-f994d0c17646 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:00:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-11be5d4a-6c5c-443d-bb2a-d8de0b2a0846 req-aa755167-619f-46b9-88a0-eaf4a3189812 service nova] Acquiring lock "e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:00:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-11be5d4a-6c5c-443d-bb2a-d8de0b2a0846 req-aa755167-619f-46b9-88a0-eaf4a3189812 service nova] Lock "e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:00:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-11be5d4a-6c5c-443d-bb2a-d8de0b2a0846 req-aa755167-619f-46b9-88a0-eaf4a3189812 service nova] Lock "e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:00:51 user nova-compute[74342]: DEBUG nova.compute.manager [req-11be5d4a-6c5c-443d-bb2a-d8de0b2a0846 req-aa755167-619f-46b9-88a0-eaf4a3189812 service nova] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] No waiting events found dispatching network-vif-unplugged-1c9f1265-73b2-4072-b664-f994d0c17646 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:00:51 user nova-compute[74342]: DEBUG nova.compute.manager [req-11be5d4a-6c5c-443d-bb2a-d8de0b2a0846 req-aa755167-619f-46b9-88a0-eaf4a3189812 service nova] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Received event network-vif-unplugged-1c9f1265-73b2-4072-b664-f994d0c17646 for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 10:00:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:51 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Instance destroyed successfully.
Oct 16 10:00:51 user nova-compute[74342]: DEBUG nova.objects.instance [None req-ce510c96-f7bc-4036-a3a2-0b1a56fcb575 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lazy-loading 'resources' on Instance uuid e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:00:51 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-ce510c96-f7bc-4036-a3a2-0b1a56fcb575 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:59:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1001651707',display_name='tempest-ServersNegativeTestJSON-server-1001651707',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1001651707',id=31,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:59:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8a3c19c78264cc7a4083e20cf4598ec',ramdisk_id='',reservation_id='r-3iqt39vm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2110827578',owner_user_name='tempest-ServersNegativeTestJSON-2110827578-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:59:10Z,user_data=None,user_id='21ee41cd47eb4493ac26a4199e8b5902',uuid=e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1c9f1265-73b2-4072-b664-f994d0c17646", "address": "fa:16:3e:83:8e:bb", "network": {"id": "19a96357-4b1f-4da6-a8f4-795a37500116", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1856971527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8a3c19c78264cc7a4083e20cf4598ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c9f1265-73", "ovs_interfaceid": "1c9f1265-73b2-4072-b664-f994d0c17646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 10:00:51 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-ce510c96-f7bc-4036-a3a2-0b1a56fcb575 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Converting VIF {"id": "1c9f1265-73b2-4072-b664-f994d0c17646", "address": "fa:16:3e:83:8e:bb", "network": {"id": "19a96357-4b1f-4da6-a8f4-795a37500116", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1856971527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8a3c19c78264cc7a4083e20cf4598ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1c9f1265-73", "ovs_interfaceid": "1c9f1265-73b2-4072-b664-f994d0c17646", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:00:51 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-ce510c96-f7bc-4036-a3a2-0b1a56fcb575 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:83:8e:bb,bridge_name='br-int',has_traffic_filtering=True,id=1c9f1265-73b2-4072-b664-f994d0c17646,network=Network(19a96357-4b1f-4da6-a8f4-795a37500116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c9f1265-73') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:00:51 user nova-compute[74342]: DEBUG os_vif [None req-ce510c96-f7bc-4036-a3a2-0b1a56fcb575 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:8e:bb,bridge_name='br-int',has_traffic_filtering=True,id=1c9f1265-73b2-4072-b664-f994d0c17646,network=Network(19a96357-4b1f-4da6-a8f4-795a37500116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c9f1265-73') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 10:00:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1c9f1265-73, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:00:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8a59b568-e945-437e-b76c-b9f8f401a73f) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:00:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:00:51 user nova-compute[74342]: INFO os_vif [None req-ce510c96-f7bc-4036-a3a2-0b1a56fcb575 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:83:8e:bb,bridge_name='br-int',has_traffic_filtering=True,id=1c9f1265-73b2-4072-b664-f994d0c17646,network=Network(19a96357-4b1f-4da6-a8f4-795a37500116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1c9f1265-73')
Oct 16 10:00:51 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-ce510c96-f7bc-4036-a3a2-0b1a56fcb575 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Deleting instance files /opt/stack/data/nova/instances/e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8_del
Oct 16 10:00:51 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-ce510c96-f7bc-4036-a3a2-0b1a56fcb575 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Deletion of /opt/stack/data/nova/instances/e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8_del complete
Oct 16 10:00:52 user nova-compute[74342]: INFO nova.compute.manager [None req-ce510c96-f7bc-4036-a3a2-0b1a56fcb575 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Took 0.67 seconds to destroy the instance on the hypervisor.
Oct 16 10:00:52 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-ce510c96-f7bc-4036-a3a2-0b1a56fcb575 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 10:00:52 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 10:00:52 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 10:00:52 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:00:52 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Took 0.41 seconds to deallocate network for instance.
Oct 16 10:00:52 user nova-compute[74342]: DEBUG nova.compute.manager [req-e6fc811e-382c-4b98-b81d-0d1b38b19b58 req-31335234-300a-40df-8eb9-00fb8a05058d service nova] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Received event network-vif-deleted-1c9f1265-73b2-4072-b664-f994d0c17646 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:00:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ce510c96-f7bc-4036-a3a2-0b1a56fcb575 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:00:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ce510c96-f7bc-4036-a3a2-0b1a56fcb575 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:00:52 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-ce510c96-f7bc-4036-a3a2-0b1a56fcb575 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Refreshing inventories for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 10:00:52 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-ce510c96-f7bc-4036-a3a2-0b1a56fcb575 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Updating ProviderTree inventory for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 10:00:52 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-ce510c96-f7bc-4036-a3a2-0b1a56fcb575 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Updating inventory in ProviderTree for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 10:00:52 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-ce510c96-f7bc-4036-a3a2-0b1a56fcb575 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Refreshing aggregate associations for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca, aggregates: None {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 10:00:52 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-ce510c96-f7bc-4036-a3a2-0b1a56fcb575 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Refreshing trait associations for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 10:00:52 user nova-compute[74342]: DEBUG nova.compute.manager [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 10:00:52 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Instance rebooted successfully.
Oct 16 10:00:52 user nova-compute[74342]: DEBUG nova.compute.manager [None req-9241faa7-304b-481a-9ede-3a959bb14682 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:00:52 user nova-compute[74342]: DEBUG nova.compute.manager [req-7fee3acf-96af-4278-a056-8272282a0826 req-da487de5-3ca5-4ea2-be25-d82d6dee3a0e service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Received event network-vif-plugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:00:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-7fee3acf-96af-4278-a056-8272282a0826 req-da487de5-3ca5-4ea2-be25-d82d6dee3a0e service nova] Acquiring lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:00:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-7fee3acf-96af-4278-a056-8272282a0826 req-da487de5-3ca5-4ea2-be25-d82d6dee3a0e service nova] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:00:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-7fee3acf-96af-4278-a056-8272282a0826 req-da487de5-3ca5-4ea2-be25-d82d6dee3a0e service nova] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:00:52 user nova-compute[74342]: DEBUG nova.compute.manager [req-7fee3acf-96af-4278-a056-8272282a0826 req-da487de5-3ca5-4ea2-be25-d82d6dee3a0e service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] No waiting events found dispatching network-vif-plugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:00:52 user nova-compute[74342]: WARNING nova.compute.manager [req-7fee3acf-96af-4278-a056-8272282a0826 req-da487de5-3ca5-4ea2-be25-d82d6dee3a0e service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Received unexpected event network-vif-plugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 for instance with vm_state stopped and task_state powering-on.
Oct 16 10:00:52 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-ce510c96-f7bc-4036-a3a2-0b1a56fcb575 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:00:52 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-ce510c96-f7bc-4036-a3a2-0b1a56fcb575 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:00:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ce510c96-f7bc-4036-a3a2-0b1a56fcb575 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.576s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:00:53 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-ce510c96-f7bc-4036-a3a2-0b1a56fcb575 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Deleted allocations for instance e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8
Oct 16 10:00:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ce510c96-f7bc-4036-a3a2-0b1a56fcb575 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.874s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:00:53 user nova-compute[74342]: DEBUG nova.compute.manager [req-0be7e773-61d6-453b-9914-0641ed03091e req-cbbba4a7-4d03-48f5-a25b-75c42644afc5 service nova] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Received event network-vif-plugged-1c9f1265-73b2-4072-b664-f994d0c17646 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:00:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0be7e773-61d6-453b-9914-0641ed03091e req-cbbba4a7-4d03-48f5-a25b-75c42644afc5 service nova] Acquiring lock "e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:00:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0be7e773-61d6-453b-9914-0641ed03091e req-cbbba4a7-4d03-48f5-a25b-75c42644afc5 service nova] Lock "e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:00:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0be7e773-61d6-453b-9914-0641ed03091e req-cbbba4a7-4d03-48f5-a25b-75c42644afc5 service nova] Lock "e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:00:53 user nova-compute[74342]: DEBUG nova.compute.manager [req-0be7e773-61d6-453b-9914-0641ed03091e req-cbbba4a7-4d03-48f5-a25b-75c42644afc5 service nova] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] No waiting events found dispatching network-vif-plugged-1c9f1265-73b2-4072-b664-f994d0c17646 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:00:53 user nova-compute[74342]: WARNING nova.compute.manager [req-0be7e773-61d6-453b-9914-0641ed03091e req-cbbba4a7-4d03-48f5-a25b-75c42644afc5 service nova] [instance: e35da9b2-5d2b-4c20-80ff-2e0ac9b5dcf8] Received unexpected event network-vif-plugged-1c9f1265-73b2-4072-b664-f994d0c17646 for instance with vm_state deleted and task_state None.
Oct 16 10:00:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:57 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:00:57 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:00:58 user nova-compute[74342]: DEBUG nova.compute.manager [req-1bf16453-95ed-4515-9f06-2f22872d0382 req-04a465a3-2347-4f98-8f20-1fa68778b16b service nova] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Received event network-changed-2175722a-e6dd-4b7f-ab62-e3974274f81a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:00:58 user nova-compute[74342]: DEBUG nova.compute.manager [req-1bf16453-95ed-4515-9f06-2f22872d0382 req-04a465a3-2347-4f98-8f20-1fa68778b16b service nova] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Refreshing instance network info cache due to event network-changed-2175722a-e6dd-4b7f-ab62-e3974274f81a. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:00:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-1bf16453-95ed-4515-9f06-2f22872d0382 req-04a465a3-2347-4f98-8f20-1fa68778b16b service nova] Acquiring lock "refresh_cache-9dc7115b-8a02-4ef4-9d44-6590c9fded3e" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:00:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-1bf16453-95ed-4515-9f06-2f22872d0382 req-04a465a3-2347-4f98-8f20-1fa68778b16b service nova] Acquired lock "refresh_cache-9dc7115b-8a02-4ef4-9d44-6590c9fded3e" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:00:58 user nova-compute[74342]: DEBUG nova.network.neutron [req-1bf16453-95ed-4515-9f06-2f22872d0382 req-04a465a3-2347-4f98-8f20-1fa68778b16b service nova] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Refreshing network info cache for port 2175722a-e6dd-4b7f-ab62-e3974274f81a {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:00:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:00:58 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:00:58 user nova-compute[74342]: DEBUG nova.network.neutron [req-1bf16453-95ed-4515-9f06-2f22872d0382 req-04a465a3-2347-4f98-8f20-1fa68778b16b service nova] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Updated VIF entry in instance network info cache for port 2175722a-e6dd-4b7f-ab62-e3974274f81a. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:00:58 user nova-compute[74342]: DEBUG nova.network.neutron [req-1bf16453-95ed-4515-9f06-2f22872d0382 req-04a465a3-2347-4f98-8f20-1fa68778b16b service nova] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Updating instance_info_cache with network_info: [{"id": "2175722a-e6dd-4b7f-ab62-e3974274f81a", "address": "fa:16:3e:f0:12:7d", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2175722a-e6", "ovs_interfaceid": "2175722a-e6dd-4b7f-ab62-e3974274f81a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:00:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-1bf16453-95ed-4515-9f06-2f22872d0382 req-04a465a3-2347-4f98-8f20-1fa68778b16b service nova] Releasing lock "refresh_cache-9dc7115b-8a02-4ef4-9d44-6590c9fded3e" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:00:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:00:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:00:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:00:58 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:00:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 10:00:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab64281f-b3fe-47ef-bd5f-796d03aa131f/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:00:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab64281f-b3fe-47ef-bd5f-796d03aa131f/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:00:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab64281f-b3fe-47ef-bd5f-796d03aa131f/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:00:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab64281f-b3fe-47ef-bd5f-796d03aa131f/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:00:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 10:00:58 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:00:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:00:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:00:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:00:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:00:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:00:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:00:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:00:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:00:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:00:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:00 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:01:00 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:01:00 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=7980MB free_disk=25.19504165649414GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:01:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:01:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:01:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 98367a96-22f0-4edb-ab03-a8eb286b437b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:01:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 4f3aa905-8eae-45cb-8019-0b991286fe42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:01:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance d7607dcc-e70e-42fb-9421-c5f630706241 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:01:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance aa116cab-861b-459d-b1eb-6f07e5d71e30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:01:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 9dc7115b-8a02-4ef4-9d44-6590c9fded3e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:01:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance f0f4fa14-f586-47f0-a79e-4ee095c9fb39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:01:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance ab64281f-b3fe-47ef-bd5f-796d03aa131f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:01:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 575ff5fb-6cd7-4e84-b6de-c971129c7935 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 16 10:01:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:01:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:01:01 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:01:01 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:01:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:01:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.611s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:01:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:02 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:01:02 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:01:02 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:01:02 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Didn't find any instances for network info cache update. {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 10:01:02 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:01:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:04 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:01:05 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:01:05 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:01:05 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:01:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:01:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:01:09 user nova-compute[74342]: DEBUG nova.objects.instance [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lazy-loading 'pci_requests' on Instance uuid 575ff5fb-6cd7-4e84-b6de-c971129c7935 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:01:09 user nova-compute[74342]: DEBUG nova.objects.instance [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lazy-loading 'numa_topology' on Instance uuid 575ff5fb-6cd7-4e84-b6de-c971129c7935 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:01:09 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 10:01:09 user nova-compute[74342]: INFO nova.compute.claims [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Claim successful on node user
Oct 16 10:01:10 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:01:10 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:01:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.459s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:01:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "ee9d9ae4-a837-4c2d-b30c-5b407b959fd8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:01:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "ee9d9ae4-a837-4c2d-b30c-5b407b959fd8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:01:10 user nova-compute[74342]: INFO nova.network.neutron [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Updating port a82e4268-e1e1-494b-b505-2558fa7f535e with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 16 10:01:10 user nova-compute[74342]: DEBUG nova.compute.manager [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 10:01:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:01:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:01:10 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 10:01:10 user nova-compute[74342]: INFO nova.compute.claims [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Claim successful on node user
Oct 16 10:01:10 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:01:10 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:01:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:01:10 user nova-compute[74342]: DEBUG nova.compute.manager [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 10:01:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Acquiring lock "refresh_cache-575ff5fb-6cd7-4e84-b6de-c971129c7935" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:01:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Acquired lock "refresh_cache-575ff5fb-6cd7-4e84-b6de-c971129c7935" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:01:10 user nova-compute[74342]: DEBUG nova.network.neutron [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:01:10 user nova-compute[74342]: DEBUG nova.compute.manager [req-b958895e-7e83-4f99-9a05-a394f9c3600a req-e5e82034-4e6a-473e-8981-ad07f8e3510e service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Received event network-changed-a82e4268-e1e1-494b-b505-2558fa7f535e {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:01:10 user nova-compute[74342]: DEBUG nova.compute.manager [req-b958895e-7e83-4f99-9a05-a394f9c3600a req-e5e82034-4e6a-473e-8981-ad07f8e3510e service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Refreshing instance network info cache due to event network-changed-a82e4268-e1e1-494b-b505-2558fa7f535e. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:01:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b958895e-7e83-4f99-9a05-a394f9c3600a req-e5e82034-4e6a-473e-8981-ad07f8e3510e service nova] Acquiring lock "refresh_cache-575ff5fb-6cd7-4e84-b6de-c971129c7935" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:01:10 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 10:01:10 user nova-compute[74342]: DEBUG nova.compute.manager [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 10:01:10 user nova-compute[74342]: DEBUG nova.network.neutron [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 10:01:10 user nova-compute[74342]: DEBUG nova.compute.manager [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 10:01:11 user nova-compute[74342]: INFO nova.virt.block_device [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Booting with volume snapshot ba39d61a-374f-41e6-be16-c371fc87c0ff at /dev/vda
Oct 16 10:01:11 user nova-compute[74342]: DEBUG nova.policy [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2cac31e799b743359b93943b68b38acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799c265b3d14465a9ca6bd7d5e8a4488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG nova.network.neutron [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Updating instance_info_cache with network_info: [{"id": "a82e4268-e1e1-494b-b505-2558fa7f535e", "address": "fa:16:3e:13:f1:6f", "network": {"id": "46f96b88-d08a-4f28-bcbf-a630d369074a", "bridge": "br-int", "label": "tempest-TestShelveInstance-2043632303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52331a6c86c446d7bb5e9e849eebdd18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa82e4268-e1", "ovs_interfaceid": "a82e4268-e1e1-494b-b505-2558fa7f535e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Releasing lock "refresh_cache-575ff5fb-6cd7-4e84-b6de-c971129c7935" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 10:01:11 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Creating image(s)
Oct 16 10:01:11 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Did not create local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Ensure instance console log exists: /opt/stack/data/nova/instances/575ff5fb-6cd7-4e84-b6de-c971129c7935/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Start _get_guest_xml network_info=[{"id": "a82e4268-e1e1-494b-b505-2558fa7f535e", "address": "fa:16:3e:13:f1:6f", "network": {"id": "46f96b88-d08a-4f28-bcbf-a630d369074a", "bridge": "br-int", "label": "tempest-TestShelveInstance-2043632303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52331a6c86c446d7bb5e9e849eebdd18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa82e4268-e1", "ovs_interfaceid": "a82e4268-e1e1-494b-b505-2558fa7f535e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'attachment_id': '10e15455-ad74-4690-a4d7-64d92471b3cb', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdvWcJrY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '575ff5fb-6cd7-4e84-b6de-c971129c7935', 'attached_at': '', 'detached_at': '', 'volume_id': '85fe9beb-cfb8-452d-8f97-249915dd854f', 'serial': '85fe9beb-cfb8-452d-8f97-249915dd854f'}, 'volume_type': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b958895e-7e83-4f99-9a05-a394f9c3600a req-e5e82034-4e6a-473e-8981-ad07f8e3510e service nova] Acquired lock "refresh_cache-575ff5fb-6cd7-4e84-b6de-c971129c7935" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG nova.network.neutron [req-b958895e-7e83-4f99-9a05-a394f9c3600a req-e5e82034-4e6a-473e-8981-ad07f8e3510e service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Refreshing network info cache for port a82e4268-e1e1-494b-b505-2558fa7f535e {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:01:11 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:01:11 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:01:11 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG nova.objects.instance [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lazy-loading 'vcpu_model' on Instance uuid 575ff5fb-6cd7-4e84-b6de-c971129c7935 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG nova.objects.base [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Object Instance<575ff5fb-6cd7-4e84-b6de-c971129c7935> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdvWcJrY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:01:11 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:01:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:01:11 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:01:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:01:11 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c4c45d-a272-42b7-88a5-924603511ef6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 10:01:11 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b7b682-ab72-4147-b03a-fe451ad044e6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f] added
Oct 16 10:01:11 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d46db0-f769-4e28-b2b9-32cccfdf7ac8]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5834934-c101-4d6b-9810-2865d0544b76]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fdvWcJrY {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fdvWcJrY" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[826f411b-99cc-4af4-b6f6-cc17439e88e4]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fdvWcJrY'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[515948a9-3da5-4705-add5-6b0782c150f1]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8503a9a6-9eaa-4cc5-b9cd-24fc5c450916]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 10:01:11 user nova-compute[74342]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)
Oct 16 10:01:11 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 10:01:11 user nova-compute[74342]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)
Oct 16 10:01:11 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe8bfa6-aa18-4af3-aa32-e386d207a1f6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f, portal: 172.16.0.220,3260]
Oct 16 10:01:11 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f, portal: 172.16.0.220,3260] successful.
Oct 16 10:01:11 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6216adfa-9590-4b18-bb44-3a1722318dd7]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:01:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7ed67e-857a-4de3-a687-a0723bfcdf9c]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 10:01:12 user nova-compute[74342]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)
Oct 16 10:01:12 user nova-compute[74342]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)
Oct 16 10:01:12 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:01:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 10:01:12 user nova-compute[74342]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)
Oct 16 10:01:12 user nova-compute[74342]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)
Oct 16 10:01:12 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:01:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:01:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 10:01:12 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 10:01:12 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 10:01:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b86c1f-1a6f-4807-9937-73758befa506]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:12 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 10:01:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdvWcJrY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 10:01:12 user nova-compute[74342]: DEBUG nova.network.neutron [req-b958895e-7e83-4f99-9a05-a394f9c3600a req-e5e82034-4e6a-473e-8981-ad07f8e3510e service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Updated VIF entry in instance network info cache for port a82e4268-e1e1-494b-b505-2558fa7f535e. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:01:12 user nova-compute[74342]: DEBUG nova.network.neutron [req-b958895e-7e83-4f99-9a05-a394f9c3600a req-e5e82034-4e6a-473e-8981-ad07f8e3510e service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Updating instance_info_cache with network_info: [{"id": "a82e4268-e1e1-494b-b505-2558fa7f535e", "address": "fa:16:3e:13:f1:6f", "network": {"id": "46f96b88-d08a-4f28-bcbf-a630d369074a", "bridge": "br-int", "label": "tempest-TestShelveInstance-2043632303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52331a6c86c446d7bb5e9e849eebdd18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa82e4268-e1", "ovs_interfaceid": "a82e4268-e1e1-494b-b505-2558fa7f535e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:01:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b958895e-7e83-4f99-9a05-a394f9c3600a req-e5e82034-4e6a-473e-8981-ad07f8e3510e service nova] Releasing lock "refresh_cache-575ff5fb-6cd7-4e84-b6de-c971129c7935" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:01:12 user nova-compute[74342]: DEBUG nova.network.neutron [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Successfully created port: 732bad9e-7c6d-402d-821d-96221d6cb069 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.379s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23136366639633964', 'path': '/dev/sdd'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23136366639633964', 'path': '/dev/sdd'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T09:56:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-359637512',display_name='tempest-TestShelveInstance-server-359637512',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-359637512',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-223238522',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:57:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='52331a6c86c446d7bb5e9e849eebdd18',ramdisk_id='',reservation_id='r-8avw62ul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1417500607',owner_user_name='tempest-TestShelveInstance-1417500607-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T10:00:43Z,user_data=None,user_id='8b8ad29a34c84e95ac5513c5a670a753',uuid=575ff5fb-6cd7-4e84-b6de-c971129c7935,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a82e4268-e1e1-494b-b505-2558fa7f535e", "address": "fa:16:3e:13:f1:6f", "network": {"id": "46f96b88-d08a-4f28-bcbf-a630d369074a", "bridge": "br-int", "label": "tempest-TestShelveInstance-2043632303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52331a6c86c446d7bb5e9e849eebdd18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa82e4268-e1", "ovs_interfaceid": "a82e4268-e1e1-494b-b505-2558fa7f535e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Converting VIF {"id": "a82e4268-e1e1-494b-b505-2558fa7f535e", "address": "fa:16:3e:13:f1:6f", "network": {"id": "46f96b88-d08a-4f28-bcbf-a630d369074a", "bridge": "br-int", "label": "tempest-TestShelveInstance-2043632303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52331a6c86c446d7bb5e9e849eebdd18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa82e4268-e1", "ovs_interfaceid": "a82e4268-e1e1-494b-b505-2558fa7f535e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:f1:6f,bridge_name='br-int',has_traffic_filtering=True,id=a82e4268-e1e1-494b-b505-2558fa7f535e,network=Network(46f96b88-d08a-4f28-bcbf-a630d369074a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa82e4268-e1') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG nova.objects.instance [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lazy-loading 'pci_devices' on Instance uuid 575ff5fb-6cd7-4e84-b6de-c971129c7935 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG nova.objects.base [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Object Instance<575ff5fb-6cd7-4e84-b6de-c971129c7935> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] End _get_guest_xml xml=<domain type="kvm">
Oct 16 10:01:13 user nova-compute[74342]:   <uuid>575ff5fb-6cd7-4e84-b6de-c971129c7935</uuid>
Oct 16 10:01:13 user nova-compute[74342]:   <name>instance-0000001d</name>
Oct 16 10:01:13 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 10:01:13 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 10:01:13 user nova-compute[74342]:   <metadata>
Oct 16 10:01:13 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 10:01:13 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 10:01:13 user nova-compute[74342]:       <nova:name>tempest-TestShelveInstance-server-359637512</nova:name>
Oct 16 10:01:13 user nova-compute[74342]:       <nova:creationTime>2023-10-16 10:01:11</nova:creationTime>
Oct 16 10:01:13 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 10:01:13 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 10:01:13 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 10:01:13 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 10:01:13 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 10:01:13 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 10:01:13 user nova-compute[74342]:       </nova:flavor>
Oct 16 10:01:13 user nova-compute[74342]:       <nova:owner>
Oct 16 10:01:13 user nova-compute[74342]:         <nova:user uuid="8b8ad29a34c84e95ac5513c5a670a753">tempest-TestShelveInstance-1417500607-project-member</nova:user>
Oct 16 10:01:13 user nova-compute[74342]:         <nova:project uuid="52331a6c86c446d7bb5e9e849eebdd18">tempest-TestShelveInstance-1417500607</nova:project>
Oct 16 10:01:13 user nova-compute[74342]:       </nova:owner>
Oct 16 10:01:13 user nova-compute[74342]:       <nova:ports>
Oct 16 10:01:13 user nova-compute[74342]:         <nova:port uuid="a82e4268-e1e1-494b-b505-2558fa7f535e">
Oct 16 10:01:13 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 10:01:13 user nova-compute[74342]:         </nova:port>
Oct 16 10:01:13 user nova-compute[74342]:       </nova:ports>
Oct 16 10:01:13 user nova-compute[74342]:     </nova:instance>
Oct 16 10:01:13 user nova-compute[74342]:   </metadata>
Oct 16 10:01:13 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 10:01:13 user nova-compute[74342]:     <system>
Oct 16 10:01:13 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 10:01:13 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 10:01:13 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 10:01:13 user nova-compute[74342]:       <entry name="serial">575ff5fb-6cd7-4e84-b6de-c971129c7935</entry>
Oct 16 10:01:13 user nova-compute[74342]:       <entry name="uuid">575ff5fb-6cd7-4e84-b6de-c971129c7935</entry>
Oct 16 10:01:13 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 10:01:13 user nova-compute[74342]:     </system>
Oct 16 10:01:13 user nova-compute[74342]:   </sysinfo>
Oct 16 10:01:13 user nova-compute[74342]:   <os>
Oct 16 10:01:13 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 10:01:13 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 10:01:13 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 10:01:13 user nova-compute[74342]:   </os>
Oct 16 10:01:13 user nova-compute[74342]:   <features>
Oct 16 10:01:13 user nova-compute[74342]:     <acpi/>
Oct 16 10:01:13 user nova-compute[74342]:     <apic/>
Oct 16 10:01:13 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 10:01:13 user nova-compute[74342]:   </features>
Oct 16 10:01:13 user nova-compute[74342]:   <clock offset="utc">
Oct 16 10:01:13 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 10:01:13 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 10:01:13 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 10:01:13 user nova-compute[74342]:   </clock>
Oct 16 10:01:13 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 10:01:13 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 10:01:13 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 10:01:13 user nova-compute[74342]:   </cpu>
Oct 16 10:01:13 user nova-compute[74342]:   <devices>
Oct 16 10:01:13 user nova-compute[74342]:     <disk type="block" device="disk">
Oct 16 10:01:13 user nova-compute[74342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:01:13 user nova-compute[74342]:       <source dev="/dev/sdd"/>
Oct 16 10:01:13 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 10:01:13 user nova-compute[74342]:       <serial>85fe9beb-cfb8-452d-8f97-249915dd854f</serial>
Oct 16 10:01:13 user nova-compute[74342]:     </disk>
Oct 16 10:01:13 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 10:01:13 user nova-compute[74342]:       <mac address="fa:16:3e:13:f1:6f"/>
Oct 16 10:01:13 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:01:13 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 10:01:13 user nova-compute[74342]:       <target dev="tapa82e4268-e1"/>
Oct 16 10:01:13 user nova-compute[74342]:     </interface>
Oct 16 10:01:13 user nova-compute[74342]:     <serial type="pty">
Oct 16 10:01:13 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/575ff5fb-6cd7-4e84-b6de-c971129c7935/console.log" append="off"/>
Oct 16 10:01:13 user nova-compute[74342]:     </serial>
Oct 16 10:01:13 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 10:01:13 user nova-compute[74342]:     <video>
Oct 16 10:01:13 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:01:13 user nova-compute[74342]:     </video>
Oct 16 10:01:13 user nova-compute[74342]:     <rng model="virtio">
Oct 16 10:01:13 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 10:01:13 user nova-compute[74342]:     </rng>
Oct 16 10:01:13 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 10:01:13 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 10:01:13 user nova-compute[74342]:       <stats period="10"/>
Oct 16 10:01:13 user nova-compute[74342]:     </memballoon>
Oct 16 10:01:13 user nova-compute[74342]:   </devices>
Oct 16 10:01:13 user nova-compute[74342]: </domain>
Oct 16 10:01:13 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T09:56:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-359637512',display_name='tempest-TestShelveInstance-server-359637512',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-359637512',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-223238522',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:57:39Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='52331a6c86c446d7bb5e9e849eebdd18',ramdisk_id='',reservation_id='r-8avw62ul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1417500607',owner_user_name='tempest-TestShelveInstance-1417500607-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T10:00:43Z,user_data=None,user_id='8b8ad29a34c84e95ac5513c5a670a753',uuid=575ff5fb-6cd7-4e84-b6de-c971129c7935,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a82e4268-e1e1-494b-b505-2558fa7f535e", "address": "fa:16:3e:13:f1:6f", "network": {"id": "46f96b88-d08a-4f28-bcbf-a630d369074a", "bridge": "br-int", "label": "tempest-TestShelveInstance-2043632303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52331a6c86c446d7bb5e9e849eebdd18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa82e4268-e1", "ovs_interfaceid": "a82e4268-e1e1-494b-b505-2558fa7f535e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Converting VIF {"id": "a82e4268-e1e1-494b-b505-2558fa7f535e", "address": "fa:16:3e:13:f1:6f", "network": {"id": "46f96b88-d08a-4f28-bcbf-a630d369074a", "bridge": "br-int", "label": "tempest-TestShelveInstance-2043632303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52331a6c86c446d7bb5e9e849eebdd18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa82e4268-e1", "ovs_interfaceid": "a82e4268-e1e1-494b-b505-2558fa7f535e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:f1:6f,bridge_name='br-int',has_traffic_filtering=True,id=a82e4268-e1e1-494b-b505-2558fa7f535e,network=Network(46f96b88-d08a-4f28-bcbf-a630d369074a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa82e4268-e1') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG os_vif [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:f1:6f,bridge_name='br-int',has_traffic_filtering=True,id=a82e4268-e1e1-494b-b505-2558fa7f535e,network=Network(46f96b88-d08a-4f28-bcbf-a630d369074a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa82e4268-e1') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0d72596c-e269-5e4a-8f8e-e931615e481c', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa82e4268-e1, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa82e4268-e1, col_values=(('qos', UUID('97538455-5a50-4042-ad37-1d85e6986174')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa82e4268-e1, col_values=(('external_ids', {'iface-id': 'a82e4268-e1e1-494b-b505-2558fa7f535e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:f1:6f', 'vm-uuid': '575ff5fb-6cd7-4e84-b6de-c971129c7935'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG nova.network.neutron [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Successfully updated port: 732bad9e-7c6d-402d-821d-96221d6cb069 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:13 user nova-compute[74342]: INFO os_vif [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:f1:6f,bridge_name='br-int',has_traffic_filtering=True,id=a82e4268-e1e1-494b-b505-2558fa7f535e,network=Network(46f96b88-d08a-4f28-bcbf-a630d369074a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa82e4268-e1')
Oct 16 10:01:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "refresh_cache-ee9d9ae4-a837-4c2d-b30c-5b407b959fd8" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquired lock "refresh_cache-ee9d9ae4-a837-4c2d-b30c-5b407b959fd8" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG nova.network.neutron [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG nova.compute.manager [req-0cbe58c2-fce6-4a9e-8ffc-3bcb58c2f390 req-a90f86c3-0897-4fdb-a445-a04e11e0171f service nova] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Received event network-changed-732bad9e-7c6d-402d-821d-96221d6cb069 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG nova.compute.manager [req-0cbe58c2-fce6-4a9e-8ffc-3bcb58c2f390 req-a90f86c3-0897-4fdb-a445-a04e11e0171f service nova] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Refreshing instance network info cache due to event network-changed-732bad9e-7c6d-402d-821d-96221d6cb069. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0cbe58c2-fce6-4a9e-8ffc-3bcb58c2f390 req-a90f86c3-0897-4fdb-a445-a04e11e0171f service nova] Acquiring lock "refresh_cache-ee9d9ae4-a837-4c2d-b30c-5b407b959fd8" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] No VIF found with MAC fa:16:3e:13:f1:6f, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG nova.network.neutron [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG nova.network.neutron [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Updating instance_info_cache with network_info: [{"id": "732bad9e-7c6d-402d-821d-96221d6cb069", "address": "fa:16:3e:18:28:3a", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap732bad9e-7c", "ovs_interfaceid": "732bad9e-7c6d-402d-821d-96221d6cb069", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Releasing lock "refresh_cache-ee9d9ae4-a837-4c2d-b30c-5b407b959fd8" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG nova.compute.manager [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Instance network_info: |[{"id": "732bad9e-7c6d-402d-821d-96221d6cb069", "address": "fa:16:3e:18:28:3a", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap732bad9e-7c", "ovs_interfaceid": "732bad9e-7c6d-402d-821d-96221d6cb069", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0cbe58c2-fce6-4a9e-8ffc-3bcb58c2f390 req-a90f86c3-0897-4fdb-a445-a04e11e0171f service nova] Acquired lock "refresh_cache-ee9d9ae4-a837-4c2d-b30c-5b407b959fd8" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:01:13 user nova-compute[74342]: DEBUG nova.network.neutron [req-0cbe58c2-fce6-4a9e-8ffc-3bcb58c2f390 req-a90f86c3-0897-4fdb-a445-a04e11e0171f service nova] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Refreshing network info cache for port 732bad9e-7c6d-402d-821d-96221d6cb069 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:01:14 user nova-compute[74342]: DEBUG nova.network.neutron [req-0cbe58c2-fce6-4a9e-8ffc-3bcb58c2f390 req-a90f86c3-0897-4fdb-a445-a04e11e0171f service nova] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Updated VIF entry in instance network info cache for port 732bad9e-7c6d-402d-821d-96221d6cb069. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:01:14 user nova-compute[74342]: DEBUG nova.network.neutron [req-0cbe58c2-fce6-4a9e-8ffc-3bcb58c2f390 req-a90f86c3-0897-4fdb-a445-a04e11e0171f service nova] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Updating instance_info_cache with network_info: [{"id": "732bad9e-7c6d-402d-821d-96221d6cb069", "address": "fa:16:3e:18:28:3a", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap732bad9e-7c", "ovs_interfaceid": "732bad9e-7c6d-402d-821d-96221d6cb069", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:01:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0cbe58c2-fce6-4a9e-8ffc-3bcb58c2f390 req-a90f86c3-0897-4fdb-a445-a04e11e0171f service nova] Releasing lock "refresh_cache-ee9d9ae4-a837-4c2d-b30c-5b407b959fd8" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:01:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:14 user nova-compute[74342]: DEBUG nova.compute.manager [req-86991bb3-bfab-460e-8243-3e2cf54dc456 req-5e5ca221-7069-4bd6-a956-1155fc1c2fad service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Received event network-vif-plugged-a82e4268-e1e1-494b-b505-2558fa7f535e {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:01:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-86991bb3-bfab-460e-8243-3e2cf54dc456 req-5e5ca221-7069-4bd6-a956-1155fc1c2fad service nova] Acquiring lock "575ff5fb-6cd7-4e84-b6de-c971129c7935-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:01:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-86991bb3-bfab-460e-8243-3e2cf54dc456 req-5e5ca221-7069-4bd6-a956-1155fc1c2fad service nova] Lock "575ff5fb-6cd7-4e84-b6de-c971129c7935-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:01:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-86991bb3-bfab-460e-8243-3e2cf54dc456 req-5e5ca221-7069-4bd6-a956-1155fc1c2fad service nova] Lock "575ff5fb-6cd7-4e84-b6de-c971129c7935-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:01:14 user nova-compute[74342]: DEBUG nova.compute.manager [req-86991bb3-bfab-460e-8243-3e2cf54dc456 req-5e5ca221-7069-4bd6-a956-1155fc1c2fad service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] No waiting events found dispatching network-vif-plugged-a82e4268-e1e1-494b-b505-2558fa7f535e {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:01:14 user nova-compute[74342]: WARNING nova.compute.manager [req-86991bb3-bfab-460e-8243-3e2cf54dc456 req-5e5ca221-7069-4bd6-a956-1155fc1c2fad service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Received unexpected event network-vif-plugged-a82e4268-e1e1-494b-b505-2558fa7f535e for instance with vm_state shelved_offloaded and task_state spawning.
Oct 16 10:01:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:16 user nova-compute[74342]: DEBUG os_brick.utils [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:01:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:16 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b818da-6ecf-4234-a060-3b874e61a9ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:16 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfbb63a8-962c-4625-965e-145f0367f166]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:16 user nova-compute[74342]: DEBUG nova.compute.manager [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 10:01:16 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 10:01:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:16 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa031eb9-ef5d-4c02-8cd9-3ca7ac52d87b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:16 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0059de9-4722-4506-a141-f000cdf702be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:01:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 10:01:16 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Instance spawned successfully.
Oct 16 10:01:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:16 user nova-compute[74342]: DEBUG nova.compute.manager [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:01:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:01:16 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 10:01:16 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[82232d6e-691e-4d44-940d-c78141de2470]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 10:01:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 10:01:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 10:01:16 user nova-compute[74342]: DEBUG os_brick.utils [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:01:16 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Updating existing volume attachment record: 50335f08-9c83-4af3-9a7d-5a9c63a417c5 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 10:01:16 user nova-compute[74342]: DEBUG nova.compute.manager [req-2be13a1e-f571-4a80-b6b6-4c1d5d26098d req-1b5332cc-1242-48aa-840b-59c21a98bcd0 service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Received event network-vif-plugged-a82e4268-e1e1-494b-b505-2558fa7f535e {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:01:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-2be13a1e-f571-4a80-b6b6-4c1d5d26098d req-1b5332cc-1242-48aa-840b-59c21a98bcd0 service nova] Acquiring lock "575ff5fb-6cd7-4e84-b6de-c971129c7935-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:01:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-2be13a1e-f571-4a80-b6b6-4c1d5d26098d req-1b5332cc-1242-48aa-840b-59c21a98bcd0 service nova] Lock "575ff5fb-6cd7-4e84-b6de-c971129c7935-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:01:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-2be13a1e-f571-4a80-b6b6-4c1d5d26098d req-1b5332cc-1242-48aa-840b-59c21a98bcd0 service nova] Lock "575ff5fb-6cd7-4e84-b6de-c971129c7935-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:01:16 user nova-compute[74342]: DEBUG nova.compute.manager [req-2be13a1e-f571-4a80-b6b6-4c1d5d26098d req-1b5332cc-1242-48aa-840b-59c21a98bcd0 service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] No waiting events found dispatching network-vif-plugged-a82e4268-e1e1-494b-b505-2558fa7f535e {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:01:16 user nova-compute[74342]: WARNING nova.compute.manager [req-2be13a1e-f571-4a80-b6b6-4c1d5d26098d req-1b5332cc-1242-48aa-840b-59c21a98bcd0 service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Received unexpected event network-vif-plugged-a82e4268-e1e1-494b-b505-2558fa7f535e for instance with vm_state shelved_offloaded and task_state spawning.
Oct 16 10:01:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-017b62d2-5e4c-4929-832b-d1bc779d465d tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "575ff5fb-6cd7-4e84-b6de-c971129c7935" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 33.678s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:01:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:29 user nova-compute[74342]: DEBUG nova.compute.manager [req-33aa3c91-bea9-443a-a08b-96c2fd9759b7 req-29c8eccd-c1aa-4afb-b03b-838b400d86e0 service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Received event network-changed-6bd9a0d7-fd42-4686-b4a8-af790582008d {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:01:29 user nova-compute[74342]: DEBUG nova.compute.manager [req-33aa3c91-bea9-443a-a08b-96c2fd9759b7 req-29c8eccd-c1aa-4afb-b03b-838b400d86e0 service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Refreshing instance network info cache due to event network-changed-6bd9a0d7-fd42-4686-b4a8-af790582008d. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:01:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-33aa3c91-bea9-443a-a08b-96c2fd9759b7 req-29c8eccd-c1aa-4afb-b03b-838b400d86e0 service nova] Acquiring lock "refresh_cache-f0f4fa14-f586-47f0-a79e-4ee095c9fb39" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:01:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-33aa3c91-bea9-443a-a08b-96c2fd9759b7 req-29c8eccd-c1aa-4afb-b03b-838b400d86e0 service nova] Acquired lock "refresh_cache-f0f4fa14-f586-47f0-a79e-4ee095c9fb39" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:01:29 user nova-compute[74342]: DEBUG nova.network.neutron [req-33aa3c91-bea9-443a-a08b-96c2fd9759b7 req-29c8eccd-c1aa-4afb-b03b-838b400d86e0 service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Refreshing network info cache for port 6bd9a0d7-fd42-4686-b4a8-af790582008d {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:01:29 user nova-compute[74342]: DEBUG nova.network.neutron [req-33aa3c91-bea9-443a-a08b-96c2fd9759b7 req-29c8eccd-c1aa-4afb-b03b-838b400d86e0 service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Updated VIF entry in instance network info cache for port 6bd9a0d7-fd42-4686-b4a8-af790582008d. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:01:29 user nova-compute[74342]: DEBUG nova.network.neutron [req-33aa3c91-bea9-443a-a08b-96c2fd9759b7 req-29c8eccd-c1aa-4afb-b03b-838b400d86e0 service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Updating instance_info_cache with network_info: [{"id": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "address": "fa:16:3e:80:ef:28", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9a0d7-fd", "ovs_interfaceid": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:01:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-33aa3c91-bea9-443a-a08b-96c2fd9759b7 req-29c8eccd-c1aa-4afb-b03b-838b400d86e0 service nova] Releasing lock "refresh_cache-f0f4fa14-f586-47f0-a79e-4ee095c9fb39" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:01:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:01:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:01:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:01:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:01:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG nova.compute.manager [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 10:01:34 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Creating image(s)
Oct 16 10:01:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Did not create local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Ensure instance console log exists: /opt/stack/data/nova/instances/ee9d9ae4-a837-4c2d-b30c-5b407b959fd8/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Start _get_guest_xml network_info=[{"id": "732bad9e-7c6d-402d-821d-96221d6cb069", "address": "fa:16:3e:18:28:3a", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap732bad9e-7c", "ovs_interfaceid": "732bad9e-7c6d-402d-821d-96221d6cb069", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-16T10:01:00Z,direct_url=<?>,disk_format='qcow2',id=28233b7c-daa5-4f1c-8989-5ba47a287f69,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-750852301',owner='799c265b3d14465a9ca6bd7d5e8a4488',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-16T10:01:01Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': True, 'attachment_id': '50335f08-9c83-4af3-9a7d-5a9c63a417c5', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZlqxVvz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ee9d9ae4-a837-4c2d-b30c-5b407b959fd8', 'attached_at': '', 'detached_at': '', 'volume_id': '4e13777c-162c-4074-b176-4d1998cd5519', 'serial': '4e13777c-162c-4074-b176-4d1998cd5519'}, 'volume_type': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 10:01:34 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:01:34 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:01:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-10-16T10:01:00Z,direct_url=<?>,disk_format='qcow2',id=28233b7c-daa5-4f1c-8989-5ba47a287f69,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-750852301',owner='799c265b3d14465a9ca6bd7d5e8a4488',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-10-16T10:01:01Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZlqxVvz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:01:34 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:01:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:01:34 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:01:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:01:34 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 10:01:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc99cec-efce-4373-ab47-edea0aa811f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 10:01:34 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0450d39a-c14d-4463-9159-f3cbb4558e08]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519] added
Oct 16 10:01:34 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8c1e36-5157-434e-b831-7c67e116bc90]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb0504a-e354-4dba-9930-bd963912bf6f]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mZlqxVvz {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mZlqxVvz" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d201ad3-4f9f-4e8d-972f-d652f94c421b]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mZlqxVvz'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8827a2-8b23-471e-ac78-41e30880f4a4]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fbff71-fa66-4bee-a54c-60d8c62ac8c3]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 10:01:34 user nova-compute[74342]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)
Oct 16 10:01:34 user nova-compute[74342]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)
Oct 16 10:01:34 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 10:01:34 user nova-compute[74342]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)
Oct 16 10:01:34 user nova-compute[74342]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)
Oct 16 10:01:34 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:01:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[405cac48-8c21-42ad-aac8-7479116bbc6b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519, portal: 172.16.0.220,3260]
Oct 16 10:01:35 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519, portal: 172.16.0.220,3260] successful.
Oct 16 10:01:35 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:01:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbb2cd7-847e-4547-b798-db52264912e2]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:01:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e350f95b-0374-401e-82c4-d1e19085b3ec]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 10:01:35 user nova-compute[74342]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)
Oct 16 10:01:35 user nova-compute[74342]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)
Oct 16 10:01:35 user nova-compute[74342]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 (non-flash)
Oct 16 10:01:35 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:01:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 10:01:35 user nova-compute[74342]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)
Oct 16 10:01:35 user nova-compute[74342]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)
Oct 16 10:01:35 user nova-compute[74342]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 (non-flash)
Oct 16 10:01:35 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:01:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:01:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 10:01:35 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] HCTL ('36', '-', '-', 0) found on session 30 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 10:01:35 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 10:01:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[695fa137-9f6b-42b3-af44-860619b3ea01]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:35 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Searching for a device in session 30 and hctl ['36', '*', '*', 0] yield: sde {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 10:01:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZlqxVvz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26134653762326561', 'path': '/dev/sde'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134653762326561', 'path': '/dev/sde'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:01:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-936037188',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-936037188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-936037188',id=35,image_ref='28233b7c-daa5-4f1c-8989-5ba47a287f69',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdY1hlBlWcNbifkK4os30+lDuH238DtycW7BtW4z5t4LT1tZW36yQ++VkIIktGKWb1Olpg8RqekD7cAifrnZG6scbA3jh5E7+jEJ7QjDV0MYgvat0Q9cMKq9FWYpztC5g==',key_name='tempest-keypair-1727954659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='799c265b3d14465a9ca6bd7d5e8a4488',ramdisk_id='',reservation_id='r-nfi9ibh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-158744824',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-158744824-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-158744824',owner_user_name='tempest-TestVolumeBootPattern-158744824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:01:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cac31e799b743359b93943b68b38acf',uuid=ee9d9ae4-a837-4c2d-b30c-5b407b959fd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "732bad9e-7c6d-402d-821d-96221d6cb069", "address": "fa:16:3e:18:28:3a", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap732bad9e-7c", "ovs_interfaceid": "732bad9e-7c6d-402d-821d-96221d6cb069", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converting VIF {"id": "732bad9e-7c6d-402d-821d-96221d6cb069", "address": "fa:16:3e:18:28:3a", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap732bad9e-7c", "ovs_interfaceid": "732bad9e-7c6d-402d-821d-96221d6cb069", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:28:3a,bridge_name='br-int',has_traffic_filtering=True,id=732bad9e-7c6d-402d-821d-96221d6cb069,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap732bad9e-7c') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG nova.objects.instance [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lazy-loading 'pci_devices' on Instance uuid ee9d9ae4-a837-4c2d-b30c-5b407b959fd8 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] End _get_guest_xml xml=<domain type="kvm">
Oct 16 10:01:36 user nova-compute[74342]:   <uuid>ee9d9ae4-a837-4c2d-b30c-5b407b959fd8</uuid>
Oct 16 10:01:36 user nova-compute[74342]:   <name>instance-00000023</name>
Oct 16 10:01:36 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 10:01:36 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 10:01:36 user nova-compute[74342]:   <metadata>
Oct 16 10:01:36 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 10:01:36 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 10:01:36 user nova-compute[74342]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-936037188</nova:name>
Oct 16 10:01:36 user nova-compute[74342]:       <nova:creationTime>2023-10-16 10:01:34</nova:creationTime>
Oct 16 10:01:36 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 10:01:36 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 10:01:36 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 10:01:36 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 10:01:36 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 10:01:36 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 10:01:36 user nova-compute[74342]:       </nova:flavor>
Oct 16 10:01:36 user nova-compute[74342]:       <nova:owner>
Oct 16 10:01:36 user nova-compute[74342]:         <nova:user uuid="2cac31e799b743359b93943b68b38acf">tempest-TestVolumeBootPattern-158744824-project-member</nova:user>
Oct 16 10:01:36 user nova-compute[74342]:         <nova:project uuid="799c265b3d14465a9ca6bd7d5e8a4488">tempest-TestVolumeBootPattern-158744824</nova:project>
Oct 16 10:01:36 user nova-compute[74342]:       </nova:owner>
Oct 16 10:01:36 user nova-compute[74342]:       <nova:root type="image" uuid="28233b7c-daa5-4f1c-8989-5ba47a287f69"/>
Oct 16 10:01:36 user nova-compute[74342]:       <nova:ports>
Oct 16 10:01:36 user nova-compute[74342]:         <nova:port uuid="732bad9e-7c6d-402d-821d-96221d6cb069">
Oct 16 10:01:36 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 16 10:01:36 user nova-compute[74342]:         </nova:port>
Oct 16 10:01:36 user nova-compute[74342]:       </nova:ports>
Oct 16 10:01:36 user nova-compute[74342]:     </nova:instance>
Oct 16 10:01:36 user nova-compute[74342]:   </metadata>
Oct 16 10:01:36 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 10:01:36 user nova-compute[74342]:     <system>
Oct 16 10:01:36 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 10:01:36 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 10:01:36 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 10:01:36 user nova-compute[74342]:       <entry name="serial">ee9d9ae4-a837-4c2d-b30c-5b407b959fd8</entry>
Oct 16 10:01:36 user nova-compute[74342]:       <entry name="uuid">ee9d9ae4-a837-4c2d-b30c-5b407b959fd8</entry>
Oct 16 10:01:36 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 10:01:36 user nova-compute[74342]:     </system>
Oct 16 10:01:36 user nova-compute[74342]:   </sysinfo>
Oct 16 10:01:36 user nova-compute[74342]:   <os>
Oct 16 10:01:36 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 10:01:36 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 10:01:36 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 10:01:36 user nova-compute[74342]:   </os>
Oct 16 10:01:36 user nova-compute[74342]:   <features>
Oct 16 10:01:36 user nova-compute[74342]:     <acpi/>
Oct 16 10:01:36 user nova-compute[74342]:     <apic/>
Oct 16 10:01:36 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 10:01:36 user nova-compute[74342]:   </features>
Oct 16 10:01:36 user nova-compute[74342]:   <clock offset="utc">
Oct 16 10:01:36 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 10:01:36 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 10:01:36 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 10:01:36 user nova-compute[74342]:   </clock>
Oct 16 10:01:36 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 10:01:36 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 10:01:36 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 10:01:36 user nova-compute[74342]:   </cpu>
Oct 16 10:01:36 user nova-compute[74342]:   <devices>
Oct 16 10:01:36 user nova-compute[74342]:     <disk type="block" device="disk">
Oct 16 10:01:36 user nova-compute[74342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:01:36 user nova-compute[74342]:       <source dev="/dev/sde"/>
Oct 16 10:01:36 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 10:01:36 user nova-compute[74342]:       <serial>4e13777c-162c-4074-b176-4d1998cd5519</serial>
Oct 16 10:01:36 user nova-compute[74342]:     </disk>
Oct 16 10:01:36 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 10:01:36 user nova-compute[74342]:       <mac address="fa:16:3e:18:28:3a"/>
Oct 16 10:01:36 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:01:36 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 10:01:36 user nova-compute[74342]:       <target dev="tap732bad9e-7c"/>
Oct 16 10:01:36 user nova-compute[74342]:     </interface>
Oct 16 10:01:36 user nova-compute[74342]:     <serial type="pty">
Oct 16 10:01:36 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/ee9d9ae4-a837-4c2d-b30c-5b407b959fd8/console.log" append="off"/>
Oct 16 10:01:36 user nova-compute[74342]:     </serial>
Oct 16 10:01:36 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 10:01:36 user nova-compute[74342]:     <video>
Oct 16 10:01:36 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:01:36 user nova-compute[74342]:     </video>
Oct 16 10:01:36 user nova-compute[74342]:     <rng model="virtio">
Oct 16 10:01:36 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 10:01:36 user nova-compute[74342]:     </rng>
Oct 16 10:01:36 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 10:01:36 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 10:01:36 user nova-compute[74342]:       <stats period="10"/>
Oct 16 10:01:36 user nova-compute[74342]:     </memballoon>
Oct 16 10:01:36 user nova-compute[74342]:   </devices>
Oct 16 10:01:36 user nova-compute[74342]: </domain>
Oct 16 10:01:36 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:01:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-936037188',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-936037188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-936037188',id=35,image_ref='28233b7c-daa5-4f1c-8989-5ba47a287f69',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdY1hlBlWcNbifkK4os30+lDuH238DtycW7BtW4z5t4LT1tZW36yQ++VkIIktGKWb1Olpg8RqekD7cAifrnZG6scbA3jh5E7+jEJ7QjDV0MYgvat0Q9cMKq9FWYpztC5g==',key_name='tempest-keypair-1727954659',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='799c265b3d14465a9ca6bd7d5e8a4488',ramdisk_id='',reservation_id='r-nfi9ibh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-158744824',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-158744824-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-158744824',owner_user_name='tempest-TestVolumeBootPattern-158744824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:01:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cac31e799b743359b93943b68b38acf',uuid=ee9d9ae4-a837-4c2d-b30c-5b407b959fd8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "732bad9e-7c6d-402d-821d-96221d6cb069", "address": "fa:16:3e:18:28:3a", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap732bad9e-7c", "ovs_interfaceid": "732bad9e-7c6d-402d-821d-96221d6cb069", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converting VIF {"id": "732bad9e-7c6d-402d-821d-96221d6cb069", "address": "fa:16:3e:18:28:3a", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap732bad9e-7c", "ovs_interfaceid": "732bad9e-7c6d-402d-821d-96221d6cb069", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:28:3a,bridge_name='br-int',has_traffic_filtering=True,id=732bad9e-7c6d-402d-821d-96221d6cb069,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap732bad9e-7c') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG os_vif [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:28:3a,bridge_name='br-int',has_traffic_filtering=True,id=732bad9e-7c6d-402d-821d-96221d6cb069,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap732bad9e-7c') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e5737fd1-0779-54ea-85a6-074189c8661e', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:01:36 user nova-compute[74342]: INFO nova.compute.manager [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Shelving
Oct 16 10:01:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap732bad9e-7c, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap732bad9e-7c, col_values=(('qos', UUID('be319b1a-de62-40f3-8cfb-6e69b97daf31')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap732bad9e-7c, col_values=(('external_ids', {'iface-id': '732bad9e-7c6d-402d-821d-96221d6cb069', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:18:28:3a', 'vm-uuid': 'ee9d9ae4-a837-4c2d-b30c-5b407b959fd8'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:36 user nova-compute[74342]: INFO os_vif [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:28:3a,bridge_name='br-int',has_traffic_filtering=True,id=732bad9e-7c6d-402d-821d-96221d6cb069,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap732bad9e-7c')
Oct 16 10:01:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] No VIF found with MAC fa:16:3e:18:28:3a, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG nova.compute.manager [req-4c2bc6b7-a476-4bc5-bb60-9d6ea1a7dbe4 req-13d4e3fd-b1ab-492b-8ef2-8df7d07a0365 service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Received event network-vif-unplugged-6bd9a0d7-fd42-4686-b4a8-af790582008d {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4c2bc6b7-a476-4bc5-bb60-9d6ea1a7dbe4 req-13d4e3fd-b1ab-492b-8ef2-8df7d07a0365 service nova] Acquiring lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4c2bc6b7-a476-4bc5-bb60-9d6ea1a7dbe4 req-13d4e3fd-b1ab-492b-8ef2-8df7d07a0365 service nova] Lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4c2bc6b7-a476-4bc5-bb60-9d6ea1a7dbe4 req-13d4e3fd-b1ab-492b-8ef2-8df7d07a0365 service nova] Lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:01:36 user nova-compute[74342]: DEBUG nova.compute.manager [req-4c2bc6b7-a476-4bc5-bb60-9d6ea1a7dbe4 req-13d4e3fd-b1ab-492b-8ef2-8df7d07a0365 service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] No waiting events found dispatching network-vif-unplugged-6bd9a0d7-fd42-4686-b4a8-af790582008d {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:01:36 user nova-compute[74342]: WARNING nova.compute.manager [req-4c2bc6b7-a476-4bc5-bb60-9d6ea1a7dbe4 req-13d4e3fd-b1ab-492b-8ef2-8df7d07a0365 service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Received unexpected event network-vif-unplugged-6bd9a0d7-fd42-4686-b4a8-af790582008d for instance with vm_state active and task_state shelving.
Oct 16 10:01:37 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Instance destroyed successfully.
Oct 16 10:01:37 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Beginning cold snapshot process
Oct 16 10:01:37 user nova-compute[74342]: DEBUG nova.privsep.utils [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 10:01:37 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk /opt/stack/data/nova/instances/snapshots/tmpveimx039/9b7c6e6d05774f7fbe1af8a524c6aa65 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk /opt/stack/data/nova/instances/snapshots/tmpveimx039/9b7c6e6d05774f7fbe1af8a524c6aa65" returned: 0 in 0.704s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:38 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Snapshot extracted, beginning image upload
Oct 16 10:01:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:38 user nova-compute[74342]: DEBUG nova.compute.manager [req-9f95228d-7a25-45a5-9e22-be8343d81687 req-719366e6-97e4-4ff8-9996-5e5cc692c24e service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Received event network-vif-plugged-6bd9a0d7-fd42-4686-b4a8-af790582008d {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:01:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9f95228d-7a25-45a5-9e22-be8343d81687 req-719366e6-97e4-4ff8-9996-5e5cc692c24e service nova] Acquiring lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:01:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9f95228d-7a25-45a5-9e22-be8343d81687 req-719366e6-97e4-4ff8-9996-5e5cc692c24e service nova] Lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:01:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9f95228d-7a25-45a5-9e22-be8343d81687 req-719366e6-97e4-4ff8-9996-5e5cc692c24e service nova] Lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:01:38 user nova-compute[74342]: DEBUG nova.compute.manager [req-9f95228d-7a25-45a5-9e22-be8343d81687 req-719366e6-97e4-4ff8-9996-5e5cc692c24e service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] No waiting events found dispatching network-vif-plugged-6bd9a0d7-fd42-4686-b4a8-af790582008d {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:01:38 user nova-compute[74342]: WARNING nova.compute.manager [req-9f95228d-7a25-45a5-9e22-be8343d81687 req-719366e6-97e4-4ff8-9996-5e5cc692c24e service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Received unexpected event network-vif-plugged-6bd9a0d7-fd42-4686-b4a8-af790582008d for instance with vm_state active and task_state shelving_image_uploading.
Oct 16 10:01:38 user nova-compute[74342]: DEBUG nova.compute.manager [req-9f95228d-7a25-45a5-9e22-be8343d81687 req-719366e6-97e4-4ff8-9996-5e5cc692c24e service nova] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Received event network-vif-plugged-732bad9e-7c6d-402d-821d-96221d6cb069 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:01:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9f95228d-7a25-45a5-9e22-be8343d81687 req-719366e6-97e4-4ff8-9996-5e5cc692c24e service nova] Acquiring lock "ee9d9ae4-a837-4c2d-b30c-5b407b959fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:01:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9f95228d-7a25-45a5-9e22-be8343d81687 req-719366e6-97e4-4ff8-9996-5e5cc692c24e service nova] Lock "ee9d9ae4-a837-4c2d-b30c-5b407b959fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:01:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9f95228d-7a25-45a5-9e22-be8343d81687 req-719366e6-97e4-4ff8-9996-5e5cc692c24e service nova] Lock "ee9d9ae4-a837-4c2d-b30c-5b407b959fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:01:38 user nova-compute[74342]: DEBUG nova.compute.manager [req-9f95228d-7a25-45a5-9e22-be8343d81687 req-719366e6-97e4-4ff8-9996-5e5cc692c24e service nova] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] No waiting events found dispatching network-vif-plugged-732bad9e-7c6d-402d-821d-96221d6cb069 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:01:38 user nova-compute[74342]: WARNING nova.compute.manager [req-9f95228d-7a25-45a5-9e22-be8343d81687 req-719366e6-97e4-4ff8-9996-5e5cc692c24e service nova] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Received unexpected event network-vif-plugged-732bad9e-7c6d-402d-821d-96221d6cb069 for instance with vm_state building and task_state spawning.
Oct 16 10:01:38 user nova-compute[74342]: DEBUG nova.compute.manager [req-9f95228d-7a25-45a5-9e22-be8343d81687 req-719366e6-97e4-4ff8-9996-5e5cc692c24e service nova] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Received event network-vif-plugged-732bad9e-7c6d-402d-821d-96221d6cb069 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:01:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9f95228d-7a25-45a5-9e22-be8343d81687 req-719366e6-97e4-4ff8-9996-5e5cc692c24e service nova] Acquiring lock "ee9d9ae4-a837-4c2d-b30c-5b407b959fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:01:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9f95228d-7a25-45a5-9e22-be8343d81687 req-719366e6-97e4-4ff8-9996-5e5cc692c24e service nova] Lock "ee9d9ae4-a837-4c2d-b30c-5b407b959fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:01:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9f95228d-7a25-45a5-9e22-be8343d81687 req-719366e6-97e4-4ff8-9996-5e5cc692c24e service nova] Lock "ee9d9ae4-a837-4c2d-b30c-5b407b959fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:01:38 user nova-compute[74342]: DEBUG nova.compute.manager [req-9f95228d-7a25-45a5-9e22-be8343d81687 req-719366e6-97e4-4ff8-9996-5e5cc692c24e service nova] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] No waiting events found dispatching network-vif-plugged-732bad9e-7c6d-402d-821d-96221d6cb069 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:01:38 user nova-compute[74342]: WARNING nova.compute.manager [req-9f95228d-7a25-45a5-9e22-be8343d81687 req-719366e6-97e4-4ff8-9996-5e5cc692c24e service nova] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Received unexpected event network-vif-plugged-732bad9e-7c6d-402d-821d-96221d6cb069 for instance with vm_state building and task_state spawning.
Oct 16 10:01:40 user nova-compute[74342]: DEBUG nova.compute.manager [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 10:01:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 10:01:40 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Instance spawned successfully.
Oct 16 10:01:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 10:01:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:01:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:01:40 user nova-compute[74342]: INFO nova.compute.manager [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Took 5.64 seconds to spawn the instance on the hypervisor.
Oct 16 10:01:40 user nova-compute[74342]: DEBUG nova.compute.manager [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:01:40 user nova-compute[74342]: INFO nova.compute.manager [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Took 30.23 seconds to build instance.
Oct 16 10:01:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e0ab3ea7-eed1-4191-97a6-efa9bc0bea48 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "ee9d9ae4-a837-4c2d-b30c-5b407b959fd8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.331s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:01:41 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Snapshot image upload complete
Oct 16 10:01:41 user nova-compute[74342]: DEBUG nova.compute.manager [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:01:41 user nova-compute[74342]: INFO nova.compute.manager [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Shelve offloading
Oct 16 10:01:41 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Instance destroyed successfully.
Oct 16 10:01:41 user nova-compute[74342]: DEBUG nova.compute.manager [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:01:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "refresh_cache-f0f4fa14-f586-47f0-a79e-4ee095c9fb39" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:01:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquired lock "refresh_cache-f0f4fa14-f586-47f0-a79e-4ee095c9fb39" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:01:41 user nova-compute[74342]: DEBUG nova.network.neutron [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:01:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:41 user nova-compute[74342]: DEBUG nova.network.neutron [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Updating instance_info_cache with network_info: [{"id": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "address": "fa:16:3e:80:ef:28", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9a0d7-fd", "ovs_interfaceid": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:01:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Releasing lock "refresh_cache-f0f4fa14-f586-47f0-a79e-4ee095c9fb39" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:01:42 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Instance destroyed successfully.
Oct 16 10:01:42 user nova-compute[74342]: DEBUG nova.objects.instance [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lazy-loading 'resources' on Instance uuid f0f4fa14-f586-47f0-a79e-4ee095c9fb39 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:01:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:59:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-727193916',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-727193916',id=33,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPrRDSK3jvDbnQw/5jWArlxh2TAUgBAtuKsNHsVciPvzxhAfuT7d3dBJZcZofN8JgfQLBmHOImdCmqkbGxOEwutBU9f8xpybWUVPbbfi1MZkmOV5UxkGtk3p/ZJL9mGwg==',key_name='tempest-keypair-150707378',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:59:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='a70b9ea5f3404a5690cd0a73db23f034',ramdisk_id='',reservation_id='r-0e1oe4y4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-939526853',owner_user_name='tempest-AttachVolumeShelveTestJSON-939526853-project-member',shelved_at='2023-10-16T10:01:41.085531',shelved_host='user',shelved_image_id='4bddac92-23e9-452c-b409-4f8c7f96506d'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T10:01:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8bf8aa8ab2d4105ad0b1fd04247e3a0',uuid=f0f4fa14-f586-47f0-a79e-4ee095c9fb39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "address": "fa:16:3e:80:ef:28", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9a0d7-fd", "ovs_interfaceid": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 10:01:42 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Converting VIF {"id": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "address": "fa:16:3e:80:ef:28", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9a0d7-fd", "ovs_interfaceid": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:01:42 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:ef:28,bridge_name='br-int',has_traffic_filtering=True,id=6bd9a0d7-fd42-4686-b4a8-af790582008d,network=Network(bbeb1d70-a5dc-46d6-a0dd-240bf3018d31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd9a0d7-fd') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:01:42 user nova-compute[74342]: DEBUG os_vif [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:ef:28,bridge_name='br-int',has_traffic_filtering=True,id=6bd9a0d7-fd42-4686-b4a8-af790582008d,network=Network(bbeb1d70-a5dc-46d6-a0dd-240bf3018d31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd9a0d7-fd') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 10:01:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6bd9a0d7-fd, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:01:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:01:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=11555bdb-6727-441b-bcac-5e4fdd7256ac) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:01:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:01:42 user nova-compute[74342]: INFO os_vif [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:ef:28,bridge_name='br-int',has_traffic_filtering=True,id=6bd9a0d7-fd42-4686-b4a8-af790582008d,network=Network(bbeb1d70-a5dc-46d6-a0dd-240bf3018d31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd9a0d7-fd')
Oct 16 10:01:42 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Deleting instance files /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39_del
Oct 16 10:01:42 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Deletion of /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39_del complete
Oct 16 10:01:42 user nova-compute[74342]: DEBUG nova.compute.manager [req-dedb96d4-da27-4c52-8547-bb40fc7a05e5 req-ee9546ff-9432-4ed4-a3ff-264385335e81 service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Received event network-changed-6bd9a0d7-fd42-4686-b4a8-af790582008d {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:01:42 user nova-compute[74342]: DEBUG nova.compute.manager [req-dedb96d4-da27-4c52-8547-bb40fc7a05e5 req-ee9546ff-9432-4ed4-a3ff-264385335e81 service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Refreshing instance network info cache due to event network-changed-6bd9a0d7-fd42-4686-b4a8-af790582008d. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:01:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-dedb96d4-da27-4c52-8547-bb40fc7a05e5 req-ee9546ff-9432-4ed4-a3ff-264385335e81 service nova] Acquiring lock "refresh_cache-f0f4fa14-f586-47f0-a79e-4ee095c9fb39" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:01:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-dedb96d4-da27-4c52-8547-bb40fc7a05e5 req-ee9546ff-9432-4ed4-a3ff-264385335e81 service nova] Acquired lock "refresh_cache-f0f4fa14-f586-47f0-a79e-4ee095c9fb39" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:01:42 user nova-compute[74342]: DEBUG nova.network.neutron [req-dedb96d4-da27-4c52-8547-bb40fc7a05e5 req-ee9546ff-9432-4ed4-a3ff-264385335e81 service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Refreshing network info cache for port 6bd9a0d7-fd42-4686-b4a8-af790582008d {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:01:42 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Deleted allocations for instance f0f4fa14-f586-47f0-a79e-4ee095c9fb39
Oct 16 10:01:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:01:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:01:42 user nova-compute[74342]: DEBUG nova.objects.instance [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lazy-loading 'numa_topology' on Instance uuid f0f4fa14-f586-47f0-a79e-4ee095c9fb39 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:01:42 user nova-compute[74342]: DEBUG nova.objects.base [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Object Instance<f0f4fa14-f586-47f0-a79e-4ee095c9fb39> lazy-loaded attributes: resources,numa_topology {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:01:42 user nova-compute[74342]: DEBUG nova.network.neutron [req-dedb96d4-da27-4c52-8547-bb40fc7a05e5 req-ee9546ff-9432-4ed4-a3ff-264385335e81 service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Updated VIF entry in instance network info cache for port 6bd9a0d7-fd42-4686-b4a8-af790582008d. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:01:42 user nova-compute[74342]: DEBUG nova.network.neutron [req-dedb96d4-da27-4c52-8547-bb40fc7a05e5 req-ee9546ff-9432-4ed4-a3ff-264385335e81 service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Updating instance_info_cache with network_info: [{"id": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "address": "fa:16:3e:80:ef:28", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap6bd9a0d7-fd", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:01:42 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:01:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-dedb96d4-da27-4c52-8547-bb40fc7a05e5 req-ee9546ff-9432-4ed4-a3ff-264385335e81 service nova] Releasing lock "refresh_cache-f0f4fa14-f586-47f0-a79e-4ee095c9fb39" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:01:42 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:01:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.345s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:01:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a604f664-c7fe-437d-8338-231fb84bf5f4 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.661s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:01:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:51 user nova-compute[74342]: DEBUG nova.compute.manager [req-cc83ac69-45c0-4065-b268-d71c0e0d90fb req-18adbc36-bf8f-4a9a-8eaa-f380ba8c8282 service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Received event network-changed-a6ce3a63-d00a-4640-9b69-db6d8da564e6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:01:51 user nova-compute[74342]: DEBUG nova.compute.manager [req-cc83ac69-45c0-4065-b268-d71c0e0d90fb req-18adbc36-bf8f-4a9a-8eaa-f380ba8c8282 service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Refreshing instance network info cache due to event network-changed-a6ce3a63-d00a-4640-9b69-db6d8da564e6. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:01:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-cc83ac69-45c0-4065-b268-d71c0e0d90fb req-18adbc36-bf8f-4a9a-8eaa-f380ba8c8282 service nova] Acquiring lock "refresh_cache-ab64281f-b3fe-47ef-bd5f-796d03aa131f" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:01:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-cc83ac69-45c0-4065-b268-d71c0e0d90fb req-18adbc36-bf8f-4a9a-8eaa-f380ba8c8282 service nova] Acquired lock "refresh_cache-ab64281f-b3fe-47ef-bd5f-796d03aa131f" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:01:51 user nova-compute[74342]: DEBUG nova.network.neutron [req-cc83ac69-45c0-4065-b268-d71c0e0d90fb req-18adbc36-bf8f-4a9a-8eaa-f380ba8c8282 service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Refreshing network info cache for port a6ce3a63-d00a-4640-9b69-db6d8da564e6 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:01:51 user nova-compute[74342]: DEBUG nova.network.neutron [req-cc83ac69-45c0-4065-b268-d71c0e0d90fb req-18adbc36-bf8f-4a9a-8eaa-f380ba8c8282 service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Updated VIF entry in instance network info cache for port a6ce3a63-d00a-4640-9b69-db6d8da564e6. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:01:51 user nova-compute[74342]: DEBUG nova.network.neutron [req-cc83ac69-45c0-4065-b268-d71c0e0d90fb req-18adbc36-bf8f-4a9a-8eaa-f380ba8c8282 service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Updating instance_info_cache with network_info: [{"id": "a6ce3a63-d00a-4640-9b69-db6d8da564e6", "address": "fa:16:3e:e7:78:bf", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ce3a63-d0", "ovs_interfaceid": "a6ce3a63-d00a-4640-9b69-db6d8da564e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:01:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-cc83ac69-45c0-4065-b268-d71c0e0d90fb req-18adbc36-bf8f-4a9a-8eaa-f380ba8c8282 service nova] Releasing lock "refresh_cache-ab64281f-b3fe-47ef-bd5f-796d03aa131f" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:01:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:01:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:01:57 user nova-compute[74342]: DEBUG nova.objects.instance [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lazy-loading 'flavor' on Instance uuid ab64281f-b3fe-47ef-bd5f-796d03aa131f {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:01:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:01:57 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:01:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:01:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:01:57 user nova-compute[74342]: INFO nova.compute.manager [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Attaching volume 88c6ae97-6908-41d0-8e92-deb17396825d to /dev/vdb
Oct 16 10:01:57 user nova-compute[74342]: DEBUG os_brick.utils [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:01:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:57 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a78c83e-63bc-4cf5-b136-48109e9e517b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:57 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b3d263-5344-434d-9c9e-b82cd5fa9608]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.026s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:57 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7c7fc5b-0cfa-47e5-9a79-071f6081f7cc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:57 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[df14b236-6dbd-47c9-aac9-952553cd7c81]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:01:57 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 10:01:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:01:57 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 10:01:57 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0393d3-32fe-4340-962c-b3a07f2dc3c1]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:01:57 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 10:01:57 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 10:01:57 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 10:01:57 user nova-compute[74342]: DEBUG os_brick.utils [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:01:57 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Updating existing volume attachment record: f048a064-d25f-4a0c-90ae-c25de916c5ed {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 10:01:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:01:59 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:01:59 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:01:59 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:01:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:01:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:01:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:01:59 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:01:59 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 10:01:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab64281f-b3fe-47ef-bd5f-796d03aa131f/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab64281f-b3fe-47ef-bd5f-796d03aa131f/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab64281f-b3fe-47ef-bd5f-796d03aa131f/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:01:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab64281f-b3fe-47ef-bd5f-796d03aa131f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:01:59 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 10:01:59 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 10:01:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 10:02:01 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:02:01 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:02:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=7834MB free_disk=25.161544799804688GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:02:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:02:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:02:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 98367a96-22f0-4edb-ab03-a8eb286b437b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:02:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 4f3aa905-8eae-45cb-8019-0b991286fe42 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:02:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance d7607dcc-e70e-42fb-9421-c5f630706241 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:02:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance aa116cab-861b-459d-b1eb-6f07e5d71e30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:02:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 9dc7115b-8a02-4ef4-9d44-6590c9fded3e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:02:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance ab64281f-b3fe-47ef-bd5f-796d03aa131f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:02:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 575ff5fb-6cd7-4e84-b6de-c971129c7935 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:02:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance ee9d9ae4-a837-4c2d-b30c-5b407b959fd8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:02:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:02:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:02:02 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:02:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:02 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:02:02 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:02:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.528s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:02:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:04 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:02:04 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:02:04 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Rebuilding the list of instances to heal {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 10:02:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-98367a96-22f0-4edb-ab03-a8eb286b437b" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:02:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-98367a96-22f0-4edb-ab03-a8eb286b437b" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:02:04 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:02:04 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lazy-loading 'info_cache' on Instance uuid 98367a96-22f0-4edb-ab03-a8eb286b437b {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:02:04 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Updating instance_info_cache with network_info: [{"id": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "address": "fa:16:3e:7a:58:71", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f58c77-45", "ovs_interfaceid": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:02:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-98367a96-22f0-4edb-ab03-a8eb286b437b" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:02:04 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:02:04 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:02:04 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:02:05 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:02:05 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:02:05 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:02:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:09 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:02:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:12 user nova-compute[74342]: INFO nova.compute.manager [None req-4176c90e-1ef5-4db1-9c83-dae2a986a99e tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Get console output
Oct 16 10:02:12 user nova-compute[74342]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Oct 16 10:02:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKvVoGtd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:02:15 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:02:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:02:15 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:02:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:02:15 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c2a570f-b84a-4a28-809d-1b3a78905ad1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 10:02:15 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c7641ad-c615-49df-85dc-f67eb91f1b0b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d] added
Oct 16 10:02:15 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b11501d-080e-4f78-902b-0b26ad66d32b]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[02000b32-c9cf-42fa-8fdf-f5b30cc9e31d]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jKvVoGtd {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jKvVoGtd" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79c2e05-afeb-4992-9b7c-52003b987544]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jKvVoGtd'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b1c712-97f8-48d0-bd8f-edc3d520b743]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c7cd2a-8265-4637-a2fd-053e97b77d27]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 10:02:15 user nova-compute[74342]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)
Oct 16 10:02:15 user nova-compute[74342]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)
Oct 16 10:02:15 user nova-compute[74342]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 (non-flash)
Oct 16 10:02:15 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 10:02:15 user nova-compute[74342]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)
Oct 16 10:02:15 user nova-compute[74342]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)
Oct 16 10:02:15 user nova-compute[74342]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 (non-flash)
Oct 16 10:02:15 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67741b9-16bc-4dfd-9ce6-7f03d1ba5b34]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d, portal: 172.16.0.220,3260]
Oct 16 10:02:15 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d, portal: 172.16.0.220,3260] successful.
Oct 16 10:02:15 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfecb804-f015-4ff1-9499-a973f8048104]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc03e5dc-4c60-4113-8073-505c3fc1ad80]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 10:02:15 user nova-compute[74342]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)
Oct 16 10:02:15 user nova-compute[74342]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)
Oct 16 10:02:15 user nova-compute[74342]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 (non-flash)
Oct 16 10:02:15 user nova-compute[74342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d (non-flash)
Oct 16 10:02:15 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 10:02:15 user nova-compute[74342]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)
Oct 16 10:02:15 user nova-compute[74342]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)
Oct 16 10:02:15 user nova-compute[74342]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 (non-flash)
Oct 16 10:02:15 user nova-compute[74342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d (non-flash)
Oct 16 10:02:15 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] HCTL ('37', '-', '-', 0) found on session 31 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[59aa22b9-f93f-4db2-b4ad-3603c9402c8e]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:15 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: None {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 10:02:16 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Searching for a device in session 31 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 10:02:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKvVoGtd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 10:02:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:02:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] <== connect_volume: return (1343ms) {'type': 'block', 'scsi_wwn': '26335626633626164', 'path': '/dev/sdf'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:02:16 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335626633626164', 'path': '/dev/sdf'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 10:02:16 user nova-compute[74342]: DEBUG nova.objects.instance [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lazy-loading 'flavor' on Instance uuid ab64281f-b3fe-47ef-bd5f-796d03aa131f {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:02:16 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 10:02:16 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:02:16 user nova-compute[74342]:   <source dev="/dev/sdf"/>
Oct 16 10:02:16 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:02:16 user nova-compute[74342]:   <serial>88c6ae97-6908-41d0-8e92-deb17396825d</serial>
Oct 16 10:02:16 user nova-compute[74342]: </disk>
Oct 16 10:02:16 user nova-compute[74342]:  {{(pid=74342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 10:02:17 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:02:17 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:02:17 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] No VIF found with MAC fa:16:3e:e7:78:bf, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:02:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0534b8c0-d4c2-4ff2-9b50-f16bbb0adf20 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.693s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:02:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:02:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:02:18 user nova-compute[74342]: INFO nova.compute.manager [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Detaching volume 88c6ae97-6908-41d0-8e92-deb17396825d
Oct 16 10:02:18 user nova-compute[74342]: INFO nova.virt.block_device [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Attempting to driver detach volume 88c6ae97-6908-41d0-8e92-deb17396825d from mountpoint /dev/vdb
Oct 16 10:02:18 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Attempting to detach device vdb from instance ab64281f-b3fe-47ef-bd5f-796d03aa131f from the persistent domain config. {{(pid=74342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 10:02:18 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 10:02:18 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:02:18 user nova-compute[74342]:   <source dev="/dev/sdf"/>
Oct 16 10:02:18 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:02:18 user nova-compute[74342]:   <serial>88c6ae97-6908-41d0-8e92-deb17396825d</serial>
Oct 16 10:02:18 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 10:02:18 user nova-compute[74342]: </disk>
Oct 16 10:02:18 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 10:02:18 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Successfully detached device vdb from instance ab64281f-b3fe-47ef-bd5f-796d03aa131f from the persistent domain config.
Oct 16 10:02:18 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ab64281f-b3fe-47ef-bd5f-796d03aa131f from the live domain config. {{(pid=74342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 10:02:18 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 10:02:18 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:02:18 user nova-compute[74342]:   <source dev="/dev/sdf"/>
Oct 16 10:02:18 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:02:18 user nova-compute[74342]:   <serial>88c6ae97-6908-41d0-8e92-deb17396825d</serial>
Oct 16 10:02:18 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 10:02:18 user nova-compute[74342]: </disk>
Oct 16 10:02:18 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 10:02:18 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ab64281f-b3fe-47ef-bd5f-796d03aa131f {{(pid=74342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 10:02:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:02:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:02:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:02:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:02:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:34 user nova-compute[74342]: DEBUG nova.compute.manager [req-787a2722-6e6e-4f39-8e0e-43bbfb6848c5 req-dc6f34a9-31c0-4f56-85fc-d228dc73105e service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Received event network-changed-a82e4268-e1e1-494b-b505-2558fa7f535e {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:02:34 user nova-compute[74342]: DEBUG nova.compute.manager [req-787a2722-6e6e-4f39-8e0e-43bbfb6848c5 req-dc6f34a9-31c0-4f56-85fc-d228dc73105e service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Refreshing instance network info cache due to event network-changed-a82e4268-e1e1-494b-b505-2558fa7f535e. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:02:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-787a2722-6e6e-4f39-8e0e-43bbfb6848c5 req-dc6f34a9-31c0-4f56-85fc-d228dc73105e service nova] Acquiring lock "refresh_cache-575ff5fb-6cd7-4e84-b6de-c971129c7935" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:02:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-787a2722-6e6e-4f39-8e0e-43bbfb6848c5 req-dc6f34a9-31c0-4f56-85fc-d228dc73105e service nova] Acquired lock "refresh_cache-575ff5fb-6cd7-4e84-b6de-c971129c7935" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:02:34 user nova-compute[74342]: DEBUG nova.network.neutron [req-787a2722-6e6e-4f39-8e0e-43bbfb6848c5 req-dc6f34a9-31c0-4f56-85fc-d228dc73105e service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Refreshing network info cache for port a82e4268-e1e1-494b-b505-2558fa7f535e {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:02:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Acquiring lock "575ff5fb-6cd7-4e84-b6de-c971129c7935" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:02:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "575ff5fb-6cd7-4e84-b6de-c971129c7935" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:02:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Acquiring lock "575ff5fb-6cd7-4e84-b6de-c971129c7935-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:02:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "575ff5fb-6cd7-4e84-b6de-c971129c7935-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:02:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "575ff5fb-6cd7-4e84-b6de-c971129c7935-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:02:34 user nova-compute[74342]: INFO nova.compute.manager [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Terminating instance
Oct 16 10:02:34 user nova-compute[74342]: DEBUG nova.compute.manager [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 10:02:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:34 user nova-compute[74342]: DEBUG nova.network.neutron [req-787a2722-6e6e-4f39-8e0e-43bbfb6848c5 req-dc6f34a9-31c0-4f56-85fc-d228dc73105e service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Updated VIF entry in instance network info cache for port a82e4268-e1e1-494b-b505-2558fa7f535e. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:02:34 user nova-compute[74342]: DEBUG nova.network.neutron [req-787a2722-6e6e-4f39-8e0e-43bbfb6848c5 req-dc6f34a9-31c0-4f56-85fc-d228dc73105e service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Updating instance_info_cache with network_info: [{"id": "a82e4268-e1e1-494b-b505-2558fa7f535e", "address": "fa:16:3e:13:f1:6f", "network": {"id": "46f96b88-d08a-4f28-bcbf-a630d369074a", "bridge": "br-int", "label": "tempest-TestShelveInstance-2043632303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52331a6c86c446d7bb5e9e849eebdd18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa82e4268-e1", "ovs_interfaceid": "a82e4268-e1e1-494b-b505-2558fa7f535e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:02:34 user nova-compute[74342]: DEBUG nova.compute.manager [req-691ea058-0d65-441e-91ca-6b7ee782b6d3 req-4372af35-757f-402a-a02e-f47dd207d88c service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Received event network-vif-unplugged-a82e4268-e1e1-494b-b505-2558fa7f535e {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:02:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-691ea058-0d65-441e-91ca-6b7ee782b6d3 req-4372af35-757f-402a-a02e-f47dd207d88c service nova] Acquiring lock "575ff5fb-6cd7-4e84-b6de-c971129c7935-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:02:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-691ea058-0d65-441e-91ca-6b7ee782b6d3 req-4372af35-757f-402a-a02e-f47dd207d88c service nova] Lock "575ff5fb-6cd7-4e84-b6de-c971129c7935-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:02:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-691ea058-0d65-441e-91ca-6b7ee782b6d3 req-4372af35-757f-402a-a02e-f47dd207d88c service nova] Lock "575ff5fb-6cd7-4e84-b6de-c971129c7935-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:02:34 user nova-compute[74342]: DEBUG nova.compute.manager [req-691ea058-0d65-441e-91ca-6b7ee782b6d3 req-4372af35-757f-402a-a02e-f47dd207d88c service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] No waiting events found dispatching network-vif-unplugged-a82e4268-e1e1-494b-b505-2558fa7f535e {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:02:34 user nova-compute[74342]: DEBUG nova.compute.manager [req-691ea058-0d65-441e-91ca-6b7ee782b6d3 req-4372af35-757f-402a-a02e-f47dd207d88c service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Received event network-vif-unplugged-a82e4268-e1e1-494b-b505-2558fa7f535e for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 10:02:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-787a2722-6e6e-4f39-8e0e-43bbfb6848c5 req-dc6f34a9-31c0-4f56-85fc-d228dc73105e service nova] Releasing lock "refresh_cache-575ff5fb-6cd7-4e84-b6de-c971129c7935" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:02:35 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Instance destroyed successfully.
Oct 16 10:02:35 user nova-compute[74342]: DEBUG nova.objects.instance [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lazy-loading 'resources' on Instance uuid 575ff5fb-6cd7-4e84-b6de-c971129c7935 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T09:56:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-359637512',display_name='tempest-TestShelveInstance-server-359637512',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-359637512',id=29,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBlgdxAD7+2/8I5Bmwwuxc9f9iE6qWVwSxmtHBDMK1V+4lFb8ymmohLRVrvUFwuOB4SKQFH8KIs71Bp4myXAMERD+6XX8zG+ywxbtrHDK1mSRcDXhNmnUm0DIioqGZROew==',key_name='tempest-TestShelveInstance-223238522',keypairs=<?>,launch_index=0,launched_at=2023-10-16T10:01:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='52331a6c86c446d7bb5e9e849eebdd18',ramdisk_id='',reservation_id='r-8avw62ul',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-1417500607',owner_user_name='tempest-TestShelveInstance-1417500607-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T10:01:17Z,user_data=None,user_id='8b8ad29a34c84e95ac5513c5a670a753',uuid=575ff5fb-6cd7-4e84-b6de-c971129c7935,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a82e4268-e1e1-494b-b505-2558fa7f535e", "address": "fa:16:3e:13:f1:6f", "network": {"id": "46f96b88-d08a-4f28-bcbf-a630d369074a", "bridge": "br-int", "label": "tempest-TestShelveInstance-2043632303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52331a6c86c446d7bb5e9e849eebdd18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa82e4268-e1", "ovs_interfaceid": "a82e4268-e1e1-494b-b505-2558fa7f535e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Converting VIF {"id": "a82e4268-e1e1-494b-b505-2558fa7f535e", "address": "fa:16:3e:13:f1:6f", "network": {"id": "46f96b88-d08a-4f28-bcbf-a630d369074a", "bridge": "br-int", "label": "tempest-TestShelveInstance-2043632303-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "52331a6c86c446d7bb5e9e849eebdd18", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa82e4268-e1", "ovs_interfaceid": "a82e4268-e1e1-494b-b505-2558fa7f535e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:f1:6f,bridge_name='br-int',has_traffic_filtering=True,id=a82e4268-e1e1-494b-b505-2558fa7f535e,network=Network(46f96b88-d08a-4f28-bcbf-a630d369074a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa82e4268-e1') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG os_vif [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:f1:6f,bridge_name='br-int',has_traffic_filtering=True,id=a82e4268-e1e1-494b-b505-2558fa7f535e,network=Network(46f96b88-d08a-4f28-bcbf-a630d369074a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa82e4268-e1') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa82e4268-e1, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=97538455-5a50-4042-ad37-1d85e6986174) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:02:35 user nova-compute[74342]: INFO os_vif [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:f1:6f,bridge_name='br-int',has_traffic_filtering=True,id=a82e4268-e1e1-494b-b505-2558fa7f535e,network=Network(46f96b88-d08a-4f28-bcbf-a630d369074a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa82e4268-e1')
Oct 16 10:02:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fdvWcJrY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:02:35 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:02:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db5420a-53d1-457d-ae80-5c1aa66be922]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 10:02:35 user nova-compute[74342]: No targets found.
Oct 16 10:02:35 user nova-compute[74342]: iSNS:
Oct 16 10:02:35 user nova-compute[74342]: No targets found.
Oct 16 10:02:35 user nova-compute[74342]: STATIC:
Oct 16 10:02:35 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519
Oct 16 10:02:35 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:02:35 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:02:35 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f
Oct 16 10:02:35 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:02:35 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:02:35 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342
Oct 16 10:02:35 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:02:35 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:02:35 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8
Oct 16 10:02:35 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:02:35 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:02:35 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d
Oct 16 10:02:35 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:02:35 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:02:35 user nova-compute[74342]: FIRMWARE:
Oct 16 10:02:35 user nova-compute[74342]: No targets found.
Oct 16 10:02:35 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 10:02:35 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 10:02:35 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a67abc-b447-421f-80d4-4f36fc72eceb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c1010d6-975c-4c4a-87c6-275a65f5e1a9]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 10:02:35 user nova-compute[74342]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)
Oct 16 10:02:35 user nova-compute[74342]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)
Oct 16 10:02:35 user nova-compute[74342]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 (non-flash)
Oct 16 10:02:35 user nova-compute[74342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d (non-flash)
Oct 16 10:02:35 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 10:02:35 user nova-compute[74342]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)
Oct 16 10:02:35 user nova-compute[74342]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f (non-flash)
Oct 16 10:02:35 user nova-compute[74342]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 (non-flash)
Oct 16 10:02:35 user nova-compute[74342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d (non-flash)
Oct 16 10:02:35 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b60268550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f'): ({'sdd'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Removing single pathed devices sdd {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a52f2ef-a221-4769-ae48-39c18afe6bc8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e97b09f-7611-4ca7-868b-4baca457c097]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Flushing IO for device /dev/sdd {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8123ac3-6749-4790-a22d-c2462b5dc8b8]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[263b59d3-e850-4237-aa43-b0e604e67acd]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] SCSI volumes sdd have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39bd90b-5f08-49d1-8fcd-fd57e002bdb3]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --logout" returned: 0 in 0.081s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b165c8-4e2e-475c-a67c-ed64354a89bd]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f, portal: 172.16.0.220,3260]
Oct 16 10:02:35 user nova-compute[74342]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f, portal: 172.16.0.220,3260] successful.
Oct 16 10:02:35 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fe9beb-cfb8-452d-8f97-249915dd854f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d31eb40-d645-46a5-95e5-9531735936c1]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] <== disconnect_volume: return (345ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 10:02:35 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Deleting instance files /opt/stack/data/nova/instances/575ff5fb-6cd7-4e84-b6de-c971129c7935_del
Oct 16 10:02:35 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Deletion of /opt/stack/data/nova/instances/575ff5fb-6cd7-4e84-b6de-c971129c7935_del complete
Oct 16 10:02:35 user nova-compute[74342]: INFO nova.compute.manager [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Took 1.24 seconds to destroy the instance on the hypervisor.
Oct 16 10:02:35 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 10:02:35 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 10:02:36 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:02:36 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Took 0.80 seconds to deallocate network for instance.
Oct 16 10:02:36 user nova-compute[74342]: DEBUG nova.compute.manager [req-de00c184-03d4-4caa-9494-252e5aa803a4 req-bb0431d9-7730-48f9-bd84-fb9ba4b7a95b service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Received event network-vif-deleted-a82e4268-e1e1-494b-b505-2558fa7f535e {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:02:36 user nova-compute[74342]: INFO nova.compute.manager [req-de00c184-03d4-4caa-9494-252e5aa803a4 req-bb0431d9-7730-48f9-bd84-fb9ba4b7a95b service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Neutron deleted interface a82e4268-e1e1-494b-b505-2558fa7f535e; detaching it from the instance and deleting it from the info cache
Oct 16 10:02:36 user nova-compute[74342]: DEBUG nova.network.neutron [req-de00c184-03d4-4caa-9494-252e5aa803a4 req-bb0431d9-7730-48f9-bd84-fb9ba4b7a95b service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:02:36 user nova-compute[74342]: DEBUG nova.compute.manager [req-de00c184-03d4-4caa-9494-252e5aa803a4 req-bb0431d9-7730-48f9-bd84-fb9ba4b7a95b service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Detach interface failed, port_id=a82e4268-e1e1-494b-b505-2558fa7f535e, reason: Instance 575ff5fb-6cd7-4e84-b6de-c971129c7935 could not be found. {{(pid=74342) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 10:02:36 user nova-compute[74342]: DEBUG nova.compute.manager [req-89944468-4d4f-49d6-bb7b-1b95b3b0c845 req-1711f21a-c583-4b08-8ee1-6ff39d46cf3a service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Received event network-vif-plugged-a82e4268-e1e1-494b-b505-2558fa7f535e {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:02:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-89944468-4d4f-49d6-bb7b-1b95b3b0c845 req-1711f21a-c583-4b08-8ee1-6ff39d46cf3a service nova] Acquiring lock "575ff5fb-6cd7-4e84-b6de-c971129c7935-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:02:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-89944468-4d4f-49d6-bb7b-1b95b3b0c845 req-1711f21a-c583-4b08-8ee1-6ff39d46cf3a service nova] Lock "575ff5fb-6cd7-4e84-b6de-c971129c7935-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:02:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-89944468-4d4f-49d6-bb7b-1b95b3b0c845 req-1711f21a-c583-4b08-8ee1-6ff39d46cf3a service nova] Lock "575ff5fb-6cd7-4e84-b6de-c971129c7935-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:02:36 user nova-compute[74342]: DEBUG nova.compute.manager [req-89944468-4d4f-49d6-bb7b-1b95b3b0c845 req-1711f21a-c583-4b08-8ee1-6ff39d46cf3a service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] No waiting events found dispatching network-vif-plugged-a82e4268-e1e1-494b-b505-2558fa7f535e {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:02:36 user nova-compute[74342]: WARNING nova.compute.manager [req-89944468-4d4f-49d6-bb7b-1b95b3b0c845 req-1711f21a-c583-4b08-8ee1-6ff39d46cf3a service nova] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Received unexpected event network-vif-plugged-a82e4268-e1e1-494b-b505-2558fa7f535e for instance with vm_state active and task_state deleting.
Oct 16 10:02:37 user nova-compute[74342]: INFO nova.compute.manager [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Took 0.96 seconds to detach 1 volumes for instance.
Oct 16 10:02:37 user nova-compute[74342]: DEBUG nova.compute.manager [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] [instance: 575ff5fb-6cd7-4e84-b6de-c971129c7935] Deleting volume: 85fe9beb-cfb8-452d-8f97-249915dd854f {{(pid=74342) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 16 10:02:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:02:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:02:37 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:02:37 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:02:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.274s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:02:37 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Deleted allocations for instance 575ff5fb-6cd7-4e84-b6de-c971129c7935
Oct 16 10:02:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b6d6442a-9587-4106-abf2-02aaeabe6766 tempest-TestShelveInstance-1417500607 tempest-TestShelveInstance-1417500607-project-member] Lock "575ff5fb-6cd7-4e84-b6de-c971129c7935" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.548s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:02:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:38 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ab64281f-b3fe-47ef-bd5f-796d03aa131f is timed out.
Oct 16 10:02:38 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Successfully detached device vdb from instance ab64281f-b3fe-47ef-bd5f-796d03aa131f from the live domain config.
Oct 16 10:02:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 10:02:38 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jKvVoGtd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:02:38 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:02:38 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:02:38 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:02:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:38 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ad8c7f-ae46-4644-8fad-dc0bdbcd34d8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:38 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 10:02:38 user nova-compute[74342]: No targets found.
Oct 16 10:02:38 user nova-compute[74342]: iSNS:
Oct 16 10:02:38 user nova-compute[74342]: No targets found.
Oct 16 10:02:38 user nova-compute[74342]: STATIC:
Oct 16 10:02:38 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519
Oct 16 10:02:38 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:02:38 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:02:38 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342
Oct 16 10:02:38 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:02:38 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:02:38 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8
Oct 16 10:02:38 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:02:38 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:02:38 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d
Oct 16 10:02:38 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:02:38 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:02:38 user nova-compute[74342]: FIRMWARE:
Oct 16 10:02:38 user nova-compute[74342]: No targets found.
Oct 16 10:02:38 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:02:38 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 10:02:38 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 10:02:38 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 10:02:38 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 10:02:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:38 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e528bbb1-8f1b-47cb-b038-0679179fcfea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1130cf97-e5b4-4d6a-b9d2-6664281cbb54]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 10:02:39 user nova-compute[74342]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)
Oct 16 10:02:39 user nova-compute[74342]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 (non-flash)
Oct 16 10:02:39 user nova-compute[74342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d (non-flash)
Oct 16 10:02:39 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 10:02:39 user nova-compute[74342]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)
Oct 16 10:02:39 user nova-compute[74342]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 (non-flash)
Oct 16 10:02:39 user nova-compute[74342]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d (non-flash)
Oct 16 10:02:39 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b60194550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d'): ({'sdf'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Removing single pathed devices sdf {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[de339d4b-9840-408f-8384-5e9d620e730c]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[806dea03-493c-4130-967c-31a40a49bac3]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Flushing IO for device /dev/sdf {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fadcbb-bbc2-4cc7-b440-003294dc467d]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.043s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d177c6a-cf3f-4366-814e-349de9ce066c]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] SCSI volumes sdf have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[002e9b21-9ffa-488a-a0b8-ca6a647966e4]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a08da0e7-625a-4bc6-afc9-2690cc98e23c tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "4f3aa905-8eae-45cb-8019-0b991286fe42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a08da0e7-625a-4bc6-afc9-2690cc98e23c tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a08da0e7-625a-4bc6-afc9-2690cc98e23c tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a08da0e7-625a-4bc6-afc9-2690cc98e23c tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a08da0e7-625a-4bc6-afc9-2690cc98e23c tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:02:39 user nova-compute[74342]: INFO nova.compute.manager [None req-a08da0e7-625a-4bc6-afc9-2690cc98e23c tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Terminating instance
Oct 16 10:02:39 user nova-compute[74342]: DEBUG nova.compute.manager [None req-a08da0e7-625a-4bc6-afc9-2690cc98e23c tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6814f1dd-cbe7-4c80-8902-6f0f9bd164b3]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d, portal: 172.16.0.220,3260]
Oct 16 10:02:39 user nova-compute[74342]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d, portal: 172.16.0.220,3260] successful.
Oct 16 10:02:39 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:88c6ae97-6908-41d0-8e92-deb17396825d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7cd902e-5c4f-479a-a0da-8416e2ec52d4]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] <== disconnect_volume: return (341ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG nova.compute.manager [req-a3411243-e1f0-4df9-9030-d105482c47c6 req-18c3a2f7-1757-4971-b96c-a2f684a034e9 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Received event network-vif-unplugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a3411243-e1f0-4df9-9030-d105482c47c6 req-18c3a2f7-1757-4971-b96c-a2f684a034e9 service nova] Acquiring lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a3411243-e1f0-4df9-9030-d105482c47c6 req-18c3a2f7-1757-4971-b96c-a2f684a034e9 service nova] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a3411243-e1f0-4df9-9030-d105482c47c6 req-18c3a2f7-1757-4971-b96c-a2f684a034e9 service nova] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG nova.compute.manager [req-a3411243-e1f0-4df9-9030-d105482c47c6 req-18c3a2f7-1757-4971-b96c-a2f684a034e9 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] No waiting events found dispatching network-vif-unplugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG nova.compute.manager [req-a3411243-e1f0-4df9-9030-d105482c47c6 req-18c3a2f7-1757-4971-b96c-a2f684a034e9 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Received event network-vif-unplugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:39 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Instance destroyed successfully.
Oct 16 10:02:39 user nova-compute[74342]: DEBUG nova.objects.instance [None req-a08da0e7-625a-4bc6-afc9-2690cc98e23c tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'resources' on Instance uuid 4f3aa905-8eae-45cb-8019-0b991286fe42 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-a08da0e7-625a-4bc6-afc9-2690cc98e23c tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:52:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1589424972',display_name='tempest-AttachVolumeTestJSON-server-1589424972',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1589424972',id=24,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBO8M7UyZeyQg1aYm+ByuTDEoeaBTTsQAFljuagcRlcGDhfx2FLzwqTOwmYqO1+0IHWLuSXoneV6tc1mCRPSiL9W+Jq0YYyfdyDE26TRgq7GChyXwYOsK9694M/+yJ6Kw==',key_name='tempest-keypair-1616245480',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:52:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c28511c6c42147db9a0992cf40e044bb',ramdisk_id='',reservation_id='r-tipl03lh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-965713551',owner_user_name='tempest-AttachVolumeTestJSON-965713551-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T10:00:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc0dfbfdb77347cda95ba991d37c311d',uuid=4f3aa905-8eae-45cb-8019-0b991286fe42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "address": "fa:16:3e:82:00:ac", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4258aa-96", "ovs_interfaceid": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-a08da0e7-625a-4bc6-afc9-2690cc98e23c tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Converting VIF {"id": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "address": "fa:16:3e:82:00:ac", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.220", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0e4258aa-96", "ovs_interfaceid": "0e4258aa-9686-4cf1-9d1a-5bf61e7ba193", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-a08da0e7-625a-4bc6-afc9-2690cc98e23c tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:00:ac,bridge_name='br-int',has_traffic_filtering=True,id=0e4258aa-9686-4cf1-9d1a-5bf61e7ba193,network=Network(54ba0b2e-1a1f-44a4-ba26-8a96960d4165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e4258aa-96') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG os_vif [None req-a08da0e7-625a-4bc6-afc9-2690cc98e23c tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:00:ac,bridge_name='br-int',has_traffic_filtering=True,id=0e4258aa-9686-4cf1-9d1a-5bf61e7ba193,network=Network(54ba0b2e-1a1f-44a4-ba26-8a96960d4165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e4258aa-96') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0e4258aa-96, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0a6e906b-83bf-494d-b3b8-a5f6d300a828) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:02:39 user nova-compute[74342]: INFO os_vif [None req-a08da0e7-625a-4bc6-afc9-2690cc98e23c tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:00:ac,bridge_name='br-int',has_traffic_filtering=True,id=0e4258aa-9686-4cf1-9d1a-5bf61e7ba193,network=Network(54ba0b2e-1a1f-44a4-ba26-8a96960d4165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0e4258aa-96')
Oct 16 10:02:39 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-a08da0e7-625a-4bc6-afc9-2690cc98e23c tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Deleting instance files /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42_del
Oct 16 10:02:39 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-a08da0e7-625a-4bc6-afc9-2690cc98e23c tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Deletion of /opt/stack/data/nova/instances/4f3aa905-8eae-45cb-8019-0b991286fe42_del complete
Oct 16 10:02:39 user nova-compute[74342]: INFO nova.compute.manager [None req-a08da0e7-625a-4bc6-afc9-2690cc98e23c tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Took 0.70 seconds to destroy the instance on the hypervisor.
Oct 16 10:02:39 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-a08da0e7-625a-4bc6-afc9-2690cc98e23c tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 10:02:39 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 10:02:40 user nova-compute[74342]: DEBUG nova.objects.instance [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lazy-loading 'flavor' on Instance uuid ab64281f-b3fe-47ef-bd5f-796d03aa131f {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:02:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9eed9fbe-06b9-44bb-8bf5-324348592aa2 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.817s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:02:40 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:02:40 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Took 0.66 seconds to deallocate network for instance.
Oct 16 10:02:40 user nova-compute[74342]: DEBUG nova.compute.manager [req-5f38a70a-51e1-4b12-a2f8-0ef095a83b52 req-6b645a73-0e03-4598-bff6-81f15baca2ff service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Received event network-vif-deleted-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:02:40 user nova-compute[74342]: INFO nova.compute.manager [req-5f38a70a-51e1-4b12-a2f8-0ef095a83b52 req-6b645a73-0e03-4598-bff6-81f15baca2ff service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Neutron deleted interface 0e4258aa-9686-4cf1-9d1a-5bf61e7ba193; detaching it from the instance and deleting it from the info cache
Oct 16 10:02:40 user nova-compute[74342]: DEBUG nova.network.neutron [req-5f38a70a-51e1-4b12-a2f8-0ef095a83b52 req-6b645a73-0e03-4598-bff6-81f15baca2ff service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:02:40 user nova-compute[74342]: DEBUG nova.compute.manager [req-5f38a70a-51e1-4b12-a2f8-0ef095a83b52 req-6b645a73-0e03-4598-bff6-81f15baca2ff service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Detach interface failed, port_id=0e4258aa-9686-4cf1-9d1a-5bf61e7ba193, reason: Instance 4f3aa905-8eae-45cb-8019-0b991286fe42 could not be found. {{(pid=74342) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 10:02:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a08da0e7-625a-4bc6-afc9-2690cc98e23c tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:02:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a08da0e7-625a-4bc6-afc9-2690cc98e23c tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:02:40 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-a08da0e7-625a-4bc6-afc9-2690cc98e23c tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:02:40 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-a08da0e7-625a-4bc6-afc9-2690cc98e23c tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:02:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a08da0e7-625a-4bc6-afc9-2690cc98e23c tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.282s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:02:40 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-a08da0e7-625a-4bc6-afc9-2690cc98e23c tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Deleted allocations for instance 4f3aa905-8eae-45cb-8019-0b991286fe42
Oct 16 10:02:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a08da0e7-625a-4bc6-afc9-2690cc98e23c tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.842s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:02:41 user nova-compute[74342]: DEBUG nova.compute.manager [req-9e4c9916-a17f-487e-a422-bc1a376581a3 req-ba08b1c0-1105-4750-8a64-61dacd5497e5 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Received event network-vif-plugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:02:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9e4c9916-a17f-487e-a422-bc1a376581a3 req-ba08b1c0-1105-4750-8a64-61dacd5497e5 service nova] Acquiring lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:02:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9e4c9916-a17f-487e-a422-bc1a376581a3 req-ba08b1c0-1105-4750-8a64-61dacd5497e5 service nova] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:02:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9e4c9916-a17f-487e-a422-bc1a376581a3 req-ba08b1c0-1105-4750-8a64-61dacd5497e5 service nova] Lock "4f3aa905-8eae-45cb-8019-0b991286fe42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:02:41 user nova-compute[74342]: DEBUG nova.compute.manager [req-9e4c9916-a17f-487e-a422-bc1a376581a3 req-ba08b1c0-1105-4750-8a64-61dacd5497e5 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] No waiting events found dispatching network-vif-plugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:02:41 user nova-compute[74342]: WARNING nova.compute.manager [req-9e4c9916-a17f-487e-a422-bc1a376581a3 req-ba08b1c0-1105-4750-8a64-61dacd5497e5 service nova] [instance: 4f3aa905-8eae-45cb-8019-0b991286fe42] Received unexpected event network-vif-plugged-0e4258aa-9686-4cf1-9d1a-5bf61e7ba193 for instance with vm_state deleted and task_state None.
Oct 16 10:02:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:02:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:02:54 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:02:59 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:02:59 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:02:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:02:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:02:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:02:59 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:02:59 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 10:02:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab64281f-b3fe-47ef-bd5f-796d03aa131f/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab64281f-b3fe-47ef-bd5f-796d03aa131f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab64281f-b3fe-47ef-bd5f-796d03aa131f/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:02:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:02:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab64281f-b3fe-47ef-bd5f-796d03aa131f/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:02:59 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 10:02:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:00 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 10:03:01 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:03:01 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:03:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8167MB free_disk=25.18720245361328GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:03:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 98367a96-22f0-4edb-ab03-a8eb286b437b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:03:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance d7607dcc-e70e-42fb-9421-c5f630706241 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:03:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance aa116cab-861b-459d-b1eb-6f07e5d71e30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:03:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 9dc7115b-8a02-4ef4-9d44-6590c9fded3e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:03:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance ab64281f-b3fe-47ef-bd5f-796d03aa131f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:03:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance ee9d9ae4-a837-4c2d-b30c-5b407b959fd8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:03:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:03:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:03:01 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:03:01 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:03:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:03:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.378s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:01 user nova-compute[74342]: DEBUG nova.compute.manager [req-fd1b19fc-3539-45a1-930f-2f4b5c7da785 req-78128982-510b-4554-8b50-071d15b71d19 service nova] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Received event network-changed-732bad9e-7c6d-402d-821d-96221d6cb069 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:03:01 user nova-compute[74342]: DEBUG nova.compute.manager [req-fd1b19fc-3539-45a1-930f-2f4b5c7da785 req-78128982-510b-4554-8b50-071d15b71d19 service nova] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Refreshing instance network info cache due to event network-changed-732bad9e-7c6d-402d-821d-96221d6cb069. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:03:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-fd1b19fc-3539-45a1-930f-2f4b5c7da785 req-78128982-510b-4554-8b50-071d15b71d19 service nova] Acquiring lock "refresh_cache-ee9d9ae4-a837-4c2d-b30c-5b407b959fd8" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:03:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-fd1b19fc-3539-45a1-930f-2f4b5c7da785 req-78128982-510b-4554-8b50-071d15b71d19 service nova] Acquired lock "refresh_cache-ee9d9ae4-a837-4c2d-b30c-5b407b959fd8" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:03:01 user nova-compute[74342]: DEBUG nova.network.neutron [req-fd1b19fc-3539-45a1-930f-2f4b5c7da785 req-78128982-510b-4554-8b50-071d15b71d19 service nova] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Refreshing network info cache for port 732bad9e-7c6d-402d-821d-96221d6cb069 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:03:02 user nova-compute[74342]: DEBUG nova.network.neutron [req-fd1b19fc-3539-45a1-930f-2f4b5c7da785 req-78128982-510b-4554-8b50-071d15b71d19 service nova] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Updated VIF entry in instance network info cache for port 732bad9e-7c6d-402d-821d-96221d6cb069. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:03:02 user nova-compute[74342]: DEBUG nova.network.neutron [req-fd1b19fc-3539-45a1-930f-2f4b5c7da785 req-78128982-510b-4554-8b50-071d15b71d19 service nova] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Updating instance_info_cache with network_info: [{"id": "732bad9e-7c6d-402d-821d-96221d6cb069", "address": "fa:16:3e:18:28:3a", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap732bad9e-7c", "ovs_interfaceid": "732bad9e-7c6d-402d-821d-96221d6cb069", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:03:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-fd1b19fc-3539-45a1-930f-2f4b5c7da785 req-78128982-510b-4554-8b50-071d15b71d19 service nova] Releasing lock "refresh_cache-ee9d9ae4-a837-4c2d-b30c-5b407b959fd8" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:03:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "ee9d9ae4-a837-4c2d-b30c-5b407b959fd8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "ee9d9ae4-a837-4c2d-b30c-5b407b959fd8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "ee9d9ae4-a837-4c2d-b30c-5b407b959fd8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "ee9d9ae4-a837-4c2d-b30c-5b407b959fd8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "ee9d9ae4-a837-4c2d-b30c-5b407b959fd8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:02 user nova-compute[74342]: INFO nova.compute.manager [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Terminating instance
Oct 16 10:03:02 user nova-compute[74342]: DEBUG nova.compute.manager [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 10:03:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:02 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:03:02 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:03:02 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:03:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-c2242b49-9726-4de4-b28b-75d7bda6d4b4 req-092aa425-ef15-4450-92d9-3c206d61da50 service nova] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Received event network-vif-unplugged-732bad9e-7c6d-402d-821d-96221d6cb069 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:03:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c2242b49-9726-4de4-b28b-75d7bda6d4b4 req-092aa425-ef15-4450-92d9-3c206d61da50 service nova] Acquiring lock "ee9d9ae4-a837-4c2d-b30c-5b407b959fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c2242b49-9726-4de4-b28b-75d7bda6d4b4 req-092aa425-ef15-4450-92d9-3c206d61da50 service nova] Lock "ee9d9ae4-a837-4c2d-b30c-5b407b959fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c2242b49-9726-4de4-b28b-75d7bda6d4b4 req-092aa425-ef15-4450-92d9-3c206d61da50 service nova] Lock "ee9d9ae4-a837-4c2d-b30c-5b407b959fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-c2242b49-9726-4de4-b28b-75d7bda6d4b4 req-092aa425-ef15-4450-92d9-3c206d61da50 service nova] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] No waiting events found dispatching network-vif-unplugged-732bad9e-7c6d-402d-821d-96221d6cb069 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:03:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-c2242b49-9726-4de4-b28b-75d7bda6d4b4 req-092aa425-ef15-4450-92d9-3c206d61da50 service nova] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Received event network-vif-unplugged-732bad9e-7c6d-402d-821d-96221d6cb069 for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 10:03:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:03 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Instance destroyed successfully.
Oct 16 10:03:03 user nova-compute[74342]: DEBUG nova.objects.instance [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lazy-loading 'resources' on Instance uuid ee9d9ae4-a837-4c2d-b30c-5b407b959fd8 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:01:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-936037188',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-936037188',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-936037188',id=35,image_ref='28233b7c-daa5-4f1c-8989-5ba47a287f69',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOdY1hlBlWcNbifkK4os30+lDuH238DtycW7BtW4z5t4LT1tZW36yQ++VkIIktGKWb1Olpg8RqekD7cAifrnZG6scbA3jh5E7+jEJ7QjDV0MYgvat0Q9cMKq9FWYpztC5g==',key_name='tempest-keypair-1727954659',keypairs=<?>,launch_index=0,launched_at=2023-10-16T10:01:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='799c265b3d14465a9ca6bd7d5e8a4488',ramdisk_id='',reservation_id='r-nfi9ibh8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-158744824',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-158744824-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-158744824',owner_user_name='tempest-TestVolumeBootPattern-158744824-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T10:01:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cac31e799b743359b93943b68b38acf',uuid=ee9d9ae4-a837-4c2d-b30c-5b407b959fd8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "732bad9e-7c6d-402d-821d-96221d6cb069", "address": "fa:16:3e:18:28:3a", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap732bad9e-7c", "ovs_interfaceid": "732bad9e-7c6d-402d-821d-96221d6cb069", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converting VIF {"id": "732bad9e-7c6d-402d-821d-96221d6cb069", "address": "fa:16:3e:18:28:3a", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.74", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap732bad9e-7c", "ovs_interfaceid": "732bad9e-7c6d-402d-821d-96221d6cb069", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:18:28:3a,bridge_name='br-int',has_traffic_filtering=True,id=732bad9e-7c6d-402d-821d-96221d6cb069,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap732bad9e-7c') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG os_vif [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:28:3a,bridge_name='br-int',has_traffic_filtering=True,id=732bad9e-7c6d-402d-821d-96221d6cb069,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap732bad9e-7c') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap732bad9e-7c, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=be319b1a-de62-40f3-8cfb-6e69b97daf31) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:03:03 user nova-compute[74342]: INFO os_vif [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:18:28:3a,bridge_name='br-int',has_traffic_filtering=True,id=732bad9e-7c6d-402d-821d-96221d6cb069,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap732bad9e-7c')
Oct 16 10:03:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mZlqxVvz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:03:03 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:03:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[03467600-f01d-4648-bb38-bec0efd0d68c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 10:03:03 user nova-compute[74342]: No targets found.
Oct 16 10:03:03 user nova-compute[74342]: iSNS:
Oct 16 10:03:03 user nova-compute[74342]: No targets found.
Oct 16 10:03:03 user nova-compute[74342]: STATIC:
Oct 16 10:03:03 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519
Oct 16 10:03:03 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:03:03 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:03:03 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342
Oct 16 10:03:03 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:03:03 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:03:03 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8
Oct 16 10:03:03 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:03:03 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:03:03 user nova-compute[74342]: FIRMWARE:
Oct 16 10:03:03 user nova-compute[74342]: No targets found.
Oct 16 10:03:03 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 10:03:03 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 10:03:03 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1842641-09bb-4fb2-ac2f-6bd2e14a2de0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0669eb2-b770-4f80-9bb1-729830304b50]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 10:03:03 user nova-compute[74342]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)
Oct 16 10:03:03 user nova-compute[74342]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 (non-flash)
Oct 16 10:03:03 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 10:03:03 user nova-compute[74342]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)
Oct 16 10:03:03 user nova-compute[74342]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 (non-flash)
Oct 16 10:03:03 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b80583a30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519'): ({'sde'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Removing single pathed devices sde {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc868495-6956-4308-83fb-68f37f430fd1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6dd6e0f-c281-41b0-afc3-74d659d6aa78]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Flushing IO for device /dev/sde {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a1b2ed3-2572-40db-a06d-34e407c41140]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab8c76b-d5cf-4707-9eae-6cb8148740d5]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] SCSI volumes sde have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b3b90b-b058-41fb-810d-09e370e94008]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d3d11a-cb58-4f08-b010-4647b82877e0]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519, portal: 172.16.0.220,3260]
Oct 16 10:03:03 user nova-compute[74342]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519, portal: 172.16.0.220,3260] successful.
Oct 16 10:03:03 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4e13777c-162c-4074-b176-4d1998cd5519 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15eb7aa-1778-495b-92e6-c6453d022a8a]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] <== disconnect_volume: return (315ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 10:03:03 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Deleting instance files /opt/stack/data/nova/instances/ee9d9ae4-a837-4c2d-b30c-5b407b959fd8_del
Oct 16 10:03:03 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Deletion of /opt/stack/data/nova/instances/ee9d9ae4-a837-4c2d-b30c-5b407b959fd8_del complete
Oct 16 10:03:03 user nova-compute[74342]: INFO nova.compute.manager [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Took 1.19 seconds to destroy the instance on the hypervisor.
Oct 16 10:03:03 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 10:03:03 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 10:03:04 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:03:04 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Took 0.61 seconds to deallocate network for instance.
Oct 16 10:03:04 user nova-compute[74342]: DEBUG nova.compute.manager [req-4eb27244-fcfc-42c5-bfc0-714f4f47e340 req-f610b433-0bad-4a3f-85c4-64aeff98f426 service nova] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Received event network-vif-deleted-732bad9e-7c6d-402d-821d-96221d6cb069 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:03:04 user nova-compute[74342]: INFO nova.compute.manager [req-4eb27244-fcfc-42c5-bfc0-714f4f47e340 req-f610b433-0bad-4a3f-85c4-64aeff98f426 service nova] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Neutron deleted interface 732bad9e-7c6d-402d-821d-96221d6cb069; detaching it from the instance and deleting it from the info cache
Oct 16 10:03:04 user nova-compute[74342]: DEBUG nova.network.neutron [req-4eb27244-fcfc-42c5-bfc0-714f4f47e340 req-f610b433-0bad-4a3f-85c4-64aeff98f426 service nova] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:03:04 user nova-compute[74342]: DEBUG nova.compute.manager [req-4eb27244-fcfc-42c5-bfc0-714f4f47e340 req-f610b433-0bad-4a3f-85c4-64aeff98f426 service nova] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Detach interface failed, port_id=732bad9e-7c6d-402d-821d-96221d6cb069, reason: Instance ee9d9ae4-a837-4c2d-b30c-5b407b959fd8 could not be found. {{(pid=74342) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 10:03:04 user nova-compute[74342]: DEBUG nova.compute.manager [req-f342390e-4ec0-4f4b-bd9c-a6e09ae63c0d req-8a3b1fbe-2ddc-4941-b380-d24abdb9f5c0 service nova] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Received event network-vif-plugged-732bad9e-7c6d-402d-821d-96221d6cb069 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:03:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f342390e-4ec0-4f4b-bd9c-a6e09ae63c0d req-8a3b1fbe-2ddc-4941-b380-d24abdb9f5c0 service nova] Acquiring lock "ee9d9ae4-a837-4c2d-b30c-5b407b959fd8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f342390e-4ec0-4f4b-bd9c-a6e09ae63c0d req-8a3b1fbe-2ddc-4941-b380-d24abdb9f5c0 service nova] Lock "ee9d9ae4-a837-4c2d-b30c-5b407b959fd8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f342390e-4ec0-4f4b-bd9c-a6e09ae63c0d req-8a3b1fbe-2ddc-4941-b380-d24abdb9f5c0 service nova] Lock "ee9d9ae4-a837-4c2d-b30c-5b407b959fd8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:04 user nova-compute[74342]: DEBUG nova.compute.manager [req-f342390e-4ec0-4f4b-bd9c-a6e09ae63c0d req-8a3b1fbe-2ddc-4941-b380-d24abdb9f5c0 service nova] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] No waiting events found dispatching network-vif-plugged-732bad9e-7c6d-402d-821d-96221d6cb069 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:03:04 user nova-compute[74342]: WARNING nova.compute.manager [req-f342390e-4ec0-4f4b-bd9c-a6e09ae63c0d req-8a3b1fbe-2ddc-4941-b380-d24abdb9f5c0 service nova] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Received unexpected event network-vif-plugged-732bad9e-7c6d-402d-821d-96221d6cb069 for instance with vm_state active and task_state deleting.
Oct 16 10:03:04 user nova-compute[74342]: INFO nova.compute.manager [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Took 0.78 seconds to detach 1 volumes for instance.
Oct 16 10:03:04 user nova-compute[74342]: DEBUG nova.compute.manager [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ee9d9ae4-a837-4c2d-b30c-5b407b959fd8] Deleting volume: 4e13777c-162c-4074-b176-4d1998cd5519 {{(pid=74342) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 16 10:03:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:05 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:03:05 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:03:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.219s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:05 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Deleted allocations for instance ee9d9ae4-a837-4c2d-b30c-5b407b959fd8
Oct 16 10:03:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ba972123-8489-4756-858b-679d29e3257c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "ee9d9ae4-a837-4c2d-b30c-5b407b959fd8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.058s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:05 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:03:05 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:03:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-aa116cab-861b-459d-b1eb-6f07e5d71e30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:03:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-aa116cab-861b-459d-b1eb-6f07e5d71e30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:03:05 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:03:05 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Updating instance_info_cache with network_info: [{"id": "480ecd6b-63b3-43be-8c76-98216f55e06a", "address": "fa:16:3e:5c:87:e5", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480ecd6b-63", "ovs_interfaceid": "480ecd6b-63b3-43be-8c76-98216f55e06a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:03:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-aa116cab-861b-459d-b1eb-6f07e5d71e30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:03:05 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:03:05 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:03:05 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:03:06 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:03:06 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:03:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-eef23918-4487-4c60-9a81-9bdd3da07832 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-eef23918-4487-4c60-9a81-9bdd3da07832 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-eef23918-4487-4c60-9a81-9bdd3da07832 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-eef23918-4487-4c60-9a81-9bdd3da07832 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-eef23918-4487-4c60-9a81-9bdd3da07832 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:08 user nova-compute[74342]: INFO nova.compute.manager [None req-eef23918-4487-4c60-9a81-9bdd3da07832 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Terminating instance
Oct 16 10:03:08 user nova-compute[74342]: DEBUG nova.compute.manager [None req-eef23918-4487-4c60-9a81-9bdd3da07832 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 10:03:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:09 user nova-compute[74342]: DEBUG nova.compute.manager [req-277daca1-83a9-4a8c-a468-30cbd71a4555 req-1dba579b-3968-4947-ae7f-23e09a8f4bd4 service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Received event network-vif-unplugged-a6ce3a63-d00a-4640-9b69-db6d8da564e6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:03:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-277daca1-83a9-4a8c-a468-30cbd71a4555 req-1dba579b-3968-4947-ae7f-23e09a8f4bd4 service nova] Acquiring lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-277daca1-83a9-4a8c-a468-30cbd71a4555 req-1dba579b-3968-4947-ae7f-23e09a8f4bd4 service nova] Lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-277daca1-83a9-4a8c-a468-30cbd71a4555 req-1dba579b-3968-4947-ae7f-23e09a8f4bd4 service nova] Lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:09 user nova-compute[74342]: DEBUG nova.compute.manager [req-277daca1-83a9-4a8c-a468-30cbd71a4555 req-1dba579b-3968-4947-ae7f-23e09a8f4bd4 service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] No waiting events found dispatching network-vif-unplugged-a6ce3a63-d00a-4640-9b69-db6d8da564e6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:03:09 user nova-compute[74342]: DEBUG nova.compute.manager [req-277daca1-83a9-4a8c-a468-30cbd71a4555 req-1dba579b-3968-4947-ae7f-23e09a8f4bd4 service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Received event network-vif-unplugged-a6ce3a63-d00a-4640-9b69-db6d8da564e6 for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 10:03:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:09 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Instance destroyed successfully.
Oct 16 10:03:09 user nova-compute[74342]: DEBUG nova.objects.instance [None req-eef23918-4487-4c60-9a81-9bdd3da07832 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lazy-loading 'resources' on Instance uuid ab64281f-b3fe-47ef-bd5f-796d03aa131f {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:03:09 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-eef23918-4487-4c60-9a81-9bdd3da07832 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:59:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2023456661',display_name='tempest-AttachVolumeNegativeTest-server-2023456661',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2023456661',id=34,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqHCTcwaIAP4WBWLs0a6BXyZQbP/BKDm7JFXQwYYrt36OlHQDwjr8IPjYqky0BV3aQfQB9vEhxA8t3wGfiSjC5gd0VoYF5ZL2SBehPKwTvO5HI+85xuc+qarUsiR9hIag==',key_name='tempest-keypair-902064826',keypairs=<?>,launch_index=0,launched_at=2023-10-16T10:00:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='08329cd0ad7d42a1999ca4f407d93245',ramdisk_id='',reservation_id='r-0j2it1j4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-119585701',owner_user_name='tempest-AttachVolumeNegativeTest-119585701-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T10:00:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee02f6ad1d9749948f43fb432685d067',uuid=ab64281f-b3fe-47ef-bd5f-796d03aa131f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a6ce3a63-d00a-4640-9b69-db6d8da564e6", "address": "fa:16:3e:e7:78:bf", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ce3a63-d0", "ovs_interfaceid": "a6ce3a63-d00a-4640-9b69-db6d8da564e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 10:03:09 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-eef23918-4487-4c60-9a81-9bdd3da07832 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Converting VIF {"id": "a6ce3a63-d00a-4640-9b69-db6d8da564e6", "address": "fa:16:3e:e7:78:bf", "network": {"id": "023e393d-f8ef-42f1-8879-6259a82218cd", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-123445775-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.43", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "08329cd0ad7d42a1999ca4f407d93245", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa6ce3a63-d0", "ovs_interfaceid": "a6ce3a63-d00a-4640-9b69-db6d8da564e6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:03:09 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-eef23918-4487-4c60-9a81-9bdd3da07832 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:78:bf,bridge_name='br-int',has_traffic_filtering=True,id=a6ce3a63-d00a-4640-9b69-db6d8da564e6,network=Network(023e393d-f8ef-42f1-8879-6259a82218cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6ce3a63-d0') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:03:09 user nova-compute[74342]: DEBUG os_vif [None req-eef23918-4487-4c60-9a81-9bdd3da07832 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:78:bf,bridge_name='br-int',has_traffic_filtering=True,id=a6ce3a63-d00a-4640-9b69-db6d8da564e6,network=Network(023e393d-f8ef-42f1-8879-6259a82218cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6ce3a63-d0') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 10:03:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa6ce3a63-d0, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:03:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=208783d6-f786-4c48-be3a-13fefb4ca24d) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:03:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:09 user nova-compute[74342]: INFO os_vif [None req-eef23918-4487-4c60-9a81-9bdd3da07832 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:78:bf,bridge_name='br-int',has_traffic_filtering=True,id=a6ce3a63-d00a-4640-9b69-db6d8da564e6,network=Network(023e393d-f8ef-42f1-8879-6259a82218cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa6ce3a63-d0')
Oct 16 10:03:09 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-eef23918-4487-4c60-9a81-9bdd3da07832 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Deleting instance files /opt/stack/data/nova/instances/ab64281f-b3fe-47ef-bd5f-796d03aa131f_del
Oct 16 10:03:09 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-eef23918-4487-4c60-9a81-9bdd3da07832 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Deletion of /opt/stack/data/nova/instances/ab64281f-b3fe-47ef-bd5f-796d03aa131f_del complete
Oct 16 10:03:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:09 user nova-compute[74342]: INFO nova.compute.manager [None req-eef23918-4487-4c60-9a81-9bdd3da07832 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Took 0.86 seconds to destroy the instance on the hypervisor.
Oct 16 10:03:09 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-eef23918-4487-4c60-9a81-9bdd3da07832 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 10:03:09 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 10:03:09 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 10:03:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:10 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:03:10 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Took 0.76 seconds to deallocate network for instance.
Oct 16 10:03:10 user nova-compute[74342]: DEBUG nova.compute.manager [req-37a4413b-be0a-4490-ad2f-a22d7c2f4af3 req-859cba85-ff01-408d-9053-b7bd7e75f18f service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Received event network-vif-deleted-a6ce3a63-d00a-4640-9b69-db6d8da564e6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:03:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-eef23918-4487-4c60-9a81-9bdd3da07832 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-eef23918-4487-4c60-9a81-9bdd3da07832 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:10 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-eef23918-4487-4c60-9a81-9bdd3da07832 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:03:10 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-eef23918-4487-4c60-9a81-9bdd3da07832 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:03:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-eef23918-4487-4c60-9a81-9bdd3da07832 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.210s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:10 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-eef23918-4487-4c60-9a81-9bdd3da07832 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Deleted allocations for instance ab64281f-b3fe-47ef-bd5f-796d03aa131f
Oct 16 10:03:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-eef23918-4487-4c60-9a81-9bdd3da07832 tempest-AttachVolumeNegativeTest-119585701 tempest-AttachVolumeNegativeTest-119585701-project-member] Lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.044s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:11 user nova-compute[74342]: DEBUG nova.compute.manager [req-64713ebe-c54c-4169-9d19-51a8bb4cbf7d req-474b3d5f-6388-4d67-b490-d67d461ee953 service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Received event network-vif-plugged-a6ce3a63-d00a-4640-9b69-db6d8da564e6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:03:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-64713ebe-c54c-4169-9d19-51a8bb4cbf7d req-474b3d5f-6388-4d67-b490-d67d461ee953 service nova] Acquiring lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-64713ebe-c54c-4169-9d19-51a8bb4cbf7d req-474b3d5f-6388-4d67-b490-d67d461ee953 service nova] Lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-64713ebe-c54c-4169-9d19-51a8bb4cbf7d req-474b3d5f-6388-4d67-b490-d67d461ee953 service nova] Lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:11 user nova-compute[74342]: DEBUG nova.compute.manager [req-64713ebe-c54c-4169-9d19-51a8bb4cbf7d req-474b3d5f-6388-4d67-b490-d67d461ee953 service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] No waiting events found dispatching network-vif-plugged-a6ce3a63-d00a-4640-9b69-db6d8da564e6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:03:11 user nova-compute[74342]: WARNING nova.compute.manager [req-64713ebe-c54c-4169-9d19-51a8bb4cbf7d req-474b3d5f-6388-4d67-b490-d67d461ee953 service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Received unexpected event network-vif-plugged-a6ce3a63-d00a-4640-9b69-db6d8da564e6 for instance with vm_state deleted and task_state None.
Oct 16 10:03:11 user nova-compute[74342]: DEBUG nova.compute.manager [req-64713ebe-c54c-4169-9d19-51a8bb4cbf7d req-474b3d5f-6388-4d67-b490-d67d461ee953 service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Received event network-vif-plugged-a6ce3a63-d00a-4640-9b69-db6d8da564e6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:03:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-64713ebe-c54c-4169-9d19-51a8bb4cbf7d req-474b3d5f-6388-4d67-b490-d67d461ee953 service nova] Acquiring lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-64713ebe-c54c-4169-9d19-51a8bb4cbf7d req-474b3d5f-6388-4d67-b490-d67d461ee953 service nova] Lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-64713ebe-c54c-4169-9d19-51a8bb4cbf7d req-474b3d5f-6388-4d67-b490-d67d461ee953 service nova] Lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:11 user nova-compute[74342]: DEBUG nova.compute.manager [req-64713ebe-c54c-4169-9d19-51a8bb4cbf7d req-474b3d5f-6388-4d67-b490-d67d461ee953 service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] No waiting events found dispatching network-vif-plugged-a6ce3a63-d00a-4640-9b69-db6d8da564e6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:03:11 user nova-compute[74342]: WARNING nova.compute.manager [req-64713ebe-c54c-4169-9d19-51a8bb4cbf7d req-474b3d5f-6388-4d67-b490-d67d461ee953 service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Received unexpected event network-vif-plugged-a6ce3a63-d00a-4640-9b69-db6d8da564e6 for instance with vm_state deleted and task_state None.
Oct 16 10:03:11 user nova-compute[74342]: DEBUG nova.compute.manager [req-64713ebe-c54c-4169-9d19-51a8bb4cbf7d req-474b3d5f-6388-4d67-b490-d67d461ee953 service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Received event network-vif-plugged-a6ce3a63-d00a-4640-9b69-db6d8da564e6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:03:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-64713ebe-c54c-4169-9d19-51a8bb4cbf7d req-474b3d5f-6388-4d67-b490-d67d461ee953 service nova] Acquiring lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-64713ebe-c54c-4169-9d19-51a8bb4cbf7d req-474b3d5f-6388-4d67-b490-d67d461ee953 service nova] Lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-64713ebe-c54c-4169-9d19-51a8bb4cbf7d req-474b3d5f-6388-4d67-b490-d67d461ee953 service nova] Lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:11 user nova-compute[74342]: DEBUG nova.compute.manager [req-64713ebe-c54c-4169-9d19-51a8bb4cbf7d req-474b3d5f-6388-4d67-b490-d67d461ee953 service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] No waiting events found dispatching network-vif-plugged-a6ce3a63-d00a-4640-9b69-db6d8da564e6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:03:11 user nova-compute[74342]: WARNING nova.compute.manager [req-64713ebe-c54c-4169-9d19-51a8bb4cbf7d req-474b3d5f-6388-4d67-b490-d67d461ee953 service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Received unexpected event network-vif-plugged-a6ce3a63-d00a-4640-9b69-db6d8da564e6 for instance with vm_state deleted and task_state None.
Oct 16 10:03:11 user nova-compute[74342]: DEBUG nova.compute.manager [req-64713ebe-c54c-4169-9d19-51a8bb4cbf7d req-474b3d5f-6388-4d67-b490-d67d461ee953 service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Received event network-vif-unplugged-a6ce3a63-d00a-4640-9b69-db6d8da564e6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:03:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-64713ebe-c54c-4169-9d19-51a8bb4cbf7d req-474b3d5f-6388-4d67-b490-d67d461ee953 service nova] Acquiring lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-64713ebe-c54c-4169-9d19-51a8bb4cbf7d req-474b3d5f-6388-4d67-b490-d67d461ee953 service nova] Lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-64713ebe-c54c-4169-9d19-51a8bb4cbf7d req-474b3d5f-6388-4d67-b490-d67d461ee953 service nova] Lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:11 user nova-compute[74342]: DEBUG nova.compute.manager [req-64713ebe-c54c-4169-9d19-51a8bb4cbf7d req-474b3d5f-6388-4d67-b490-d67d461ee953 service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] No waiting events found dispatching network-vif-unplugged-a6ce3a63-d00a-4640-9b69-db6d8da564e6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:03:11 user nova-compute[74342]: WARNING nova.compute.manager [req-64713ebe-c54c-4169-9d19-51a8bb4cbf7d req-474b3d5f-6388-4d67-b490-d67d461ee953 service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Received unexpected event network-vif-unplugged-a6ce3a63-d00a-4640-9b69-db6d8da564e6 for instance with vm_state deleted and task_state None.
Oct 16 10:03:11 user nova-compute[74342]: DEBUG nova.compute.manager [req-64713ebe-c54c-4169-9d19-51a8bb4cbf7d req-474b3d5f-6388-4d67-b490-d67d461ee953 service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Received event network-vif-plugged-a6ce3a63-d00a-4640-9b69-db6d8da564e6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:03:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-64713ebe-c54c-4169-9d19-51a8bb4cbf7d req-474b3d5f-6388-4d67-b490-d67d461ee953 service nova] Acquiring lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-64713ebe-c54c-4169-9d19-51a8bb4cbf7d req-474b3d5f-6388-4d67-b490-d67d461ee953 service nova] Lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-64713ebe-c54c-4169-9d19-51a8bb4cbf7d req-474b3d5f-6388-4d67-b490-d67d461ee953 service nova] Lock "ab64281f-b3fe-47ef-bd5f-796d03aa131f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:11 user nova-compute[74342]: DEBUG nova.compute.manager [req-64713ebe-c54c-4169-9d19-51a8bb4cbf7d req-474b3d5f-6388-4d67-b490-d67d461ee953 service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] No waiting events found dispatching network-vif-plugged-a6ce3a63-d00a-4640-9b69-db6d8da564e6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:03:11 user nova-compute[74342]: WARNING nova.compute.manager [req-64713ebe-c54c-4169-9d19-51a8bb4cbf7d req-474b3d5f-6388-4d67-b490-d67d461ee953 service nova] [instance: ab64281f-b3fe-47ef-bd5f-796d03aa131f] Received unexpected event network-vif-plugged-a6ce3a63-d00a-4640-9b69-db6d8da564e6 for instance with vm_state deleted and task_state None.
Oct 16 10:03:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "aa116cab-861b-459d-b1eb-6f07e5d71e30" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "aa116cab-861b-459d-b1eb-6f07e5d71e30" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "aa116cab-861b-459d-b1eb-6f07e5d71e30-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "aa116cab-861b-459d-b1eb-6f07e5d71e30-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "aa116cab-861b-459d-b1eb-6f07e5d71e30-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:13 user nova-compute[74342]: INFO nova.compute.manager [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Terminating instance
Oct 16 10:03:13 user nova-compute[74342]: DEBUG nova.compute.manager [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 10:03:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:13 user nova-compute[74342]: DEBUG nova.compute.manager [req-e3ca711e-0a76-4c03-8539-5a527fefef55 req-8fed6dac-246b-43fc-9f19-f91b05241190 service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Received event network-vif-unplugged-480ecd6b-63b3-43be-8c76-98216f55e06a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:03:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e3ca711e-0a76-4c03-8539-5a527fefef55 req-8fed6dac-246b-43fc-9f19-f91b05241190 service nova] Acquiring lock "aa116cab-861b-459d-b1eb-6f07e5d71e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e3ca711e-0a76-4c03-8539-5a527fefef55 req-8fed6dac-246b-43fc-9f19-f91b05241190 service nova] Lock "aa116cab-861b-459d-b1eb-6f07e5d71e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e3ca711e-0a76-4c03-8539-5a527fefef55 req-8fed6dac-246b-43fc-9f19-f91b05241190 service nova] Lock "aa116cab-861b-459d-b1eb-6f07e5d71e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:13 user nova-compute[74342]: DEBUG nova.compute.manager [req-e3ca711e-0a76-4c03-8539-5a527fefef55 req-8fed6dac-246b-43fc-9f19-f91b05241190 service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] No waiting events found dispatching network-vif-unplugged-480ecd6b-63b3-43be-8c76-98216f55e06a {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:03:13 user nova-compute[74342]: DEBUG nova.compute.manager [req-e3ca711e-0a76-4c03-8539-5a527fefef55 req-8fed6dac-246b-43fc-9f19-f91b05241190 service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Received event network-vif-unplugged-480ecd6b-63b3-43be-8c76-98216f55e06a for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 10:03:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:14 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Instance destroyed successfully.
Oct 16 10:03:14 user nova-compute[74342]: DEBUG nova.objects.instance [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lazy-loading 'resources' on Instance uuid aa116cab-861b-459d-b1eb-6f07e5d71e30 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:55:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1222282830',display_name='tempest-ServerActionsTestOtherA-server-1222282830',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1222282830',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5Nn7Cd9XA4JGuwKexWOVVgfutTMETbY1OUIw/2Lg/7f8J0Bw2Ei1JnC+VmVg9p5to1vwEeuuESoLWsMybdIS98JRtnBeQn9/1YcrhMFyK9tNXAGp/a4/hIqjXfamZ4kQ==',key_name='tempest-keypair-772403242',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:59:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='355bac247f9d4ea8b3c2f0d87453f4c1',ramdisk_id='',reservation_id='r-g85xdm18',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1004911708',owner_user_name='tempest-ServerActionsTestOtherA-1004911708-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T10:00:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3c728429a0a42789cfc0f1251d6f623',uuid=aa116cab-861b-459d-b1eb-6f07e5d71e30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "480ecd6b-63b3-43be-8c76-98216f55e06a", "address": "fa:16:3e:5c:87:e5", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480ecd6b-63", "ovs_interfaceid": "480ecd6b-63b3-43be-8c76-98216f55e06a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Converting VIF {"id": "480ecd6b-63b3-43be-8c76-98216f55e06a", "address": "fa:16:3e:5c:87:e5", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap480ecd6b-63", "ovs_interfaceid": "480ecd6b-63b3-43be-8c76-98216f55e06a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5c:87:e5,bridge_name='br-int',has_traffic_filtering=True,id=480ecd6b-63b3-43be-8c76-98216f55e06a,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480ecd6b-63') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG os_vif [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:87:e5,bridge_name='br-int',has_traffic_filtering=True,id=480ecd6b-63b3-43be-8c76-98216f55e06a,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480ecd6b-63') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap480ecd6b-63, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=34eccd99-be6d-4592-82ff-e168ab0a4012) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:14 user nova-compute[74342]: INFO os_vif [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5c:87:e5,bridge_name='br-int',has_traffic_filtering=True,id=480ecd6b-63b3-43be-8c76-98216f55e06a,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap480ecd6b-63')
Oct 16 10:03:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CoeJBEON', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:03:14 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:03:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af975cf-4e14-4fcb-afb9-2e2981191be8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 10:03:14 user nova-compute[74342]: No targets found.
Oct 16 10:03:14 user nova-compute[74342]: iSNS:
Oct 16 10:03:14 user nova-compute[74342]: No targets found.
Oct 16 10:03:14 user nova-compute[74342]: STATIC:
Oct 16 10:03:14 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342
Oct 16 10:03:14 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:03:14 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:03:14 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8
Oct 16 10:03:14 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:03:14 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:03:14 user nova-compute[74342]: FIRMWARE:
Oct 16 10:03:14 user nova-compute[74342]: No targets found.
Oct 16 10:03:14 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 10:03:14 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 10:03:14 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[174936cb-aa72-462d-b4a2-b8481c8f259b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9da17a-1be9-47d4-9795-0d48a1569966]: (4, ('tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 10:03:14 user nova-compute[74342]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)
Oct 16 10:03:14 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsi session list stdout=tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 (non-flash)
Oct 16 10:03:14 user nova-compute[74342]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)
Oct 16 10:03:14 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b601b7be0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8'): ({'sdb'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Removing single pathed devices sdb {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7774cf1a-4e78-4d18-abf6-3aa0ddc2f4ff]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[57454e71-4211-49d4-b8e6-ac4444c1c2f3]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Flushing IO for device /dev/sdb {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c225ead-c84b-4885-8cc9-ef1e103eb19c]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab643329-0e54-45d2-af0c-bb6468bc032e]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO92649e02-2d0100b4158d3b9a', '/dev/disk/by-id/scsi-23264303130306234', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_92649e02') {{(pid=85400) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c04c557b-9118-4516-bb2d-a083f3779fa8]: (4, None) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[394c55e1-99f5-40f5-95d9-ecff563f02bc]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[253cd777-2f3b-4fc6-be6e-b1960687d7e3]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8, portal: 172.16.0.220,3260]
Oct 16 10:03:14 user nova-compute[74342]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8, portal: 172.16.0.220,3260] successful.
Oct 16 10:03:14 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e645e4f7-6f67-4461-a2e7-8195c5b246a8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74c4995-fbc8-4709-87ae-b491dc24d7b9]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.277s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] <== disconnect_volume: return (278ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 10:03:14 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Deleting instance files /opt/stack/data/nova/instances/aa116cab-861b-459d-b1eb-6f07e5d71e30_del
Oct 16 10:03:14 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Deletion of /opt/stack/data/nova/instances/aa116cab-861b-459d-b1eb-6f07e5d71e30_del complete
Oct 16 10:03:14 user nova-compute[74342]: INFO nova.compute.manager [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Took 1.11 seconds to destroy the instance on the hypervisor.
Oct 16 10:03:14 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 10:03:14 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 10:03:15 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:03:15 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Took 0.75 seconds to deallocate network for instance.
Oct 16 10:03:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-7d9c3d33-9f10-42e5-8c30-a1e824baa390 req-cb4f5d71-a23a-4643-836e-22064c2375b6 service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Received event network-vif-deleted-480ecd6b-63b3-43be-8c76-98216f55e06a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:03:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-9bf3de49-d835-4c7e-b1ad-a0a945395955 req-f25b548c-8e2c-427e-b629-b79ddcb4fb6b service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Received event network-vif-plugged-480ecd6b-63b3-43be-8c76-98216f55e06a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:03:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9bf3de49-d835-4c7e-b1ad-a0a945395955 req-f25b548c-8e2c-427e-b629-b79ddcb4fb6b service nova] Acquiring lock "aa116cab-861b-459d-b1eb-6f07e5d71e30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9bf3de49-d835-4c7e-b1ad-a0a945395955 req-f25b548c-8e2c-427e-b629-b79ddcb4fb6b service nova] Lock "aa116cab-861b-459d-b1eb-6f07e5d71e30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9bf3de49-d835-4c7e-b1ad-a0a945395955 req-f25b548c-8e2c-427e-b629-b79ddcb4fb6b service nova] Lock "aa116cab-861b-459d-b1eb-6f07e5d71e30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-9bf3de49-d835-4c7e-b1ad-a0a945395955 req-f25b548c-8e2c-427e-b629-b79ddcb4fb6b service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] No waiting events found dispatching network-vif-plugged-480ecd6b-63b3-43be-8c76-98216f55e06a {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:03:15 user nova-compute[74342]: WARNING nova.compute.manager [req-9bf3de49-d835-4c7e-b1ad-a0a945395955 req-f25b548c-8e2c-427e-b629-b79ddcb4fb6b service nova] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Received unexpected event network-vif-plugged-480ecd6b-63b3-43be-8c76-98216f55e06a for instance with vm_state active and task_state deleting.
Oct 16 10:03:16 user nova-compute[74342]: INFO nova.compute.manager [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Took 0.76 seconds to detach 1 volumes for instance.
Oct 16 10:03:16 user nova-compute[74342]: DEBUG nova.compute.manager [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: aa116cab-861b-459d-b1eb-6f07e5d71e30] Deleting volume: e645e4f7-6f67-4461-a2e7-8195c5b246a8 {{(pid=74342) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 16 10:03:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:16 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:03:16 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:03:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.179s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:16 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Deleted allocations for instance aa116cab-861b-459d-b1eb-6f07e5d71e30
Oct 16 10:03:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-1b823ed0-0b47-4279-b286-4a42c5b8ae20 tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "aa116cab-861b-459d-b1eb-6f07e5d71e30" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.073s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:03:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:29 user nova-compute[74342]: INFO nova.compute.manager [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Unshelving
Oct 16 10:03:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:29 user nova-compute[74342]: DEBUG nova.objects.instance [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lazy-loading 'pci_requests' on Instance uuid f0f4fa14-f586-47f0-a79e-4ee095c9fb39 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:03:29 user nova-compute[74342]: DEBUG nova.objects.instance [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lazy-loading 'numa_topology' on Instance uuid f0f4fa14-f586-47f0-a79e-4ee095c9fb39 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:03:29 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 10:03:29 user nova-compute[74342]: INFO nova.compute.claims [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Claim successful on node user
Oct 16 10:03:29 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:03:29 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:03:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.294s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:29 user nova-compute[74342]: INFO nova.network.neutron [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Updating port 6bd9a0d7-fd42-4686-b4a8-af790582008d with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Oct 16 10:03:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "refresh_cache-f0f4fa14-f586-47f0-a79e-4ee095c9fb39" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:03:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquired lock "refresh_cache-f0f4fa14-f586-47f0-a79e-4ee095c9fb39" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:03:30 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:03:30 user nova-compute[74342]: DEBUG nova.compute.manager [req-099d3642-4ac7-4853-b813-e3612afc99b2 req-145166ce-40ad-4314-b660-263fca925bb0 service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Received event network-changed-6bd9a0d7-fd42-4686-b4a8-af790582008d {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:03:30 user nova-compute[74342]: DEBUG nova.compute.manager [req-099d3642-4ac7-4853-b813-e3612afc99b2 req-145166ce-40ad-4314-b660-263fca925bb0 service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Refreshing instance network info cache due to event network-changed-6bd9a0d7-fd42-4686-b4a8-af790582008d. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:03:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-099d3642-4ac7-4853-b813-e3612afc99b2 req-145166ce-40ad-4314-b660-263fca925bb0 service nova] Acquiring lock "refresh_cache-f0f4fa14-f586-47f0-a79e-4ee095c9fb39" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:03:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:31 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Updating instance_info_cache with network_info: [{"id": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "address": "fa:16:3e:80:ef:28", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9a0d7-fd", "ovs_interfaceid": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:03:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Releasing lock "refresh_cache-f0f4fa14-f586-47f0-a79e-4ee095c9fb39" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:03:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 10:03:31 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Creating image(s)
Oct 16 10:03:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "/opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "/opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "/opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:31 user nova-compute[74342]: DEBUG nova.objects.instance [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lazy-loading 'trusted_certs' on Instance uuid f0f4fa14-f586-47f0-a79e-4ee095c9fb39 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:03:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-099d3642-4ac7-4853-b813-e3612afc99b2 req-145166ce-40ad-4314-b660-263fca925bb0 service nova] Acquired lock "refresh_cache-f0f4fa14-f586-47f0-a79e-4ee095c9fb39" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:03:31 user nova-compute[74342]: DEBUG nova.network.neutron [req-099d3642-4ac7-4853-b813-e3612afc99b2 req-145166ce-40ad-4314-b660-263fca925bb0 service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Refreshing network info cache for port 6bd9a0d7-fd42-4686-b4a8-af790582008d {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:03:31 user nova-compute[74342]: DEBUG nova.objects.base [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Object Instance<f0f4fa14-f586-47f0-a79e-4ee095c9fb39> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:03:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "23d68d07431b972e0a066a70baac4029c8b1c066" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "23d68d07431b972e0a066a70baac4029c8b1c066" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23d68d07431b972e0a066a70baac4029c8b1c066.part --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23d68d07431b972e0a066a70baac4029c8b1c066.part --force-share --output=json" returned: 0 in 0.202s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:32 user nova-compute[74342]: DEBUG nova.virt.images [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] 4bddac92-23e9-452c-b409-4f8c7f96506d was qcow2, converting to raw {{(pid=74342) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 10:03:32 user nova-compute[74342]: DEBUG nova.privsep.utils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 10:03:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/23d68d07431b972e0a066a70baac4029c8b1c066.part /opt/stack/data/nova/instances/_base/23d68d07431b972e0a066a70baac4029c8b1c066.converted {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:33 user nova-compute[74342]: DEBUG nova.network.neutron [req-099d3642-4ac7-4853-b813-e3612afc99b2 req-145166ce-40ad-4314-b660-263fca925bb0 service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Updated VIF entry in instance network info cache for port 6bd9a0d7-fd42-4686-b4a8-af790582008d. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:03:33 user nova-compute[74342]: DEBUG nova.network.neutron [req-099d3642-4ac7-4853-b813-e3612afc99b2 req-145166ce-40ad-4314-b660-263fca925bb0 service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Updating instance_info_cache with network_info: [{"id": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "address": "fa:16:3e:80:ef:28", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9a0d7-fd", "ovs_interfaceid": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:03:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-099d3642-4ac7-4853-b813-e3612afc99b2 req-145166ce-40ad-4314-b660-263fca925bb0 service nova] Releasing lock "refresh_cache-f0f4fa14-f586-47f0-a79e-4ee095c9fb39" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:03:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/23d68d07431b972e0a066a70baac4029c8b1c066.part /opt/stack/data/nova/instances/_base/23d68d07431b972e0a066a70baac4029c8b1c066.converted" returned: 0 in 0.574s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23d68d07431b972e0a066a70baac4029c8b1c066.converted --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:33 user nova-compute[74342]: DEBUG nova.compute.manager [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 10:03:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23d68d07431b972e0a066a70baac4029c8b1c066.converted --force-share --output=json" returned: 0 in 0.188s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "23d68d07431b972e0a066a70baac4029c8b1c066" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.088s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23d68d07431b972e0a066a70baac4029c8b1c066 --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:33 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 10:03:33 user nova-compute[74342]: INFO nova.compute.claims [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Claim successful on node user
Oct 16 10:03:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23d68d07431b972e0a066a70baac4029c8b1c066 --force-share --output=json" returned: 0 in 0.172s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "23d68d07431b972e0a066a70baac4029c8b1c066" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "23d68d07431b972e0a066a70baac4029c8b1c066" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23d68d07431b972e0a066a70baac4029c8b1c066 --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:33 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:03:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23d68d07431b972e0a066a70baac4029c8b1c066 --force-share --output=json" returned: 0 in 0.182s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23d68d07431b972e0a066a70baac4029c8b1c066,backing_fmt=raw /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:33 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:03:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/23d68d07431b972e0a066a70baac4029c8b1c066,backing_fmt=raw /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk 1073741824" returned: 0 in 0.057s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "23d68d07431b972e0a066a70baac4029c8b1c066" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23d68d07431b972e0a066a70baac4029c8b1c066 --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.467s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:34 user nova-compute[74342]: DEBUG nova.compute.manager [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 10:03:34 user nova-compute[74342]: DEBUG nova.compute.manager [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 10:03:34 user nova-compute[74342]: DEBUG nova.network.neutron [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 10:03:34 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 10:03:34 user nova-compute[74342]: DEBUG nova.compute.manager [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 10:03:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/23d68d07431b972e0a066a70baac4029c8b1c066 --force-share --output=json" returned: 0 in 0.183s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:34 user nova-compute[74342]: DEBUG nova.objects.instance [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lazy-loading 'migration_context' on Instance uuid f0f4fa14-f586-47f0-a79e-4ee095c9fb39 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:03:34 user nova-compute[74342]: DEBUG nova.objects.base [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Object Instance<f0f4fa14-f586-47f0-a79e-4ee095c9fb39> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:03:34 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Rebasing disk image.
Oct 16 10:03:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:34 user nova-compute[74342]: DEBUG nova.policy [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bc0dfbfdb77347cda95ba991d37c311d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c28511c6c42147db9a0992cf40e044bb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 10:03:34 user nova-compute[74342]: DEBUG nova.compute.manager [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 10:03:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 10:03:34 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Creating image(s)
Oct 16 10:03:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "/opt/stack/data/nova/instances/79ebd3fd-b258-48b4-ab51-a97ba8174c30/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "/opt/stack/data/nova/instances/79ebd3fd-b258-48b4-ab51-a97ba8174c30/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "/opt/stack/data/nova/instances/79ebd3fd-b258-48b4-ab51-a97ba8174c30/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.186s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd -F raw /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.190s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.188s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/79ebd3fd-b258-48b4-ab51-a97ba8174c30/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/79ebd3fd-b258-48b4-ab51-a97ba8174c30/disk 1073741824" returned: 0 in 0.051s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:34 user nova-compute[74342]: DEBUG nova.network.neutron [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Successfully created port: 6bb97021-afe7-4ea2-9237-3b0d5a410034 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 10:03:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.207s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:34 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Checking if we can resize image /opt/stack/data/nova/instances/79ebd3fd-b258-48b4-ab51-a97ba8174c30/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 10:03:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ebd3fd-b258-48b4-ab51-a97ba8174c30/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ebd3fd-b258-48b4-ab51-a97ba8174c30/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:35 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Cannot resize image /opt/stack/data/nova/instances/79ebd3fd-b258-48b4-ab51-a97ba8174c30/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 10:03:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 10:03:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Ensure instance console log exists: /opt/stack/data/nova/instances/79ebd3fd-b258-48b4-ab51-a97ba8174c30/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 10:03:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:35 user nova-compute[74342]: DEBUG nova.network.neutron [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Successfully updated port: 6bb97021-afe7-4ea2-9237-3b0d5a410034 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 10:03:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "refresh_cache-79ebd3fd-b258-48b4-ab51-a97ba8174c30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:03:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquired lock "refresh_cache-79ebd3fd-b258-48b4-ab51-a97ba8174c30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:03:35 user nova-compute[74342]: DEBUG nova.network.neutron [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:03:35 user nova-compute[74342]: DEBUG nova.compute.manager [req-0ce6dca2-9d0e-440e-bc3e-78ada9a34451 req-0feaabc1-7d7c-4317-a1c3-29d6713ff2f6 service nova] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Received event network-changed-6bb97021-afe7-4ea2-9237-3b0d5a410034 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:03:35 user nova-compute[74342]: DEBUG nova.compute.manager [req-0ce6dca2-9d0e-440e-bc3e-78ada9a34451 req-0feaabc1-7d7c-4317-a1c3-29d6713ff2f6 service nova] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Refreshing instance network info cache due to event network-changed-6bb97021-afe7-4ea2-9237-3b0d5a410034. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:03:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0ce6dca2-9d0e-440e-bc3e-78ada9a34451 req-0feaabc1-7d7c-4317-a1c3-29d6713ff2f6 service nova] Acquiring lock "refresh_cache-79ebd3fd-b258-48b4-ab51-a97ba8174c30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:03:35 user nova-compute[74342]: DEBUG nova.network.neutron [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.network.neutron [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Updating instance_info_cache with network_info: [{"id": "6bb97021-afe7-4ea2-9237-3b0d5a410034", "address": "fa:16:3e:1f:d6:92", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bb97021-af", "ovs_interfaceid": "6bb97021-afe7-4ea2-9237-3b0d5a410034", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Releasing lock "refresh_cache-79ebd3fd-b258-48b4-ab51-a97ba8174c30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.compute.manager [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Instance network_info: |[{"id": "6bb97021-afe7-4ea2-9237-3b0d5a410034", "address": "fa:16:3e:1f:d6:92", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bb97021-af", "ovs_interfaceid": "6bb97021-afe7-4ea2-9237-3b0d5a410034", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0ce6dca2-9d0e-440e-bc3e-78ada9a34451 req-0feaabc1-7d7c-4317-a1c3-29d6713ff2f6 service nova] Acquired lock "refresh_cache-79ebd3fd-b258-48b4-ab51-a97ba8174c30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.network.neutron [req-0ce6dca2-9d0e-440e-bc3e-78ada9a34451 req-0feaabc1-7d7c-4317-a1c3-29d6713ff2f6 service nova] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Refreshing network info cache for port 6bb97021-afe7-4ea2-9237-3b0d5a410034 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Start _get_guest_xml network_info=[{"id": "6bb97021-afe7-4ea2-9237-3b0d5a410034", "address": "fa:16:3e:1f:d6:92", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bb97021-af", "ovs_interfaceid": "6bb97021-afe7-4ea2-9237-3b0d5a410034", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 10:03:36 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:03:36 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:03:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1964832210',display_name='tempest-AttachVolumeTestJSON-server-1964832210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1964832210',id=36,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5pJIhc+XSoy3+VnlkC/661RxvWaE4z581j+N9a/Qc6Xv7PjNZzsDnJzk+KLTM2OEoJVNLV0BRDHNG0IY7fGFVjT97De3Ub99qPnfIZF2N2K+l6z7GMuhht/KEhCrN5vw==',key_name='tempest-keypair-646353730',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c28511c6c42147db9a0992cf40e044bb',ramdisk_id='',reservation_id='r-84gp0b8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-965713551',owner_user_name='tempest-AttachVolumeTestJSON-965713551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:03:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc0dfbfdb77347cda95ba991d37c311d',uuid=79ebd3fd-b258-48b4-ab51-a97ba8174c30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6bb97021-afe7-4ea2-9237-3b0d5a410034", "address": "fa:16:3e:1f:d6:92", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bb97021-af", "ovs_interfaceid": "6bb97021-afe7-4ea2-9237-3b0d5a410034", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Converting VIF {"id": "6bb97021-afe7-4ea2-9237-3b0d5a410034", "address": "fa:16:3e:1f:d6:92", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bb97021-af", "ovs_interfaceid": "6bb97021-afe7-4ea2-9237-3b0d5a410034", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:d6:92,bridge_name='br-int',has_traffic_filtering=True,id=6bb97021-afe7-4ea2-9237-3b0d5a410034,network=Network(54ba0b2e-1a1f-44a4-ba26-8a96960d4165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bb97021-af') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.objects.instance [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'pci_devices' on Instance uuid 79ebd3fd-b258-48b4-ab51-a97ba8174c30 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] End _get_guest_xml xml=<domain type="kvm">
Oct 16 10:03:36 user nova-compute[74342]:   <uuid>79ebd3fd-b258-48b4-ab51-a97ba8174c30</uuid>
Oct 16 10:03:36 user nova-compute[74342]:   <name>instance-00000024</name>
Oct 16 10:03:36 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 10:03:36 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 10:03:36 user nova-compute[74342]:   <metadata>
Oct 16 10:03:36 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 10:03:36 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 10:03:36 user nova-compute[74342]:       <nova:name>tempest-AttachVolumeTestJSON-server-1964832210</nova:name>
Oct 16 10:03:36 user nova-compute[74342]:       <nova:creationTime>2023-10-16 10:03:36</nova:creationTime>
Oct 16 10:03:36 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 10:03:36 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 10:03:36 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 10:03:36 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 10:03:36 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 10:03:36 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 10:03:36 user nova-compute[74342]:       </nova:flavor>
Oct 16 10:03:36 user nova-compute[74342]:       <nova:owner>
Oct 16 10:03:36 user nova-compute[74342]:         <nova:user uuid="bc0dfbfdb77347cda95ba991d37c311d">tempest-AttachVolumeTestJSON-965713551-project-member</nova:user>
Oct 16 10:03:36 user nova-compute[74342]:         <nova:project uuid="c28511c6c42147db9a0992cf40e044bb">tempest-AttachVolumeTestJSON-965713551</nova:project>
Oct 16 10:03:36 user nova-compute[74342]:       </nova:owner>
Oct 16 10:03:36 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 10:03:36 user nova-compute[74342]:       <nova:ports>
Oct 16 10:03:36 user nova-compute[74342]:         <nova:port uuid="6bb97021-afe7-4ea2-9237-3b0d5a410034">
Oct 16 10:03:36 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 16 10:03:36 user nova-compute[74342]:         </nova:port>
Oct 16 10:03:36 user nova-compute[74342]:       </nova:ports>
Oct 16 10:03:36 user nova-compute[74342]:     </nova:instance>
Oct 16 10:03:36 user nova-compute[74342]:   </metadata>
Oct 16 10:03:36 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 10:03:36 user nova-compute[74342]:     <system>
Oct 16 10:03:36 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 10:03:36 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 10:03:36 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 10:03:36 user nova-compute[74342]:       <entry name="serial">79ebd3fd-b258-48b4-ab51-a97ba8174c30</entry>
Oct 16 10:03:36 user nova-compute[74342]:       <entry name="uuid">79ebd3fd-b258-48b4-ab51-a97ba8174c30</entry>
Oct 16 10:03:36 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 10:03:36 user nova-compute[74342]:     </system>
Oct 16 10:03:36 user nova-compute[74342]:   </sysinfo>
Oct 16 10:03:36 user nova-compute[74342]:   <os>
Oct 16 10:03:36 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 10:03:36 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 10:03:36 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 10:03:36 user nova-compute[74342]:   </os>
Oct 16 10:03:36 user nova-compute[74342]:   <features>
Oct 16 10:03:36 user nova-compute[74342]:     <acpi/>
Oct 16 10:03:36 user nova-compute[74342]:     <apic/>
Oct 16 10:03:36 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 10:03:36 user nova-compute[74342]:   </features>
Oct 16 10:03:36 user nova-compute[74342]:   <clock offset="utc">
Oct 16 10:03:36 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 10:03:36 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 10:03:36 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 10:03:36 user nova-compute[74342]:   </clock>
Oct 16 10:03:36 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 10:03:36 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 10:03:36 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 10:03:36 user nova-compute[74342]:   </cpu>
Oct 16 10:03:36 user nova-compute[74342]:   <devices>
Oct 16 10:03:36 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 10:03:36 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 10:03:36 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/79ebd3fd-b258-48b4-ab51-a97ba8174c30/disk"/>
Oct 16 10:03:36 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 10:03:36 user nova-compute[74342]:     </disk>
Oct 16 10:03:36 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 10:03:36 user nova-compute[74342]:       <mac address="fa:16:3e:1f:d6:92"/>
Oct 16 10:03:36 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:03:36 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 10:03:36 user nova-compute[74342]:       <target dev="tap6bb97021-af"/>
Oct 16 10:03:36 user nova-compute[74342]:     </interface>
Oct 16 10:03:36 user nova-compute[74342]:     <serial type="pty">
Oct 16 10:03:36 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/79ebd3fd-b258-48b4-ab51-a97ba8174c30/console.log" append="off"/>
Oct 16 10:03:36 user nova-compute[74342]:     </serial>
Oct 16 10:03:36 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 10:03:36 user nova-compute[74342]:     <video>
Oct 16 10:03:36 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:03:36 user nova-compute[74342]:     </video>
Oct 16 10:03:36 user nova-compute[74342]:     <rng model="virtio">
Oct 16 10:03:36 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 10:03:36 user nova-compute[74342]:     </rng>
Oct 16 10:03:36 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 10:03:36 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 10:03:36 user nova-compute[74342]:       <stats period="10"/>
Oct 16 10:03:36 user nova-compute[74342]:     </memballoon>
Oct 16 10:03:36 user nova-compute[74342]:   </devices>
Oct 16 10:03:36 user nova-compute[74342]: </domain>
Oct 16 10:03:36 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:03:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1964832210',display_name='tempest-AttachVolumeTestJSON-server-1964832210',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1964832210',id=36,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5pJIhc+XSoy3+VnlkC/661RxvWaE4z581j+N9a/Qc6Xv7PjNZzsDnJzk+KLTM2OEoJVNLV0BRDHNG0IY7fGFVjT97De3Ub99qPnfIZF2N2K+l6z7GMuhht/KEhCrN5vw==',key_name='tempest-keypair-646353730',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c28511c6c42147db9a0992cf40e044bb',ramdisk_id='',reservation_id='r-84gp0b8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-965713551',owner_user_name='tempest-AttachVolumeTestJSON-965713551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:03:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc0dfbfdb77347cda95ba991d37c311d',uuid=79ebd3fd-b258-48b4-ab51-a97ba8174c30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6bb97021-afe7-4ea2-9237-3b0d5a410034", "address": "fa:16:3e:1f:d6:92", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bb97021-af", "ovs_interfaceid": "6bb97021-afe7-4ea2-9237-3b0d5a410034", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Converting VIF {"id": "6bb97021-afe7-4ea2-9237-3b0d5a410034", "address": "fa:16:3e:1f:d6:92", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bb97021-af", "ovs_interfaceid": "6bb97021-afe7-4ea2-9237-3b0d5a410034", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:d6:92,bridge_name='br-int',has_traffic_filtering=True,id=6bb97021-afe7-4ea2-9237-3b0d5a410034,network=Network(54ba0b2e-1a1f-44a4-ba26-8a96960d4165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bb97021-af') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG os_vif [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:d6:92,bridge_name='br-int',has_traffic_filtering=True,id=6bb97021-afe7-4ea2-9237-3b0d5a410034,network=Network(54ba0b2e-1a1f-44a4-ba26-8a96960d4165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bb97021-af') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9b743b2-b31e-5ff3-bc58-d4611f55d56c', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6bb97021-af, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6bb97021-af, col_values=(('qos', UUID('67d69024-1624-4297-9b73-287e8ca33651')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6bb97021-af, col_values=(('external_ids', {'iface-id': '6bb97021-afe7-4ea2-9237-3b0d5a410034', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:d6:92', 'vm-uuid': '79ebd3fd-b258-48b4-ab51-a97ba8174c30'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:36 user nova-compute[74342]: INFO os_vif [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:d6:92,bridge_name='br-int',has_traffic_filtering=True,id=6bb97021-afe7-4ea2-9237-3b0d5a410034,network=Network(54ba0b2e-1a1f-44a4-ba26-8a96960d4165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bb97021-af')
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] No VIF found with MAC fa:16:3e:1f:d6:92, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd -F raw /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk" returned: 0 in 2.085s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Ensure instance console log exists: /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Start _get_guest_xml network_info=[{"id": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "address": "fa:16:3e:80:ef:28", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9a0d7-fd", "ovs_interfaceid": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='f5959a341d0a1f21bc51d416a36ccd9e',container_format='bare',created_at=2023-10-16T10:01:36Z,direct_url=<?>,disk_format='qcow2',id=4bddac92-23e9-452c-b409-4f8c7f96506d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-727193916-shelved',owner='a70b9ea5f3404a5690cd0a73db23f034',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-16T10:01:41Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 10:03:36 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:03:36 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f5959a341d0a1f21bc51d416a36ccd9e',container_format='bare',created_at=2023-10-16T10:01:36Z,direct_url=<?>,disk_format='qcow2',id=4bddac92-23e9-452c-b409-4f8c7f96506d,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-727193916-shelved',owner='a70b9ea5f3404a5690cd0a73db23f034',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-16T10:01:41Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.objects.instance [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lazy-loading 'vcpu_model' on Instance uuid f0f4fa14-f586-47f0-a79e-4ee095c9fb39 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.objects.base [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Object Instance<f0f4fa14-f586-47f0-a79e-4ee095c9fb39> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T09:59:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-727193916',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-727193916',id=33,image_ref='4bddac92-23e9-452c-b409-4f8c7f96506d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-150707378',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:59:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a70b9ea5f3404a5690cd0a73db23f034',ramdisk_id='',reservation_id='r-0e1oe4y4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-939526853',owner_user_name='tempest-AttachVolumeShelveTestJSON-939526853-project-member',shelved_at='2023-10-16T10:01:41.085531',shelved_host='user',shelved_image_id='4bddac92-23e9-452c-b409-4f8c7f96506d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:03:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8bf8aa8ab2d4105ad0b1fd04247e3a0',uuid=f0f4fa14-f586-47f0-a79e-4ee095c9fb39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "address": "fa:16:3e:80:ef:28", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9a0d7-fd", "ovs_interfaceid": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Converting VIF {"id": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "address": "fa:16:3e:80:ef:28", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9a0d7-fd", "ovs_interfaceid": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:ef:28,bridge_name='br-int',has_traffic_filtering=True,id=6bd9a0d7-fd42-4686-b4a8-af790582008d,network=Network(bbeb1d70-a5dc-46d6-a0dd-240bf3018d31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd9a0d7-fd') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.objects.instance [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lazy-loading 'pci_devices' on Instance uuid f0f4fa14-f586-47f0-a79e-4ee095c9fb39 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.objects.base [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Object Instance<f0f4fa14-f586-47f0-a79e-4ee095c9fb39> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] End _get_guest_xml xml=<domain type="kvm">
Oct 16 10:03:36 user nova-compute[74342]:   <uuid>f0f4fa14-f586-47f0-a79e-4ee095c9fb39</uuid>
Oct 16 10:03:36 user nova-compute[74342]:   <name>instance-00000021</name>
Oct 16 10:03:36 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 10:03:36 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 10:03:36 user nova-compute[74342]:   <metadata>
Oct 16 10:03:36 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 10:03:36 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 10:03:36 user nova-compute[74342]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-727193916</nova:name>
Oct 16 10:03:36 user nova-compute[74342]:       <nova:creationTime>2023-10-16 10:03:36</nova:creationTime>
Oct 16 10:03:36 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 10:03:36 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 10:03:36 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 10:03:36 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 10:03:36 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 10:03:36 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 10:03:36 user nova-compute[74342]:       </nova:flavor>
Oct 16 10:03:36 user nova-compute[74342]:       <nova:owner>
Oct 16 10:03:36 user nova-compute[74342]:         <nova:user uuid="c8bf8aa8ab2d4105ad0b1fd04247e3a0">tempest-AttachVolumeShelveTestJSON-939526853-project-member</nova:user>
Oct 16 10:03:36 user nova-compute[74342]:         <nova:project uuid="a70b9ea5f3404a5690cd0a73db23f034">tempest-AttachVolumeShelveTestJSON-939526853</nova:project>
Oct 16 10:03:36 user nova-compute[74342]:       </nova:owner>
Oct 16 10:03:36 user nova-compute[74342]:       <nova:root type="image" uuid="4bddac92-23e9-452c-b409-4f8c7f96506d"/>
Oct 16 10:03:36 user nova-compute[74342]:       <nova:ports>
Oct 16 10:03:36 user nova-compute[74342]:         <nova:port uuid="6bd9a0d7-fd42-4686-b4a8-af790582008d">
Oct 16 10:03:36 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 16 10:03:36 user nova-compute[74342]:         </nova:port>
Oct 16 10:03:36 user nova-compute[74342]:       </nova:ports>
Oct 16 10:03:36 user nova-compute[74342]:     </nova:instance>
Oct 16 10:03:36 user nova-compute[74342]:   </metadata>
Oct 16 10:03:36 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 10:03:36 user nova-compute[74342]:     <system>
Oct 16 10:03:36 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 10:03:36 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 10:03:36 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 10:03:36 user nova-compute[74342]:       <entry name="serial">f0f4fa14-f586-47f0-a79e-4ee095c9fb39</entry>
Oct 16 10:03:36 user nova-compute[74342]:       <entry name="uuid">f0f4fa14-f586-47f0-a79e-4ee095c9fb39</entry>
Oct 16 10:03:36 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 10:03:36 user nova-compute[74342]:     </system>
Oct 16 10:03:36 user nova-compute[74342]:   </sysinfo>
Oct 16 10:03:36 user nova-compute[74342]:   <os>
Oct 16 10:03:36 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 10:03:36 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 10:03:36 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 10:03:36 user nova-compute[74342]:   </os>
Oct 16 10:03:36 user nova-compute[74342]:   <features>
Oct 16 10:03:36 user nova-compute[74342]:     <acpi/>
Oct 16 10:03:36 user nova-compute[74342]:     <apic/>
Oct 16 10:03:36 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 10:03:36 user nova-compute[74342]:   </features>
Oct 16 10:03:36 user nova-compute[74342]:   <clock offset="utc">
Oct 16 10:03:36 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 10:03:36 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 10:03:36 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 10:03:36 user nova-compute[74342]:   </clock>
Oct 16 10:03:36 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 10:03:36 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 10:03:36 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 10:03:36 user nova-compute[74342]:   </cpu>
Oct 16 10:03:36 user nova-compute[74342]:   <devices>
Oct 16 10:03:36 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 10:03:36 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 10:03:36 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk"/>
Oct 16 10:03:36 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 10:03:36 user nova-compute[74342]:     </disk>
Oct 16 10:03:36 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 10:03:36 user nova-compute[74342]:       <mac address="fa:16:3e:80:ef:28"/>
Oct 16 10:03:36 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:03:36 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 10:03:36 user nova-compute[74342]:       <target dev="tap6bd9a0d7-fd"/>
Oct 16 10:03:36 user nova-compute[74342]:     </interface>
Oct 16 10:03:36 user nova-compute[74342]:     <serial type="pty">
Oct 16 10:03:36 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/console.log" append="off"/>
Oct 16 10:03:36 user nova-compute[74342]:     </serial>
Oct 16 10:03:36 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 10:03:36 user nova-compute[74342]:     <video>
Oct 16 10:03:36 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:03:36 user nova-compute[74342]:     </video>
Oct 16 10:03:36 user nova-compute[74342]:     <rng model="virtio">
Oct 16 10:03:36 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 10:03:36 user nova-compute[74342]:     </rng>
Oct 16 10:03:36 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 10:03:36 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 10:03:36 user nova-compute[74342]:       <stats period="10"/>
Oct 16 10:03:36 user nova-compute[74342]:     </memballoon>
Oct 16 10:03:36 user nova-compute[74342]:   </devices>
Oct 16 10:03:36 user nova-compute[74342]: </domain>
Oct 16 10:03:36 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T09:59:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-727193916',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-727193916',id=33,image_ref='4bddac92-23e9-452c-b409-4f8c7f96506d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-150707378',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:59:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='a70b9ea5f3404a5690cd0a73db23f034',ramdisk_id='',reservation_id='r-0e1oe4y4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-939526853',owner_user_name='tempest-AttachVolumeShelveTestJSON-939526853-project-member',shelved_at='2023-10-16T10:01:41.085531',shelved_host='user',shelved_image_id='4bddac92-23e9-452c-b409-4f8c7f96506d'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:03:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8bf8aa8ab2d4105ad0b1fd04247e3a0',uuid=f0f4fa14-f586-47f0-a79e-4ee095c9fb39,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "address": "fa:16:3e:80:ef:28", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9a0d7-fd", "ovs_interfaceid": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Converting VIF {"id": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "address": "fa:16:3e:80:ef:28", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9a0d7-fd", "ovs_interfaceid": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:ef:28,bridge_name='br-int',has_traffic_filtering=True,id=6bd9a0d7-fd42-4686-b4a8-af790582008d,network=Network(bbeb1d70-a5dc-46d6-a0dd-240bf3018d31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd9a0d7-fd') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG os_vif [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:ef:28,bridge_name='br-int',has_traffic_filtering=True,id=6bd9a0d7-fd42-4686-b4a8-af790582008d,network=Network(bbeb1d70-a5dc-46d6-a0dd-240bf3018d31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd9a0d7-fd') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5b086fbd-cb1b-5bef-872c-160fc5cfcd60', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6bd9a0d7-fd, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6bd9a0d7-fd, col_values=(('qos', UUID('d096727b-26ce-4e76-aab5-06608b4165db')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6bd9a0d7-fd, col_values=(('external_ids', {'iface-id': '6bd9a0d7-fd42-4686-b4a8-af790582008d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:ef:28', 'vm-uuid': 'f0f4fa14-f586-47f0-a79e-4ee095c9fb39'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:36 user nova-compute[74342]: INFO os_vif [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:ef:28,bridge_name='br-int',has_traffic_filtering=True,id=6bd9a0d7-fd42-4686-b4a8-af790582008d,network=Network(bbeb1d70-a5dc-46d6-a0dd-240bf3018d31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd9a0d7-fd')
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.network.neutron [req-0ce6dca2-9d0e-440e-bc3e-78ada9a34451 req-0feaabc1-7d7c-4317-a1c3-29d6713ff2f6 service nova] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Updated VIF entry in instance network info cache for port 6bb97021-afe7-4ea2-9237-3b0d5a410034. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.network.neutron [req-0ce6dca2-9d0e-440e-bc3e-78ada9a34451 req-0feaabc1-7d7c-4317-a1c3-29d6713ff2f6 service nova] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Updating instance_info_cache with network_info: [{"id": "6bb97021-afe7-4ea2-9237-3b0d5a410034", "address": "fa:16:3e:1f:d6:92", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bb97021-af", "ovs_interfaceid": "6bb97021-afe7-4ea2-9237-3b0d5a410034", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0ce6dca2-9d0e-440e-bc3e-78ada9a34451 req-0feaabc1-7d7c-4317-a1c3-29d6713ff2f6 service nova] Releasing lock "refresh_cache-79ebd3fd-b258-48b4-ab51-a97ba8174c30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:03:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] No VIF found with MAC fa:16:3e:80:ef:28, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:03:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:38 user nova-compute[74342]: DEBUG nova.compute.manager [req-def958cf-fcaa-4365-91e6-756ee4d7065a req-3943c2ba-01a1-4e28-863f-bcd176985486 service nova] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Received event network-vif-plugged-6bb97021-afe7-4ea2-9237-3b0d5a410034 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:03:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-def958cf-fcaa-4365-91e6-756ee4d7065a req-3943c2ba-01a1-4e28-863f-bcd176985486 service nova] Acquiring lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-def958cf-fcaa-4365-91e6-756ee4d7065a req-3943c2ba-01a1-4e28-863f-bcd176985486 service nova] Lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-def958cf-fcaa-4365-91e6-756ee4d7065a req-3943c2ba-01a1-4e28-863f-bcd176985486 service nova] Lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:38 user nova-compute[74342]: DEBUG nova.compute.manager [req-def958cf-fcaa-4365-91e6-756ee4d7065a req-3943c2ba-01a1-4e28-863f-bcd176985486 service nova] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] No waiting events found dispatching network-vif-plugged-6bb97021-afe7-4ea2-9237-3b0d5a410034 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:03:38 user nova-compute[74342]: WARNING nova.compute.manager [req-def958cf-fcaa-4365-91e6-756ee4d7065a req-3943c2ba-01a1-4e28-863f-bcd176985486 service nova] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Received unexpected event network-vif-plugged-6bb97021-afe7-4ea2-9237-3b0d5a410034 for instance with vm_state building and task_state spawning.
Oct 16 10:03:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:39 user nova-compute[74342]: DEBUG nova.compute.manager [req-ce69c136-b95d-4eab-b0c3-91be2fc909ae req-2e32057d-3ff0-4d09-b3f0-25615e3012a3 service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Received event network-vif-plugged-6bd9a0d7-fd42-4686-b4a8-af790582008d {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:03:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ce69c136-b95d-4eab-b0c3-91be2fc909ae req-2e32057d-3ff0-4d09-b3f0-25615e3012a3 service nova] Acquiring lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ce69c136-b95d-4eab-b0c3-91be2fc909ae req-2e32057d-3ff0-4d09-b3f0-25615e3012a3 service nova] Lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ce69c136-b95d-4eab-b0c3-91be2fc909ae req-2e32057d-3ff0-4d09-b3f0-25615e3012a3 service nova] Lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:39 user nova-compute[74342]: DEBUG nova.compute.manager [req-ce69c136-b95d-4eab-b0c3-91be2fc909ae req-2e32057d-3ff0-4d09-b3f0-25615e3012a3 service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] No waiting events found dispatching network-vif-plugged-6bd9a0d7-fd42-4686-b4a8-af790582008d {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:03:39 user nova-compute[74342]: WARNING nova.compute.manager [req-ce69c136-b95d-4eab-b0c3-91be2fc909ae req-2e32057d-3ff0-4d09-b3f0-25615e3012a3 service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Received unexpected event network-vif-plugged-6bd9a0d7-fd42-4686-b4a8-af790582008d for instance with vm_state shelved_offloaded and task_state spawning.
Oct 16 10:03:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:40 user nova-compute[74342]: DEBUG nova.compute.manager [req-a47678b9-bff7-4533-a9c3-1230ab1545c4 req-940f43c4-01bf-458c-96bb-548dae70f004 service nova] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Received event network-vif-plugged-6bb97021-afe7-4ea2-9237-3b0d5a410034 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:03:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a47678b9-bff7-4533-a9c3-1230ab1545c4 req-940f43c4-01bf-458c-96bb-548dae70f004 service nova] Acquiring lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a47678b9-bff7-4533-a9c3-1230ab1545c4 req-940f43c4-01bf-458c-96bb-548dae70f004 service nova] Lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a47678b9-bff7-4533-a9c3-1230ab1545c4 req-940f43c4-01bf-458c-96bb-548dae70f004 service nova] Lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:40 user nova-compute[74342]: DEBUG nova.compute.manager [req-a47678b9-bff7-4533-a9c3-1230ab1545c4 req-940f43c4-01bf-458c-96bb-548dae70f004 service nova] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] No waiting events found dispatching network-vif-plugged-6bb97021-afe7-4ea2-9237-3b0d5a410034 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:03:40 user nova-compute[74342]: WARNING nova.compute.manager [req-a47678b9-bff7-4533-a9c3-1230ab1545c4 req-940f43c4-01bf-458c-96bb-548dae70f004 service nova] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Received unexpected event network-vif-plugged-6bb97021-afe7-4ea2-9237-3b0d5a410034 for instance with vm_state building and task_state spawning.
Oct 16 10:03:41 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 10:03:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 10:03:41 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Instance spawned successfully.
Oct 16 10:03:41 user nova-compute[74342]: DEBUG nova.compute.manager [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 10:03:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 10:03:41 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Instance spawned successfully.
Oct 16 10:03:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 10:03:41 user nova-compute[74342]: DEBUG nova.compute.manager [req-6392bb6f-73d2-4727-bbf9-775e5192ed56 req-f9d809b6-963f-4d3c-be88-13475a5ae3fe service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Received event network-vif-plugged-6bd9a0d7-fd42-4686-b4a8-af790582008d {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:03:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-6392bb6f-73d2-4727-bbf9-775e5192ed56 req-f9d809b6-963f-4d3c-be88-13475a5ae3fe service nova] Acquiring lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-6392bb6f-73d2-4727-bbf9-775e5192ed56 req-f9d809b6-963f-4d3c-be88-13475a5ae3fe service nova] Lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-6392bb6f-73d2-4727-bbf9-775e5192ed56 req-f9d809b6-963f-4d3c-be88-13475a5ae3fe service nova] Lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:41 user nova-compute[74342]: DEBUG nova.compute.manager [req-6392bb6f-73d2-4727-bbf9-775e5192ed56 req-f9d809b6-963f-4d3c-be88-13475a5ae3fe service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] No waiting events found dispatching network-vif-plugged-6bd9a0d7-fd42-4686-b4a8-af790582008d {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:03:41 user nova-compute[74342]: WARNING nova.compute.manager [req-6392bb6f-73d2-4727-bbf9-775e5192ed56 req-f9d809b6-963f-4d3c-be88-13475a5ae3fe service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Received unexpected event network-vif-plugged-6bd9a0d7-fd42-4686-b4a8-af790582008d for instance with vm_state shelved_offloaded and task_state spawning.
Oct 16 10:03:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:03:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:03:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:03:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:03:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:03:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:03:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:41 user nova-compute[74342]: INFO nova.compute.manager [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Took 7.30 seconds to spawn the instance on the hypervisor.
Oct 16 10:03:41 user nova-compute[74342]: DEBUG nova.compute.manager [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:03:41 user nova-compute[74342]: INFO nova.compute.manager [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Took 8.16 seconds to build instance.
Oct 16 10:03:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d1fcfcb3-c225-4c0f-9335-2d25008b2927 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.290s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:41 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:03:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c70d746d-c2cc-4558-b685-e9a3384e7b3f tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.520s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:03:59 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:03:59 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:03:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:03:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:03:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:03:59 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:03:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:03:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:03:59 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 10:03:59 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ebd3fd-b258-48b4-ab51-a97ba8174c30/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:04:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ebd3fd-b258-48b4-ab51-a97ba8174c30/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:04:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ebd3fd-b258-48b4-ab51-a97ba8174c30/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:04:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ebd3fd-b258-48b4-ab51-a97ba8174c30/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:04:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:04:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:04:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:04:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:04:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:04:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:04:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:04:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:04:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:01 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:04:01 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:04:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8287MB free_disk=25.144054412841797GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:04:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:04:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:04:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 98367a96-22f0-4edb-ab03-a8eb286b437b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:04:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance d7607dcc-e70e-42fb-9421-c5f630706241 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:04:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 9dc7115b-8a02-4ef4-9d44-6590c9fded3e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:04:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance f0f4fa14-f586-47f0-a79e-4ee095c9fb39 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:04:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 79ebd3fd-b258-48b4-ab51-a97ba8174c30 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:04:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:04:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:04:01 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:04:01 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:04:02 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:04:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.456s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:04:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "9dc7115b-8a02-4ef4-9d44-6590c9fded3e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:04:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "9dc7115b-8a02-4ef4-9d44-6590c9fded3e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:04:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "9dc7115b-8a02-4ef4-9d44-6590c9fded3e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:04:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "9dc7115b-8a02-4ef4-9d44-6590c9fded3e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:04:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "9dc7115b-8a02-4ef4-9d44-6590c9fded3e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:04:02 user nova-compute[74342]: INFO nova.compute.manager [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Terminating instance
Oct 16 10:04:02 user nova-compute[74342]: DEBUG nova.compute.manager [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 10:04:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-5fd2eb89-469d-4c2c-98f4-bbfcc82ac809 req-74f9fac5-3f5e-4854-94cb-9e3b9e8e4ad9 service nova] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Received event network-vif-unplugged-2175722a-e6dd-4b7f-ab62-e3974274f81a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:04:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5fd2eb89-469d-4c2c-98f4-bbfcc82ac809 req-74f9fac5-3f5e-4854-94cb-9e3b9e8e4ad9 service nova] Acquiring lock "9dc7115b-8a02-4ef4-9d44-6590c9fded3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:04:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5fd2eb89-469d-4c2c-98f4-bbfcc82ac809 req-74f9fac5-3f5e-4854-94cb-9e3b9e8e4ad9 service nova] Lock "9dc7115b-8a02-4ef4-9d44-6590c9fded3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:04:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5fd2eb89-469d-4c2c-98f4-bbfcc82ac809 req-74f9fac5-3f5e-4854-94cb-9e3b9e8e4ad9 service nova] Lock "9dc7115b-8a02-4ef4-9d44-6590c9fded3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:04:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-5fd2eb89-469d-4c2c-98f4-bbfcc82ac809 req-74f9fac5-3f5e-4854-94cb-9e3b9e8e4ad9 service nova] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] No waiting events found dispatching network-vif-unplugged-2175722a-e6dd-4b7f-ab62-e3974274f81a {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:04:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-5fd2eb89-469d-4c2c-98f4-bbfcc82ac809 req-74f9fac5-3f5e-4854-94cb-9e3b9e8e4ad9 service nova] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Received event network-vif-unplugged-2175722a-e6dd-4b7f-ab62-e3974274f81a for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:03 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Instance destroyed successfully.
Oct 16 10:04:03 user nova-compute[74342]: DEBUG nova.objects.instance [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lazy-loading 'resources' on Instance uuid 9dc7115b-8a02-4ef4-9d44-6590c9fded3e {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:59:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1968296748',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1968296748',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1968296748',id=32,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCnx9nLbf02/dLhwYC0EJ1MiVF8ijprGcOZdaUesCRKKvwWxWSqxsg/YaUGHmlKxGjomdI0Y1S2XlaZiEiIhTdufI1s6+tfi0Dz/JTgKeXKLq1uA3AbTSoOFwoSH4tL5Fg==',key_name='tempest-keypair-1848953359',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:59:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='799c265b3d14465a9ca6bd7d5e8a4488',ramdisk_id='',reservation_id='r-s47t0181',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-158744824',owner_user_name='tempest-TestVolumeBootPattern-158744824-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:59:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2cac31e799b743359b93943b68b38acf',uuid=9dc7115b-8a02-4ef4-9d44-6590c9fded3e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2175722a-e6dd-4b7f-ab62-e3974274f81a", "address": "fa:16:3e:f0:12:7d", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2175722a-e6", "ovs_interfaceid": "2175722a-e6dd-4b7f-ab62-e3974274f81a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converting VIF {"id": "2175722a-e6dd-4b7f-ab62-e3974274f81a", "address": "fa:16:3e:f0:12:7d", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2175722a-e6", "ovs_interfaceid": "2175722a-e6dd-4b7f-ab62-e3974274f81a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:12:7d,bridge_name='br-int',has_traffic_filtering=True,id=2175722a-e6dd-4b7f-ab62-e3974274f81a,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2175722a-e6') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG os_vif [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:12:7d,bridge_name='br-int',has_traffic_filtering=True,id=2175722a-e6dd-4b7f-ab62-e3974274f81a,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2175722a-e6') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2175722a-e6, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9bae8d1-1240-4866-a38f-a72cf70427af) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:04:03 user nova-compute[74342]: INFO os_vif [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:12:7d,bridge_name='br-int',has_traffic_filtering=True,id=2175722a-e6dd-4b7f-ab62-e3974274f81a,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2175722a-e6')
Oct 16 10:04:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TSBlviZk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:04:03 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:04:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afaf2bf-6f37-410b-a79c-56d9ee1a4fed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 10:04:03 user nova-compute[74342]: No targets found.
Oct 16 10:04:03 user nova-compute[74342]: iSNS:
Oct 16 10:04:03 user nova-compute[74342]: No targets found.
Oct 16 10:04:03 user nova-compute[74342]: STATIC:
Oct 16 10:04:03 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342
Oct 16 10:04:03 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:04:03 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:04:03 user nova-compute[74342]: FIRMWARE:
Oct 16 10:04:03 user nova-compute[74342]: No targets found.
Oct 16 10:04:03 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 10:04:03 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 10:04:03 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[488ff284-55af-4877-8dec-4e2b3be32162]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb60803-d617-4352-beea-b68bc174e5e3]: (4, ('tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)
Oct 16 10:04:03 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsi session list stdout=tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 (non-flash)
Oct 16 10:04:03 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b4077de10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342'): ({'sdc'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Removing single pathed devices sdc {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12d6012-2ab9-4597-b8cf-dc307fa04ee1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[54cd1b76-065a-4ac4-a6c0-0ed0b9734bb6]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Flushing IO for device /dev/sdc {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[884d61ba-e519-4aec-b150-d15d271cfdab]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf33817-d8e5-43a3-bc9b-8cc086b1cf7b]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] SCSI volumes sdc have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO65957234-38b8dcf9cb023bda', '/dev/disk/by-id/scsi-23338623864636639', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_65957234') {{(pid=85400) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad901ff8-31dc-4525-881e-6f323595ac83]: (4, None) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[797354cb-e7fb-4eee-9d57-9a304de73c88]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[45bcd40a-459d-41e2-913c-718d1e759370]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342, portal: 172.16.0.220,3260]
Oct 16 10:04:03 user nova-compute[74342]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342, portal: 172.16.0.220,3260] successful.
Oct 16 10:04:03 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6238337b-9041-4805-bc92-cc3e22047342 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec2f542-f137-4f1a-94ed-b8d624d91019]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.304s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] <== disconnect_volume: return (305ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 10:04:03 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Deleting instance files /opt/stack/data/nova/instances/9dc7115b-8a02-4ef4-9d44-6590c9fded3e_del
Oct 16 10:04:03 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Deletion of /opt/stack/data/nova/instances/9dc7115b-8a02-4ef4-9d44-6590c9fded3e_del complete
Oct 16 10:04:03 user nova-compute[74342]: INFO nova.compute.manager [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Took 1.39 seconds to destroy the instance on the hypervisor.
Oct 16 10:04:03 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 10:04:03 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 10:04:04 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:04:04 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Took 1.03 seconds to deallocate network for instance.
Oct 16 10:04:05 user nova-compute[74342]: DEBUG nova.compute.manager [req-bd27b192-5f90-415e-bd8e-b31999dcfb03 req-b0023e02-b251-453e-8d2d-5a12fa23f651 service nova] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Received event network-vif-plugged-2175722a-e6dd-4b7f-ab62-e3974274f81a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:04:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-bd27b192-5f90-415e-bd8e-b31999dcfb03 req-b0023e02-b251-453e-8d2d-5a12fa23f651 service nova] Acquiring lock "9dc7115b-8a02-4ef4-9d44-6590c9fded3e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:04:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-bd27b192-5f90-415e-bd8e-b31999dcfb03 req-b0023e02-b251-453e-8d2d-5a12fa23f651 service nova] Lock "9dc7115b-8a02-4ef4-9d44-6590c9fded3e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:04:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-bd27b192-5f90-415e-bd8e-b31999dcfb03 req-b0023e02-b251-453e-8d2d-5a12fa23f651 service nova] Lock "9dc7115b-8a02-4ef4-9d44-6590c9fded3e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:04:05 user nova-compute[74342]: DEBUG nova.compute.manager [req-bd27b192-5f90-415e-bd8e-b31999dcfb03 req-b0023e02-b251-453e-8d2d-5a12fa23f651 service nova] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] No waiting events found dispatching network-vif-plugged-2175722a-e6dd-4b7f-ab62-e3974274f81a {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:04:05 user nova-compute[74342]: WARNING nova.compute.manager [req-bd27b192-5f90-415e-bd8e-b31999dcfb03 req-b0023e02-b251-453e-8d2d-5a12fa23f651 service nova] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Received unexpected event network-vif-plugged-2175722a-e6dd-4b7f-ab62-e3974274f81a for instance with vm_state active and task_state deleting.
Oct 16 10:04:05 user nova-compute[74342]: DEBUG nova.compute.manager [req-bd27b192-5f90-415e-bd8e-b31999dcfb03 req-b0023e02-b251-453e-8d2d-5a12fa23f651 service nova] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Received event network-vif-deleted-2175722a-e6dd-4b7f-ab62-e3974274f81a {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:04:05 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:04:05 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:04:05 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:04:05 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:04:05 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:04:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-d7607dcc-e70e-42fb-9421-c5f630706241" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:04:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-d7607dcc-e70e-42fb-9421-c5f630706241" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:04:05 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:04:05 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Updating instance_info_cache with network_info: [{"id": "f9bd07aa-abd7-4ff6-afd3-388251345ec0", "address": "fa:16:3e:f5:80:2e", "network": {"id": "19a96357-4b1f-4da6-a8f4-795a37500116", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1856971527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8a3c19c78264cc7a4083e20cf4598ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9bd07aa-ab", "ovs_interfaceid": "f9bd07aa-abd7-4ff6-afd3-388251345ec0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:04:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-d7607dcc-e70e-42fb-9421-c5f630706241" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:04:05 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:04:07 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:04:07 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:04:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:08 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:04:08 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:04:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:10 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:04:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:13 user nova-compute[74342]: INFO nova.compute.manager [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Took 8.96 seconds to detach 1 volumes for instance.
Oct 16 10:04:13 user nova-compute[74342]: DEBUG nova.compute.manager [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 9dc7115b-8a02-4ef4-9d44-6590c9fded3e] Deleting volume: 6238337b-9041-4805-bc92-cc3e22047342 {{(pid=74342) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Oct 16 10:04:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:04:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:04:14 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:04:14 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:04:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.203s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:04:14 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Deleted allocations for instance 9dc7115b-8a02-4ef4-9d44-6590c9fded3e
Oct 16 10:04:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-720627de-387a-44b2-9022-cff8ab98fd9c tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "9dc7115b-8a02-4ef4-9d44-6590c9fded3e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 11.948s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:04:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:04:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a820659b-4f84-40cf-9003-991a443b079c tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "98367a96-22f0-4edb-ab03-a8eb286b437b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:04:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a820659b-4f84-40cf-9003-991a443b079c tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "98367a96-22f0-4edb-ab03-a8eb286b437b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:04:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a820659b-4f84-40cf-9003-991a443b079c tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "98367a96-22f0-4edb-ab03-a8eb286b437b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:04:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a820659b-4f84-40cf-9003-991a443b079c tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "98367a96-22f0-4edb-ab03-a8eb286b437b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:04:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a820659b-4f84-40cf-9003-991a443b079c tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "98367a96-22f0-4edb-ab03-a8eb286b437b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:04:19 user nova-compute[74342]: INFO nova.compute.manager [None req-a820659b-4f84-40cf-9003-991a443b079c tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Terminating instance
Oct 16 10:04:19 user nova-compute[74342]: DEBUG nova.compute.manager [None req-a820659b-4f84-40cf-9003-991a443b079c tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 10:04:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:19 user nova-compute[74342]: DEBUG nova.compute.manager [req-6264c013-a69b-4b05-8ef1-205e9c807b65 req-f9103387-c675-4398-9afa-e6844a8d7fa3 service nova] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Received event network-vif-unplugged-75f58c77-45a5-4951-951c-4c0bb6ac8bf3 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:04:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-6264c013-a69b-4b05-8ef1-205e9c807b65 req-f9103387-c675-4398-9afa-e6844a8d7fa3 service nova] Acquiring lock "98367a96-22f0-4edb-ab03-a8eb286b437b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:04:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-6264c013-a69b-4b05-8ef1-205e9c807b65 req-f9103387-c675-4398-9afa-e6844a8d7fa3 service nova] Lock "98367a96-22f0-4edb-ab03-a8eb286b437b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:04:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-6264c013-a69b-4b05-8ef1-205e9c807b65 req-f9103387-c675-4398-9afa-e6844a8d7fa3 service nova] Lock "98367a96-22f0-4edb-ab03-a8eb286b437b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:04:19 user nova-compute[74342]: DEBUG nova.compute.manager [req-6264c013-a69b-4b05-8ef1-205e9c807b65 req-f9103387-c675-4398-9afa-e6844a8d7fa3 service nova] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] No waiting events found dispatching network-vif-unplugged-75f58c77-45a5-4951-951c-4c0bb6ac8bf3 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:04:19 user nova-compute[74342]: DEBUG nova.compute.manager [req-6264c013-a69b-4b05-8ef1-205e9c807b65 req-f9103387-c675-4398-9afa-e6844a8d7fa3 service nova] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Received event network-vif-unplugged-75f58c77-45a5-4951-951c-4c0bb6ac8bf3 for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 10:04:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:19 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Instance destroyed successfully.
Oct 16 10:04:19 user nova-compute[74342]: DEBUG nova.objects.instance [None req-a820659b-4f84-40cf-9003-991a443b079c tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lazy-loading 'resources' on Instance uuid 98367a96-22f0-4edb-ab03-a8eb286b437b {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:04:19 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-a820659b-4f84-40cf-9003-991a443b079c tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:43:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-542181045',display_name='tempest-ServerActionsTestOtherA-server-542181045',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-542181045',id=2,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5Nn7Cd9XA4JGuwKexWOVVgfutTMETbY1OUIw/2Lg/7f8J0Bw2Ei1JnC+VmVg9p5to1vwEeuuESoLWsMybdIS98JRtnBeQn9/1YcrhMFyK9tNXAGp/a4/hIqjXfamZ4kQ==',key_name='tempest-keypair-772403242',keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:44:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='355bac247f9d4ea8b3c2f0d87453f4c1',ramdisk_id='',reservation_id='r-0eoey4qy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1004911708',owner_user_name='tempest-ServerActionsTestOtherA-1004911708-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:44:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e3c728429a0a42789cfc0f1251d6f623',uuid=98367a96-22f0-4edb-ab03-a8eb286b437b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "address": "fa:16:3e:7a:58:71", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f58c77-45", "ovs_interfaceid": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 10:04:19 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-a820659b-4f84-40cf-9003-991a443b079c tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Converting VIF {"id": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "address": "fa:16:3e:7a:58:71", "network": {"id": "b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-409788226-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "355bac247f9d4ea8b3c2f0d87453f4c1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75f58c77-45", "ovs_interfaceid": "75f58c77-45a5-4951-951c-4c0bb6ac8bf3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:04:19 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-a820659b-4f84-40cf-9003-991a443b079c tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:58:71,bridge_name='br-int',has_traffic_filtering=True,id=75f58c77-45a5-4951-951c-4c0bb6ac8bf3,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75f58c77-45') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:04:19 user nova-compute[74342]: DEBUG os_vif [None req-a820659b-4f84-40cf-9003-991a443b079c tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:58:71,bridge_name='br-int',has_traffic_filtering=True,id=75f58c77-45a5-4951-951c-4c0bb6ac8bf3,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75f58c77-45') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 10:04:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75f58c77-45, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:04:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:04:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f37cbab4-6de2-4ac9-b383-339c85142525) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:04:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:19 user nova-compute[74342]: INFO os_vif [None req-a820659b-4f84-40cf-9003-991a443b079c tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:58:71,bridge_name='br-int',has_traffic_filtering=True,id=75f58c77-45a5-4951-951c-4c0bb6ac8bf3,network=Network(b1e3dbef-f6f7-4e72-aef5-3cda21cbdbb2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75f58c77-45')
Oct 16 10:04:19 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-a820659b-4f84-40cf-9003-991a443b079c tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Deleting instance files /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b_del
Oct 16 10:04:19 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-a820659b-4f84-40cf-9003-991a443b079c tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Deletion of /opt/stack/data/nova/instances/98367a96-22f0-4edb-ab03-a8eb286b437b_del complete
Oct 16 10:04:20 user nova-compute[74342]: INFO nova.compute.manager [None req-a820659b-4f84-40cf-9003-991a443b079c tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Took 0.70 seconds to destroy the instance on the hypervisor.
Oct 16 10:04:20 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-a820659b-4f84-40cf-9003-991a443b079c tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 10:04:20 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 10:04:20 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 10:04:20 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:04:20 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Took 0.39 seconds to deallocate network for instance.
Oct 16 10:04:20 user nova-compute[74342]: DEBUG nova.compute.manager [req-525222ff-707f-465c-b47e-6c9a939a1e77 req-2ead32dd-6e1d-498c-ac40-42f54bdb0fa0 service nova] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Received event network-vif-deleted-75f58c77-45a5-4951-951c-4c0bb6ac8bf3 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:04:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a820659b-4f84-40cf-9003-991a443b079c tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:04:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a820659b-4f84-40cf-9003-991a443b079c tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:04:20 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-a820659b-4f84-40cf-9003-991a443b079c tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:04:20 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-a820659b-4f84-40cf-9003-991a443b079c tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:04:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a820659b-4f84-40cf-9003-991a443b079c tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:04:20 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-a820659b-4f84-40cf-9003-991a443b079c tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Deleted allocations for instance 98367a96-22f0-4edb-ab03-a8eb286b437b
Oct 16 10:04:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a820659b-4f84-40cf-9003-991a443b079c tempest-ServerActionsTestOtherA-1004911708 tempest-ServerActionsTestOtherA-1004911708-project-member] Lock "98367a96-22f0-4edb-ab03-a8eb286b437b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.467s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:04:21 user nova-compute[74342]: DEBUG nova.compute.manager [req-f7dcb82c-d106-4bf6-8f49-4f7c0cf2d58b req-2d487b6b-c885-40f7-99e1-84e884ac83b3 service nova] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Received event network-vif-plugged-75f58c77-45a5-4951-951c-4c0bb6ac8bf3 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:04:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f7dcb82c-d106-4bf6-8f49-4f7c0cf2d58b req-2d487b6b-c885-40f7-99e1-84e884ac83b3 service nova] Acquiring lock "98367a96-22f0-4edb-ab03-a8eb286b437b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:04:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f7dcb82c-d106-4bf6-8f49-4f7c0cf2d58b req-2d487b6b-c885-40f7-99e1-84e884ac83b3 service nova] Lock "98367a96-22f0-4edb-ab03-a8eb286b437b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:04:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f7dcb82c-d106-4bf6-8f49-4f7c0cf2d58b req-2d487b6b-c885-40f7-99e1-84e884ac83b3 service nova] Lock "98367a96-22f0-4edb-ab03-a8eb286b437b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:04:21 user nova-compute[74342]: DEBUG nova.compute.manager [req-f7dcb82c-d106-4bf6-8f49-4f7c0cf2d58b req-2d487b6b-c885-40f7-99e1-84e884ac83b3 service nova] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] No waiting events found dispatching network-vif-plugged-75f58c77-45a5-4951-951c-4c0bb6ac8bf3 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:04:21 user nova-compute[74342]: WARNING nova.compute.manager [req-f7dcb82c-d106-4bf6-8f49-4f7c0cf2d58b req-2d487b6b-c885-40f7-99e1-84e884ac83b3 service nova] [instance: 98367a96-22f0-4edb-ab03-a8eb286b437b] Received unexpected event network-vif-plugged-75f58c77-45a5-4951-951c-4c0bb6ac8bf3 for instance with vm_state deleted and task_state None.
Oct 16 10:04:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:04:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:04:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:04:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:04:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:04:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:04:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:04:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:04:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:04:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:04:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:54 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:59 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:04:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:04:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:04:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:04:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:04:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:04:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:00 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:05:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:05:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:05:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:05:00 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:05:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ebd3fd-b258-48b4-ab51-a97ba8174c30/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:05:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ebd3fd-b258-48b4-ab51-a97ba8174c30/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:05:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ebd3fd-b258-48b4-ab51-a97ba8174c30/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:05:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ebd3fd-b258-48b4-ab51-a97ba8174c30/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:05:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:05:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:05:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:05:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:05:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:05:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:05:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:05:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:05:02 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:05:02 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:05:02 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8602MB free_disk=25.15892791748047GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:05:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:05:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:05:02 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance d7607dcc-e70e-42fb-9421-c5f630706241 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:05:02 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance f0f4fa14-f586-47f0-a79e-4ee095c9fb39 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:05:02 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 79ebd3fd-b258-48b4-ab51-a97ba8174c30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:05:02 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:05:02 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:05:02 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:05:02 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:05:02 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:05:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.335s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:05:02 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:05:02 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Cleaning up deleted instances {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 10:05:02 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] There are 1 instances to clean {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 10:05:02 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Instance has had 3 of 5 cleanup attempts {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 16 10:05:02 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Deletion of /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd_resize failed
Oct 16 10:05:04 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:05:04 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:05:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:05 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:05:05 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:05:06 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:05:06 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:05:06 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Didn't find any instances for network info cache update. {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 10:05:08 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:05:09 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:05:09 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:05:09 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:05:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:05:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:15 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:05:15 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74342) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 10:05:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7d07d8c4-f8da-4a08-befd-4fab1f670673 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:05:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7d07d8c4-f8da-4a08-befd-4fab1f670673 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:05:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7d07d8c4-f8da-4a08-befd-4fab1f670673 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:05:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7d07d8c4-f8da-4a08-befd-4fab1f670673 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:05:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7d07d8c4-f8da-4a08-befd-4fab1f670673 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:05:19 user nova-compute[74342]: INFO nova.compute.manager [None req-7d07d8c4-f8da-4a08-befd-4fab1f670673 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Terminating instance
Oct 16 10:05:19 user nova-compute[74342]: DEBUG nova.compute.manager [None req-7d07d8c4-f8da-4a08-befd-4fab1f670673 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 10:05:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:20 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Instance destroyed successfully.
Oct 16 10:05:20 user nova-compute[74342]: DEBUG nova.objects.instance [None req-7d07d8c4-f8da-4a08-befd-4fab1f670673 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lazy-loading 'resources' on Instance uuid f0f4fa14-f586-47f0-a79e-4ee095c9fb39 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:05:20 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-7d07d8c4-f8da-4a08-befd-4fab1f670673 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-10-16T09:59:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-727193916',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-727193916',id=33,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNPrRDSK3jvDbnQw/5jWArlxh2TAUgBAtuKsNHsVciPvzxhAfuT7d3dBJZcZofN8JgfQLBmHOImdCmqkbGxOEwutBU9f8xpybWUVPbbfi1MZkmOV5UxkGtk3p/ZJL9mGwg==',key_name='tempest-keypair-150707378',keypairs=<?>,launch_index=0,launched_at=2023-10-16T10:03:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a70b9ea5f3404a5690cd0a73db23f034',ramdisk_id='',reservation_id='r-0e1oe4y4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-939526853',owner_user_name='tempest-AttachVolumeShelveTestJSON-939526853-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T10:03:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c8bf8aa8ab2d4105ad0b1fd04247e3a0',uuid=f0f4fa14-f586-47f0-a79e-4ee095c9fb39,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "address": "fa:16:3e:80:ef:28", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9a0d7-fd", "ovs_interfaceid": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 10:05:20 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-7d07d8c4-f8da-4a08-befd-4fab1f670673 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Converting VIF {"id": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "address": "fa:16:3e:80:ef:28", "network": {"id": "bbeb1d70-a5dc-46d6-a0dd-240bf3018d31", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-521178011-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.192", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a70b9ea5f3404a5690cd0a73db23f034", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bd9a0d7-fd", "ovs_interfaceid": "6bd9a0d7-fd42-4686-b4a8-af790582008d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:05:20 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-7d07d8c4-f8da-4a08-befd-4fab1f670673 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:ef:28,bridge_name='br-int',has_traffic_filtering=True,id=6bd9a0d7-fd42-4686-b4a8-af790582008d,network=Network(bbeb1d70-a5dc-46d6-a0dd-240bf3018d31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd9a0d7-fd') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:05:20 user nova-compute[74342]: DEBUG os_vif [None req-7d07d8c4-f8da-4a08-befd-4fab1f670673 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:ef:28,bridge_name='br-int',has_traffic_filtering=True,id=6bd9a0d7-fd42-4686-b4a8-af790582008d,network=Network(bbeb1d70-a5dc-46d6-a0dd-240bf3018d31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd9a0d7-fd') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 10:05:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6bd9a0d7-fd, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:05:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:05:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d096727b-26ce-4e76-aab5-06608b4165db) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:05:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:05:20 user nova-compute[74342]: INFO os_vif [None req-7d07d8c4-f8da-4a08-befd-4fab1f670673 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:ef:28,bridge_name='br-int',has_traffic_filtering=True,id=6bd9a0d7-fd42-4686-b4a8-af790582008d,network=Network(bbeb1d70-a5dc-46d6-a0dd-240bf3018d31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bd9a0d7-fd')
Oct 16 10:05:20 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-7d07d8c4-f8da-4a08-befd-4fab1f670673 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Deleting instance files /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39_del
Oct 16 10:05:20 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-7d07d8c4-f8da-4a08-befd-4fab1f670673 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Deletion of /opt/stack/data/nova/instances/f0f4fa14-f586-47f0-a79e-4ee095c9fb39_del complete
Oct 16 10:05:20 user nova-compute[74342]: INFO nova.compute.manager [None req-7d07d8c4-f8da-4a08-befd-4fab1f670673 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Took 0.89 seconds to destroy the instance on the hypervisor.
Oct 16 10:05:20 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-7d07d8c4-f8da-4a08-befd-4fab1f670673 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 10:05:20 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 10:05:20 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 10:05:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "7c10cb66-71de-448e-9cb6-fc7e2ef466a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:05:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "7c10cb66-71de-448e-9cb6-fc7e2ef466a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:05:20 user nova-compute[74342]: DEBUG nova.compute.manager [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 10:05:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:05:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:05:20 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 10:05:20 user nova-compute[74342]: INFO nova.compute.claims [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Claim successful on node user
Oct 16 10:05:20 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:05:20 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:05:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.390s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:05:20 user nova-compute[74342]: DEBUG nova.compute.manager [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 10:05:21 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:05:21 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Took 0.86 seconds to deallocate network for instance.
Oct 16 10:05:21 user nova-compute[74342]: DEBUG nova.compute.manager [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 10:05:21 user nova-compute[74342]: DEBUG nova.network.neutron [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 10:05:21 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 10:05:21 user nova-compute[74342]: DEBUG nova.compute.manager [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 10:05:21 user nova-compute[74342]: DEBUG nova.policy [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2cac31e799b743359b93943b68b38acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799c265b3d14465a9ca6bd7d5e8a4488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 10:05:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7d07d8c4-f8da-4a08-befd-4fab1f670673 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:05:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7d07d8c4-f8da-4a08-befd-4fab1f670673 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:05:21 user nova-compute[74342]: INFO nova.virt.block_device [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Booting with volume 9bd3971e-40e0-42a8-9105-740cb01b7562 at /dev/vda
Oct 16 10:05:21 user nova-compute[74342]: DEBUG nova.compute.manager [req-0d6751bc-eb0f-4ba4-9c15-a3cebdd3dff6 req-19878997-d9ee-4e58-800e-5eebb3028de7 service nova] [instance: f0f4fa14-f586-47f0-a79e-4ee095c9fb39] Received event network-vif-deleted-6bd9a0d7-fd42-4686-b4a8-af790582008d {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:05:21 user nova-compute[74342]: DEBUG os_brick.utils [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:05:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:05:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:05:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[39bc360a-19fa-4661-b94a-d1e98e2b2c4f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:05:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:05:21 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-7d07d8c4-f8da-4a08-befd-4fab1f670673 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:05:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:05:21 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-7d07d8c4-f8da-4a08-befd-4fab1f670673 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:05:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb33852a-0629-4e5a-8336-1c345e569545]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:05:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:05:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:05:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ffa7b7-4a34-44d8-926f-6f9be8b51928]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:05:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7d07d8c4-f8da-4a08-befd-4fab1f670673 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.191s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:05:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee69de6-02b2-49a4-9b8e-2964cf68d4e2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:05:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:05:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:05:21 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-7d07d8c4-f8da-4a08-befd-4fab1f670673 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Deleted allocations for instance f0f4fa14-f586-47f0-a79e-4ee095c9fb39
Oct 16 10:05:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 10:05:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:05:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:05:21 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 10:05:21 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc815f3-23ad-4438-bc72-e07611b48de4]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:05:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 10:05:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 10:05:21 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 10:05:21 user nova-compute[74342]: DEBUG os_brick.utils [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:05:21 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Updating existing volume attachment record: e47fca9e-bfe4-4f76-aa77-0efc8cdc14dd {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 10:05:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7d07d8c4-f8da-4a08-befd-4fab1f670673 tempest-AttachVolumeShelveTestJSON-939526853 tempest-AttachVolumeShelveTestJSON-939526853-project-member] Lock "f0f4fa14-f586-47f0-a79e-4ee095c9fb39" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.203s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:05:22 user nova-compute[74342]: DEBUG nova.network.neutron [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Successfully created port: b4f10a48-743b-4e0f-8909-0ada6ad36930 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 10:05:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "34ef7d18-0724-479a-8448-981b9cf0d6ab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:05:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:05:22 user nova-compute[74342]: DEBUG nova.compute.manager [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 10:05:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:05:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:05:22 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 10:05:22 user nova-compute[74342]: INFO nova.compute.claims [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Claim successful on node user
Oct 16 10:05:22 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:05:22 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:05:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:05:22 user nova-compute[74342]: DEBUG nova.compute.manager [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 10:05:22 user nova-compute[74342]: DEBUG nova.network.neutron [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Successfully updated port: b4f10a48-743b-4e0f-8909-0ada6ad36930 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 10:05:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "refresh_cache-7c10cb66-71de-448e-9cb6-fc7e2ef466a2" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:05:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquired lock "refresh_cache-7c10cb66-71de-448e-9cb6-fc7e2ef466a2" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:05:22 user nova-compute[74342]: DEBUG nova.network.neutron [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:05:22 user nova-compute[74342]: DEBUG nova.compute.manager [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 10:05:22 user nova-compute[74342]: DEBUG nova.network.neutron [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 10:05:22 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 10:05:23 user nova-compute[74342]: DEBUG nova.compute.manager [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG nova.network.neutron [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG nova.compute.manager [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 10:05:23 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Creating image(s)
Oct 16 10:05:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "/opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "/opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "/opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG nova.policy [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2ca9ac24fcad4d9fbf8cb2fd7ec6a3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2453f549532c465da8952474a5218357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "7d016ab3-14c4-4c33-bd50-468f71339cd7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "7d016ab3-14c4-4c33-bd50-468f71339cd7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG nova.compute.manager [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG nova.compute.manager [req-d270682d-81fd-46aa-9f0b-6203ab49fc31 req-10de25c2-eb75-4fbe-8ed2-59311155de42 service nova] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Received event network-changed-b4f10a48-743b-4e0f-8909-0ada6ad36930 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG nova.compute.manager [req-d270682d-81fd-46aa-9f0b-6203ab49fc31 req-10de25c2-eb75-4fbe-8ed2-59311155de42 service nova] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Refreshing instance network info cache due to event network-changed-b4f10a48-743b-4e0f-8909-0ada6ad36930. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d270682d-81fd-46aa-9f0b-6203ab49fc31 req-10de25c2-eb75-4fbe-8ed2-59311155de42 service nova] Acquiring lock "refresh_cache-7c10cb66-71de-448e-9cb6-fc7e2ef466a2" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 10:05:23 user nova-compute[74342]: INFO nova.compute.claims [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Claim successful on node user
Oct 16 10:05:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.214s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.186s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG nova.network.neutron [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Updating instance_info_cache with network_info: [{"id": "b4f10a48-743b-4e0f-8909-0ada6ad36930", "address": "fa:16:3e:69:74:44", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4f10a48-74", "ovs_interfaceid": "b4f10a48-743b-4e0f-8909-0ada6ad36930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk 1073741824" returned: 0 in 0.069s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Releasing lock "refresh_cache-7c10cb66-71de-448e-9cb6-fc7e2ef466a2" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG nova.compute.manager [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Instance network_info: |[{"id": "b4f10a48-743b-4e0f-8909-0ada6ad36930", "address": "fa:16:3e:69:74:44", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4f10a48-74", "ovs_interfaceid": "b4f10a48-743b-4e0f-8909-0ada6ad36930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d270682d-81fd-46aa-9f0b-6203ab49fc31 req-10de25c2-eb75-4fbe-8ed2-59311155de42 service nova] Acquired lock "refresh_cache-7c10cb66-71de-448e-9cb6-fc7e2ef466a2" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG nova.network.neutron [req-d270682d-81fd-46aa-9f0b-6203ab49fc31 req-10de25c2-eb75-4fbe-8ed2-59311155de42 service nova] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Refreshing network info cache for port b4f10a48-743b-4e0f-8909-0ada6ad36930 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.446s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG nova.compute.manager [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.225s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Checking if we can resize image /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG nova.compute.manager [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 10:05:23 user nova-compute[74342]: DEBUG nova.network.neutron [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 10:05:23 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 10:05:23 user nova-compute[74342]: DEBUG nova.compute.manager [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.249s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Cannot resize image /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Ensure instance console log exists: /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG nova.compute.manager [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 10:05:24 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Creating image(s)
Oct 16 10:05:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "/opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "/opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG nova.policy [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2ca9ac24fcad4d9fbf8cb2fd7ec6a3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2453f549532c465da8952474a5218357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG nova.network.neutron [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Successfully created port: 1495980a-a474-4a07-a8d1-27521ae89be7 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG nova.network.neutron [req-d270682d-81fd-46aa-9f0b-6203ab49fc31 req-10de25c2-eb75-4fbe-8ed2-59311155de42 service nova] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Updated VIF entry in instance network info cache for port b4f10a48-743b-4e0f-8909-0ada6ad36930. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG nova.network.neutron [req-d270682d-81fd-46aa-9f0b-6203ab49fc31 req-10de25c2-eb75-4fbe-8ed2-59311155de42 service nova] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Updating instance_info_cache with network_info: [{"id": "b4f10a48-743b-4e0f-8909-0ada6ad36930", "address": "fa:16:3e:69:74:44", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4f10a48-74", "ovs_interfaceid": "b4f10a48-743b-4e0f-8909-0ada6ad36930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d270682d-81fd-46aa-9f0b-6203ab49fc31 req-10de25c2-eb75-4fbe-8ed2-59311155de42 service nova] Releasing lock "refresh_cache-7c10cb66-71de-448e-9cb6-fc7e2ef466a2" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.197s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG nova.compute.manager [req-a9a5de8b-dfbd-4b1d-9a8a-8ed9b54b2525 req-e10d847e-cb8f-40c3-9e58-e6cc84ebcb83 service nova] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Received event network-changed-6bb97021-afe7-4ea2-9237-3b0d5a410034 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG nova.compute.manager [req-a9a5de8b-dfbd-4b1d-9a8a-8ed9b54b2525 req-e10d847e-cb8f-40c3-9e58-e6cc84ebcb83 service nova] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Refreshing instance network info cache due to event network-changed-6bb97021-afe7-4ea2-9237-3b0d5a410034. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a9a5de8b-dfbd-4b1d-9a8a-8ed9b54b2525 req-e10d847e-cb8f-40c3-9e58-e6cc84ebcb83 service nova] Acquiring lock "refresh_cache-79ebd3fd-b258-48b4-ab51-a97ba8174c30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a9a5de8b-dfbd-4b1d-9a8a-8ed9b54b2525 req-e10d847e-cb8f-40c3-9e58-e6cc84ebcb83 service nova] Acquired lock "refresh_cache-79ebd3fd-b258-48b4-ab51-a97ba8174c30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG nova.network.neutron [req-a9a5de8b-dfbd-4b1d-9a8a-8ed9b54b2525 req-e10d847e-cb8f-40c3-9e58-e6cc84ebcb83 service nova] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Refreshing network info cache for port 6bb97021-afe7-4ea2-9237-3b0d5a410034 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.211s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk 1073741824" returned: 0 in 0.050s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG nova.network.neutron [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Successfully created port: a74fa1b3-860c-44de-bc9d-207dc8ec9982 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.213s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Cannot resize image /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Ensure instance console log exists: /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:05:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.network.neutron [req-a9a5de8b-dfbd-4b1d-9a8a-8ed9b54b2525 req-e10d847e-cb8f-40c3-9e58-e6cc84ebcb83 service nova] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Updated VIF entry in instance network info cache for port 6bb97021-afe7-4ea2-9237-3b0d5a410034. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.network.neutron [req-a9a5de8b-dfbd-4b1d-9a8a-8ed9b54b2525 req-e10d847e-cb8f-40c3-9e58-e6cc84ebcb83 service nova] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Updating instance_info_cache with network_info: [{"id": "6bb97021-afe7-4ea2-9237-3b0d5a410034", "address": "fa:16:3e:1f:d6:92", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bb97021-af", "ovs_interfaceid": "6bb97021-afe7-4ea2-9237-3b0d5a410034", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.network.neutron [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Successfully updated port: 1495980a-a474-4a07-a8d1-27521ae89be7 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a9a5de8b-dfbd-4b1d-9a8a-8ed9b54b2525 req-e10d847e-cb8f-40c3-9e58-e6cc84ebcb83 service nova] Releasing lock "refresh_cache-79ebd3fd-b258-48b4-ab51-a97ba8174c30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.network.neutron [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Successfully updated port: a74fa1b3-860c-44de-bc9d-207dc8ec9982 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "refresh_cache-34ef7d18-0724-479a-8448-981b9cf0d6ab" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquired lock "refresh_cache-34ef7d18-0724-479a-8448-981b9cf0d6ab" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.network.neutron [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "refresh_cache-7d016ab3-14c4-4c33-bd50-468f71339cd7" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquired lock "refresh_cache-7d016ab3-14c4-4c33-bd50-468f71339cd7" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.network.neutron [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.compute.manager [req-c2b1b8dc-27da-4e17-847d-9beeab29343d req-a152a5f6-996d-465a-985c-734cde544a6e service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Received event network-changed-1495980a-a474-4a07-a8d1-27521ae89be7 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.compute.manager [req-c2b1b8dc-27da-4e17-847d-9beeab29343d req-a152a5f6-996d-465a-985c-734cde544a6e service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Refreshing instance network info cache due to event network-changed-1495980a-a474-4a07-a8d1-27521ae89be7. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c2b1b8dc-27da-4e17-847d-9beeab29343d req-a152a5f6-996d-465a-985c-734cde544a6e service nova] Acquiring lock "refresh_cache-34ef7d18-0724-479a-8448-981b9cf0d6ab" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.network.neutron [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.network.neutron [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.network.neutron [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Updating instance_info_cache with network_info: [{"id": "1495980a-a474-4a07-a8d1-27521ae89be7", "address": "fa:16:3e:0e:3e:44", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1495980a-a4", "ovs_interfaceid": "1495980a-a474-4a07-a8d1-27521ae89be7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.network.neutron [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Updating instance_info_cache with network_info: [{"id": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "address": "fa:16:3e:de:cb:e3", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74fa1b3-86", "ovs_interfaceid": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Releasing lock "refresh_cache-34ef7d18-0724-479a-8448-981b9cf0d6ab" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.compute.manager [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Instance network_info: |[{"id": "1495980a-a474-4a07-a8d1-27521ae89be7", "address": "fa:16:3e:0e:3e:44", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1495980a-a4", "ovs_interfaceid": "1495980a-a474-4a07-a8d1-27521ae89be7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c2b1b8dc-27da-4e17-847d-9beeab29343d req-a152a5f6-996d-465a-985c-734cde544a6e service nova] Acquired lock "refresh_cache-34ef7d18-0724-479a-8448-981b9cf0d6ab" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.network.neutron [req-c2b1b8dc-27da-4e17-847d-9beeab29343d req-a152a5f6-996d-465a-985c-734cde544a6e service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Refreshing network info cache for port 1495980a-a474-4a07-a8d1-27521ae89be7 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Start _get_guest_xml network_info=[{"id": "1495980a-a474-4a07-a8d1-27521ae89be7", "address": "fa:16:3e:0e:3e:44", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1495980a-a4", "ovs_interfaceid": "1495980a-a474-4a07-a8d1-27521ae89be7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Releasing lock "refresh_cache-7d016ab3-14c4-4c33-bd50-468f71339cd7" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.compute.manager [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Instance network_info: |[{"id": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "address": "fa:16:3e:de:cb:e3", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74fa1b3-86", "ovs_interfaceid": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Start _get_guest_xml network_info=[{"id": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "address": "fa:16:3e:de:cb:e3", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74fa1b3-86", "ovs_interfaceid": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 10:05:25 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:05:25 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:05:25 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:05:25 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:05:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2002535416',display_name='tempest-ServerRescueNegativeTestJSON-server-2002535416',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2002535416',id=38,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2453f549532c465da8952474a5218357',ramdisk_id='',reservation_id='r-taj2n86i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1027819060',owner_user_name='tempest-ServerRescueNegativeTestJSON-1027819060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:05:23Z,user_data=None,user_id='2ca9ac24fcad4d9fbf8cb2fd7ec6a3f0',uuid=34ef7d18-0724-479a-8448-981b9cf0d6ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1495980a-a474-4a07-a8d1-27521ae89be7", "address": "fa:16:3e:0e:3e:44", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1495980a-a4", "ovs_interfaceid": "1495980a-a474-4a07-a8d1-27521ae89be7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Converting VIF {"id": "1495980a-a474-4a07-a8d1-27521ae89be7", "address": "fa:16:3e:0e:3e:44", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1495980a-a4", "ovs_interfaceid": "1495980a-a474-4a07-a8d1-27521ae89be7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:3e:44,bridge_name='br-int',has_traffic_filtering=True,id=1495980a-a474-4a07-a8d1-27521ae89be7,network=Network(c8edc360-319a-4e77-8af6-5b8e7a87ae82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1495980a-a4') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.objects.instance [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lazy-loading 'pci_devices' on Instance uuid 34ef7d18-0724-479a-8448-981b9cf0d6ab {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:05:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-360954549',display_name='tempest-ServerRescueNegativeTestJSON-server-360954549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-360954549',id=39,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2453f549532c465da8952474a5218357',ramdisk_id='',reservation_id='r-pmlvt0py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1027819060',owner_user_name='tempest-ServerRescueNegativeTestJSON-1027819060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:05:24Z,user_data=None,user_id='2ca9ac24fcad4d9fbf8cb2fd7ec6a3f0',uuid=7d016ab3-14c4-4c33-bd50-468f71339cd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "address": "fa:16:3e:de:cb:e3", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74fa1b3-86", "ovs_interfaceid": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Converting VIF {"id": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "address": "fa:16:3e:de:cb:e3", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74fa1b3-86", "ovs_interfaceid": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:cb:e3,bridge_name='br-int',has_traffic_filtering=True,id=a74fa1b3-860c-44de-bc9d-207dc8ec9982,network=Network(c8edc360-319a-4e77-8af6-5b8e7a87ae82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa74fa1b3-86') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.objects.instance [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d016ab3-14c4-4c33-bd50-468f71339cd7 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] End _get_guest_xml xml=<domain type="kvm">
Oct 16 10:05:25 user nova-compute[74342]:   <uuid>34ef7d18-0724-479a-8448-981b9cf0d6ab</uuid>
Oct 16 10:05:25 user nova-compute[74342]:   <name>instance-00000026</name>
Oct 16 10:05:25 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 10:05:25 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 10:05:25 user nova-compute[74342]:   <metadata>
Oct 16 10:05:25 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 10:05:25 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 10:05:25 user nova-compute[74342]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2002535416</nova:name>
Oct 16 10:05:25 user nova-compute[74342]:       <nova:creationTime>2023-10-16 10:05:25</nova:creationTime>
Oct 16 10:05:25 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 10:05:25 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 10:05:25 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 10:05:25 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 10:05:25 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 10:05:25 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 10:05:25 user nova-compute[74342]:       </nova:flavor>
Oct 16 10:05:25 user nova-compute[74342]:       <nova:owner>
Oct 16 10:05:25 user nova-compute[74342]:         <nova:user uuid="2ca9ac24fcad4d9fbf8cb2fd7ec6a3f0">tempest-ServerRescueNegativeTestJSON-1027819060-project-member</nova:user>
Oct 16 10:05:25 user nova-compute[74342]:         <nova:project uuid="2453f549532c465da8952474a5218357">tempest-ServerRescueNegativeTestJSON-1027819060</nova:project>
Oct 16 10:05:25 user nova-compute[74342]:       </nova:owner>
Oct 16 10:05:25 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 10:05:25 user nova-compute[74342]:       <nova:ports>
Oct 16 10:05:25 user nova-compute[74342]:         <nova:port uuid="1495980a-a474-4a07-a8d1-27521ae89be7">
Oct 16 10:05:25 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 16 10:05:25 user nova-compute[74342]:         </nova:port>
Oct 16 10:05:25 user nova-compute[74342]:       </nova:ports>
Oct 16 10:05:25 user nova-compute[74342]:     </nova:instance>
Oct 16 10:05:25 user nova-compute[74342]:   </metadata>
Oct 16 10:05:25 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 10:05:25 user nova-compute[74342]:     <system>
Oct 16 10:05:25 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 10:05:25 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 10:05:25 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 10:05:25 user nova-compute[74342]:       <entry name="serial">34ef7d18-0724-479a-8448-981b9cf0d6ab</entry>
Oct 16 10:05:25 user nova-compute[74342]:       <entry name="uuid">34ef7d18-0724-479a-8448-981b9cf0d6ab</entry>
Oct 16 10:05:25 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 10:05:25 user nova-compute[74342]:     </system>
Oct 16 10:05:25 user nova-compute[74342]:   </sysinfo>
Oct 16 10:05:25 user nova-compute[74342]:   <os>
Oct 16 10:05:25 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 10:05:25 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 10:05:25 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 10:05:25 user nova-compute[74342]:   </os>
Oct 16 10:05:25 user nova-compute[74342]:   <features>
Oct 16 10:05:25 user nova-compute[74342]:     <acpi/>
Oct 16 10:05:25 user nova-compute[74342]:     <apic/>
Oct 16 10:05:25 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 10:05:25 user nova-compute[74342]:   </features>
Oct 16 10:05:25 user nova-compute[74342]:   <clock offset="utc">
Oct 16 10:05:25 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 10:05:25 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 10:05:25 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 10:05:25 user nova-compute[74342]:   </clock>
Oct 16 10:05:25 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 10:05:25 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 10:05:25 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 10:05:25 user nova-compute[74342]:   </cpu>
Oct 16 10:05:25 user nova-compute[74342]:   <devices>
Oct 16 10:05:25 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 10:05:25 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 10:05:25 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk"/>
Oct 16 10:05:25 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 10:05:25 user nova-compute[74342]:     </disk>
Oct 16 10:05:25 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 10:05:25 user nova-compute[74342]:       <mac address="fa:16:3e:0e:3e:44"/>
Oct 16 10:05:25 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:05:25 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 10:05:25 user nova-compute[74342]:       <target dev="tap1495980a-a4"/>
Oct 16 10:05:25 user nova-compute[74342]:     </interface>
Oct 16 10:05:25 user nova-compute[74342]:     <serial type="pty">
Oct 16 10:05:25 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/console.log" append="off"/>
Oct 16 10:05:25 user nova-compute[74342]:     </serial>
Oct 16 10:05:25 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 10:05:25 user nova-compute[74342]:     <video>
Oct 16 10:05:25 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:05:25 user nova-compute[74342]:     </video>
Oct 16 10:05:25 user nova-compute[74342]:     <rng model="virtio">
Oct 16 10:05:25 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 10:05:25 user nova-compute[74342]:     </rng>
Oct 16 10:05:25 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 10:05:25 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 10:05:25 user nova-compute[74342]:       <stats period="10"/>
Oct 16 10:05:25 user nova-compute[74342]:     </memballoon>
Oct 16 10:05:25 user nova-compute[74342]:   </devices>
Oct 16 10:05:25 user nova-compute[74342]: </domain>
Oct 16 10:05:25 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:05:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2002535416',display_name='tempest-ServerRescueNegativeTestJSON-server-2002535416',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2002535416',id=38,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2453f549532c465da8952474a5218357',ramdisk_id='',reservation_id='r-taj2n86i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1027819060',owner_user_name='tempest-ServerRescueNegativeTestJSON-1027819060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:05:23Z,user_data=None,user_id='2ca9ac24fcad4d9fbf8cb2fd7ec6a3f0',uuid=34ef7d18-0724-479a-8448-981b9cf0d6ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1495980a-a474-4a07-a8d1-27521ae89be7", "address": "fa:16:3e:0e:3e:44", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1495980a-a4", "ovs_interfaceid": "1495980a-a474-4a07-a8d1-27521ae89be7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Converting VIF {"id": "1495980a-a474-4a07-a8d1-27521ae89be7", "address": "fa:16:3e:0e:3e:44", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1495980a-a4", "ovs_interfaceid": "1495980a-a474-4a07-a8d1-27521ae89be7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:3e:44,bridge_name='br-int',has_traffic_filtering=True,id=1495980a-a474-4a07-a8d1-27521ae89be7,network=Network(c8edc360-319a-4e77-8af6-5b8e7a87ae82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1495980a-a4') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG os_vif [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:3e:44,bridge_name='br-int',has_traffic_filtering=True,id=1495980a-a474-4a07-a8d1-27521ae89be7,network=Network(c8edc360-319a-4e77-8af6-5b8e7a87ae82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1495980a-a4') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a2cc814-e531-5d21-9a81-45ffb82e676e', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] End _get_guest_xml xml=<domain type="kvm">
Oct 16 10:05:25 user nova-compute[74342]:   <uuid>7d016ab3-14c4-4c33-bd50-468f71339cd7</uuid>
Oct 16 10:05:25 user nova-compute[74342]:   <name>instance-00000027</name>
Oct 16 10:05:25 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 10:05:25 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 10:05:25 user nova-compute[74342]:   <metadata>
Oct 16 10:05:25 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 10:05:25 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 10:05:25 user nova-compute[74342]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-360954549</nova:name>
Oct 16 10:05:25 user nova-compute[74342]:       <nova:creationTime>2023-10-16 10:05:25</nova:creationTime>
Oct 16 10:05:25 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 10:05:25 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 10:05:25 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 10:05:25 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 10:05:25 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 10:05:25 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 10:05:25 user nova-compute[74342]:       </nova:flavor>
Oct 16 10:05:25 user nova-compute[74342]:       <nova:owner>
Oct 16 10:05:25 user nova-compute[74342]:         <nova:user uuid="2ca9ac24fcad4d9fbf8cb2fd7ec6a3f0">tempest-ServerRescueNegativeTestJSON-1027819060-project-member</nova:user>
Oct 16 10:05:25 user nova-compute[74342]:         <nova:project uuid="2453f549532c465da8952474a5218357">tempest-ServerRescueNegativeTestJSON-1027819060</nova:project>
Oct 16 10:05:25 user nova-compute[74342]:       </nova:owner>
Oct 16 10:05:25 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 10:05:25 user nova-compute[74342]:       <nova:ports>
Oct 16 10:05:25 user nova-compute[74342]:         <nova:port uuid="a74fa1b3-860c-44de-bc9d-207dc8ec9982">
Oct 16 10:05:25 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 16 10:05:25 user nova-compute[74342]:         </nova:port>
Oct 16 10:05:25 user nova-compute[74342]:       </nova:ports>
Oct 16 10:05:25 user nova-compute[74342]:     </nova:instance>
Oct 16 10:05:25 user nova-compute[74342]:   </metadata>
Oct 16 10:05:25 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 10:05:25 user nova-compute[74342]:     <system>
Oct 16 10:05:25 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 10:05:25 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 10:05:25 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 10:05:25 user nova-compute[74342]:       <entry name="serial">7d016ab3-14c4-4c33-bd50-468f71339cd7</entry>
Oct 16 10:05:25 user nova-compute[74342]:       <entry name="uuid">7d016ab3-14c4-4c33-bd50-468f71339cd7</entry>
Oct 16 10:05:25 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 10:05:25 user nova-compute[74342]:     </system>
Oct 16 10:05:25 user nova-compute[74342]:   </sysinfo>
Oct 16 10:05:25 user nova-compute[74342]:   <os>
Oct 16 10:05:25 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 10:05:25 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 10:05:25 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 10:05:25 user nova-compute[74342]:   </os>
Oct 16 10:05:25 user nova-compute[74342]:   <features>
Oct 16 10:05:25 user nova-compute[74342]:     <acpi/>
Oct 16 10:05:25 user nova-compute[74342]:     <apic/>
Oct 16 10:05:25 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 10:05:25 user nova-compute[74342]:   </features>
Oct 16 10:05:25 user nova-compute[74342]:   <clock offset="utc">
Oct 16 10:05:25 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 10:05:25 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 10:05:25 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 10:05:25 user nova-compute[74342]:   </clock>
Oct 16 10:05:25 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 10:05:25 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 10:05:25 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 10:05:25 user nova-compute[74342]:   </cpu>
Oct 16 10:05:25 user nova-compute[74342]:   <devices>
Oct 16 10:05:25 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 10:05:25 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 10:05:25 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk"/>
Oct 16 10:05:25 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 10:05:25 user nova-compute[74342]:     </disk>
Oct 16 10:05:25 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 10:05:25 user nova-compute[74342]:       <mac address="fa:16:3e:de:cb:e3"/>
Oct 16 10:05:25 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:05:25 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 10:05:25 user nova-compute[74342]:       <target dev="tapa74fa1b3-86"/>
Oct 16 10:05:25 user nova-compute[74342]:     </interface>
Oct 16 10:05:25 user nova-compute[74342]:     <serial type="pty">
Oct 16 10:05:25 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/console.log" append="off"/>
Oct 16 10:05:25 user nova-compute[74342]:     </serial>
Oct 16 10:05:25 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 10:05:25 user nova-compute[74342]:     <video>
Oct 16 10:05:25 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:05:25 user nova-compute[74342]:     </video>
Oct 16 10:05:25 user nova-compute[74342]:     <rng model="virtio">
Oct 16 10:05:25 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 10:05:25 user nova-compute[74342]:     </rng>
Oct 16 10:05:25 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 10:05:25 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 10:05:25 user nova-compute[74342]:       <stats period="10"/>
Oct 16 10:05:25 user nova-compute[74342]:     </memballoon>
Oct 16 10:05:25 user nova-compute[74342]:   </devices>
Oct 16 10:05:25 user nova-compute[74342]: </domain>
Oct 16 10:05:25 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:05:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-360954549',display_name='tempest-ServerRescueNegativeTestJSON-server-360954549',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-360954549',id=39,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2453f549532c465da8952474a5218357',ramdisk_id='',reservation_id='r-pmlvt0py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1027819060',owner_user_name='tempest-ServerRescueNegativeTestJSON-1027819060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:05:24Z,user_data=None,user_id='2ca9ac24fcad4d9fbf8cb2fd7ec6a3f0',uuid=7d016ab3-14c4-4c33-bd50-468f71339cd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "address": "fa:16:3e:de:cb:e3", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74fa1b3-86", "ovs_interfaceid": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Converting VIF {"id": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "address": "fa:16:3e:de:cb:e3", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74fa1b3-86", "ovs_interfaceid": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:cb:e3,bridge_name='br-int',has_traffic_filtering=True,id=a74fa1b3-860c-44de-bc9d-207dc8ec9982,network=Network(c8edc360-319a-4e77-8af6-5b8e7a87ae82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa74fa1b3-86') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG os_vif [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:cb:e3,bridge_name='br-int',has_traffic_filtering=True,id=a74fa1b3-860c-44de-bc9d-207dc8ec9982,network=Network(c8edc360-319a-4e77-8af6-5b8e7a87ae82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa74fa1b3-86') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '019ed5de-a9e9-5ad9-962a-e3afc23fd3d9', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1495980a-a4, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1495980a-a4, col_values=(('qos', UUID('206f1801-8aa4-45d7-9bc1-a3c4fe45fe31')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1495980a-a4, col_values=(('external_ids', {'iface-id': '1495980a-a474-4a07-a8d1-27521ae89be7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:3e:44', 'vm-uuid': '34ef7d18-0724-479a-8448-981b9cf0d6ab'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:25 user nova-compute[74342]: INFO os_vif [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:3e:44,bridge_name='br-int',has_traffic_filtering=True,id=1495980a-a474-4a07-a8d1-27521ae89be7,network=Network(c8edc360-319a-4e77-8af6-5b8e7a87ae82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1495980a-a4')
Oct 16 10:05:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa74fa1b3-86, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa74fa1b3-86, col_values=(('qos', UUID('bcedd05a-2593-46cc-b846-f8a4eab2fba6')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa74fa1b3-86, col_values=(('external_ids', {'iface-id': 'a74fa1b3-860c-44de-bc9d-207dc8ec9982', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:cb:e3', 'vm-uuid': '7d016ab3-14c4-4c33-bd50-468f71339cd7'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:25 user nova-compute[74342]: INFO os_vif [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:cb:e3,bridge_name='br-int',has_traffic_filtering=True,id=a74fa1b3-860c-44de-bc9d-207dc8ec9982,network=Network(c8edc360-319a-4e77-8af6-5b8e7a87ae82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa74fa1b3-86')
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:05:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] No VIF found with MAC fa:16:3e:0e:3e:44, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:05:26 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:05:26 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] No VIF found with MAC fa:16:3e:de:cb:e3, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:05:26 user nova-compute[74342]: DEBUG nova.network.neutron [req-c2b1b8dc-27da-4e17-847d-9beeab29343d req-a152a5f6-996d-465a-985c-734cde544a6e service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Updated VIF entry in instance network info cache for port 1495980a-a474-4a07-a8d1-27521ae89be7. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:05:26 user nova-compute[74342]: DEBUG nova.network.neutron [req-c2b1b8dc-27da-4e17-847d-9beeab29343d req-a152a5f6-996d-465a-985c-734cde544a6e service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Updating instance_info_cache with network_info: [{"id": "1495980a-a474-4a07-a8d1-27521ae89be7", "address": "fa:16:3e:0e:3e:44", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1495980a-a4", "ovs_interfaceid": "1495980a-a474-4a07-a8d1-27521ae89be7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:05:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c2b1b8dc-27da-4e17-847d-9beeab29343d req-a152a5f6-996d-465a-985c-734cde544a6e service nova] Releasing lock "refresh_cache-34ef7d18-0724-479a-8448-981b9cf0d6ab" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:05:26 user nova-compute[74342]: DEBUG nova.compute.manager [req-68a11a36-7fe4-4dfd-a349-35c2f334ec54 req-a26820ad-b8da-44b0-9955-93f468ee7d7d service nova] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Received event network-changed-a74fa1b3-860c-44de-bc9d-207dc8ec9982 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:05:26 user nova-compute[74342]: DEBUG nova.compute.manager [req-68a11a36-7fe4-4dfd-a349-35c2f334ec54 req-a26820ad-b8da-44b0-9955-93f468ee7d7d service nova] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Refreshing instance network info cache due to event network-changed-a74fa1b3-860c-44de-bc9d-207dc8ec9982. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:05:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-68a11a36-7fe4-4dfd-a349-35c2f334ec54 req-a26820ad-b8da-44b0-9955-93f468ee7d7d service nova] Acquiring lock "refresh_cache-7d016ab3-14c4-4c33-bd50-468f71339cd7" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:05:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-68a11a36-7fe4-4dfd-a349-35c2f334ec54 req-a26820ad-b8da-44b0-9955-93f468ee7d7d service nova] Acquired lock "refresh_cache-7d016ab3-14c4-4c33-bd50-468f71339cd7" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:05:26 user nova-compute[74342]: DEBUG nova.network.neutron [req-68a11a36-7fe4-4dfd-a349-35c2f334ec54 req-a26820ad-b8da-44b0-9955-93f468ee7d7d service nova] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Refreshing network info cache for port a74fa1b3-860c-44de-bc9d-207dc8ec9982 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:05:26 user nova-compute[74342]: DEBUG nova.network.neutron [req-68a11a36-7fe4-4dfd-a349-35c2f334ec54 req-a26820ad-b8da-44b0-9955-93f468ee7d7d service nova] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Updated VIF entry in instance network info cache for port a74fa1b3-860c-44de-bc9d-207dc8ec9982. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:05:26 user nova-compute[74342]: DEBUG nova.network.neutron [req-68a11a36-7fe4-4dfd-a349-35c2f334ec54 req-a26820ad-b8da-44b0-9955-93f468ee7d7d service nova] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Updating instance_info_cache with network_info: [{"id": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "address": "fa:16:3e:de:cb:e3", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74fa1b3-86", "ovs_interfaceid": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:05:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-68a11a36-7fe4-4dfd-a349-35c2f334ec54 req-a26820ad-b8da-44b0-9955-93f468ee7d7d service nova] Releasing lock "refresh_cache-7d016ab3-14c4-4c33-bd50-468f71339cd7" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:05:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:28 user nova-compute[74342]: DEBUG nova.compute.manager [req-26beae06-4293-4d50-9e27-31581a5c4c2b req-0ea023d2-4c9d-4e6b-b061-b66143e84792 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Received event network-vif-plugged-1495980a-a474-4a07-a8d1-27521ae89be7 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:05:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-26beae06-4293-4d50-9e27-31581a5c4c2b req-0ea023d2-4c9d-4e6b-b061-b66143e84792 service nova] Acquiring lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:05:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-26beae06-4293-4d50-9e27-31581a5c4c2b req-0ea023d2-4c9d-4e6b-b061-b66143e84792 service nova] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:05:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-26beae06-4293-4d50-9e27-31581a5c4c2b req-0ea023d2-4c9d-4e6b-b061-b66143e84792 service nova] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:05:28 user nova-compute[74342]: DEBUG nova.compute.manager [req-26beae06-4293-4d50-9e27-31581a5c4c2b req-0ea023d2-4c9d-4e6b-b061-b66143e84792 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] No waiting events found dispatching network-vif-plugged-1495980a-a474-4a07-a8d1-27521ae89be7 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:05:28 user nova-compute[74342]: WARNING nova.compute.manager [req-26beae06-4293-4d50-9e27-31581a5c4c2b req-0ea023d2-4c9d-4e6b-b061-b66143e84792 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Received unexpected event network-vif-plugged-1495980a-a474-4a07-a8d1-27521ae89be7 for instance with vm_state building and task_state spawning.
Oct 16 10:05:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:05:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:05:29 user nova-compute[74342]: DEBUG nova.objects.instance [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'flavor' on Instance uuid 79ebd3fd-b258-48b4-ab51-a97ba8174c30 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:05:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:05:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:05:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:05:29 user nova-compute[74342]: INFO nova.compute.manager [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Attaching volume fdf3098b-02e6-480c-b522-c09e53665a46 to /dev/vdb
Oct 16 10:05:29 user nova-compute[74342]: DEBUG os_brick.utils [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:05:29 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:05:29 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:05:29 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[52e25d85-699d-4ae8-88c5-180d97ea5cb6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:05:29 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:05:29 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:05:29 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5ec8003-e249-49d0-a2ce-87e91632f55e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:05:29 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:05:29 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:05:29 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfbe4a67-e1d1-4c26-ae1b-d0fc358aa840]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:05:29 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[affa0755-1fe2-4c28-8580-a4b2e03af57f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:05:29 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:05:29 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:05:29 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 10:05:29 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:05:29 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:05:29 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 10:05:29 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5bdb3a-d454-47fe-9b6e-09c0a2873d9a]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:05:29 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 10:05:29 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 10:05:29 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 10:05:29 user nova-compute[74342]: DEBUG os_brick.utils [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:05:29 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Updating existing volume attachment record: 6b0457f1-6b2f-4c16-8ee9-4d19a7ae3d33 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 10:05:30 user nova-compute[74342]: DEBUG nova.compute.manager [req-11c75aaa-4dae-41c5-b34f-ae03f5988d33 req-19da6101-f05c-4256-b49b-0726ba7fb52c service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Received event network-vif-plugged-1495980a-a474-4a07-a8d1-27521ae89be7 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:05:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-11c75aaa-4dae-41c5-b34f-ae03f5988d33 req-19da6101-f05c-4256-b49b-0726ba7fb52c service nova] Acquiring lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:05:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-11c75aaa-4dae-41c5-b34f-ae03f5988d33 req-19da6101-f05c-4256-b49b-0726ba7fb52c service nova] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:05:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-11c75aaa-4dae-41c5-b34f-ae03f5988d33 req-19da6101-f05c-4256-b49b-0726ba7fb52c service nova] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:05:30 user nova-compute[74342]: DEBUG nova.compute.manager [req-11c75aaa-4dae-41c5-b34f-ae03f5988d33 req-19da6101-f05c-4256-b49b-0726ba7fb52c service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] No waiting events found dispatching network-vif-plugged-1495980a-a474-4a07-a8d1-27521ae89be7 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:05:30 user nova-compute[74342]: WARNING nova.compute.manager [req-11c75aaa-4dae-41c5-b34f-ae03f5988d33 req-19da6101-f05c-4256-b49b-0726ba7fb52c service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Received unexpected event network-vif-plugged-1495980a-a474-4a07-a8d1-27521ae89be7 for instance with vm_state building and task_state spawning.
Oct 16 10:05:30 user nova-compute[74342]: DEBUG nova.compute.manager [req-11c75aaa-4dae-41c5-b34f-ae03f5988d33 req-19da6101-f05c-4256-b49b-0726ba7fb52c service nova] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Received event network-vif-plugged-a74fa1b3-860c-44de-bc9d-207dc8ec9982 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:05:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-11c75aaa-4dae-41c5-b34f-ae03f5988d33 req-19da6101-f05c-4256-b49b-0726ba7fb52c service nova] Acquiring lock "7d016ab3-14c4-4c33-bd50-468f71339cd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:05:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-11c75aaa-4dae-41c5-b34f-ae03f5988d33 req-19da6101-f05c-4256-b49b-0726ba7fb52c service nova] Lock "7d016ab3-14c4-4c33-bd50-468f71339cd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:05:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-11c75aaa-4dae-41c5-b34f-ae03f5988d33 req-19da6101-f05c-4256-b49b-0726ba7fb52c service nova] Lock "7d016ab3-14c4-4c33-bd50-468f71339cd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:05:30 user nova-compute[74342]: DEBUG nova.compute.manager [req-11c75aaa-4dae-41c5-b34f-ae03f5988d33 req-19da6101-f05c-4256-b49b-0726ba7fb52c service nova] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] No waiting events found dispatching network-vif-plugged-a74fa1b3-860c-44de-bc9d-207dc8ec9982 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:05:30 user nova-compute[74342]: WARNING nova.compute.manager [req-11c75aaa-4dae-41c5-b34f-ae03f5988d33 req-19da6101-f05c-4256-b49b-0726ba7fb52c service nova] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Received unexpected event network-vif-plugged-a74fa1b3-860c-44de-bc9d-207dc8ec9982 for instance with vm_state building and task_state spawning.
Oct 16 10:05:30 user nova-compute[74342]: DEBUG nova.compute.manager [req-11c75aaa-4dae-41c5-b34f-ae03f5988d33 req-19da6101-f05c-4256-b49b-0726ba7fb52c service nova] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Received event network-vif-plugged-a74fa1b3-860c-44de-bc9d-207dc8ec9982 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:05:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-11c75aaa-4dae-41c5-b34f-ae03f5988d33 req-19da6101-f05c-4256-b49b-0726ba7fb52c service nova] Acquiring lock "7d016ab3-14c4-4c33-bd50-468f71339cd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:05:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-11c75aaa-4dae-41c5-b34f-ae03f5988d33 req-19da6101-f05c-4256-b49b-0726ba7fb52c service nova] Lock "7d016ab3-14c4-4c33-bd50-468f71339cd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:05:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-11c75aaa-4dae-41c5-b34f-ae03f5988d33 req-19da6101-f05c-4256-b49b-0726ba7fb52c service nova] Lock "7d016ab3-14c4-4c33-bd50-468f71339cd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:05:30 user nova-compute[74342]: DEBUG nova.compute.manager [req-11c75aaa-4dae-41c5-b34f-ae03f5988d33 req-19da6101-f05c-4256-b49b-0726ba7fb52c service nova] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] No waiting events found dispatching network-vif-plugged-a74fa1b3-860c-44de-bc9d-207dc8ec9982 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:05:30 user nova-compute[74342]: WARNING nova.compute.manager [req-11c75aaa-4dae-41c5-b34f-ae03f5988d33 req-19da6101-f05c-4256-b49b-0726ba7fb52c service nova] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Received unexpected event network-vif-plugged-a74fa1b3-860c-44de-bc9d-207dc8ec9982 for instance with vm_state building and task_state spawning.
Oct 16 10:05:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:31 user nova-compute[74342]: DEBUG nova.compute.manager [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 10:05:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 10:05:31 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Instance spawned successfully.
Oct 16 10:05:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 10:05:31 user nova-compute[74342]: DEBUG nova.compute.manager [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 10:05:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 10:05:31 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Instance spawned successfully.
Oct 16 10:05:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 10:05:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:05:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:05:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:05:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:05:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:05:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:05:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:05:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:05:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:05:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:05:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:05:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:05:31 user nova-compute[74342]: INFO nova.compute.manager [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Took 8.29 seconds to spawn the instance on the hypervisor.
Oct 16 10:05:31 user nova-compute[74342]: DEBUG nova.compute.manager [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:05:31 user nova-compute[74342]: INFO nova.compute.manager [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Took 7.35 seconds to spawn the instance on the hypervisor.
Oct 16 10:05:31 user nova-compute[74342]: DEBUG nova.compute.manager [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:05:31 user nova-compute[74342]: INFO nova.compute.manager [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Took 9.05 seconds to build instance.
Oct 16 10:05:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4696bdcc-d0ea-4d05-9de8-3057e3e3556e tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.160s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:05:31 user nova-compute[74342]: INFO nova.compute.manager [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Took 8.28 seconds to build instance.
Oct 16 10:05:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8fd921b7-3c45-4aa5-8b7c-3ebfb0953ed6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "7d016ab3-14c4-4c33-bd50-468f71339cd7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.391s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:05:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:05:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:05:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:05:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:05:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:55 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:05:59 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:06:00 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:06:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:06:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:06:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:06:00 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:06:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ebd3fd-b258-48b4-ab51-a97ba8174c30/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqsHwjgS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:06:01 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:06:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:06:01 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:06:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:06:01 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ebd3fd-b258-48b4-ab51-a97ba8174c30/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ebd3fd-b258-48b4-ab51-a97ba8174c30/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d1780e0-7f62-4800-b37a-35613589b25a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 10:06:01 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[448d8a50-ab7a-4781-af58-9f339a809704]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46] added
Oct 16 10:06:01 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae280f9d-0967-49dd-8653-92c4a45794ff]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[db72457f-ace2-42df-88ed-4fdb98b7b00b]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VqsHwjgS {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VqsHwjgS" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[69db568e-5940-42ba-829d-c22fb7065a97]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VqsHwjgS'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c033187-cff0-46d0-8eb6-3fb2cfec17ba]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d58b151-e533-49bf-a9eb-c7c40fd8c051]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 10:06:01 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 10:06:01 user nova-compute[74342]:  {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:06:01 user nova-compute[74342]: WARNING os_brick.initiator.connectors.iscsi [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 10:06:01 user nova-compute[74342]: 
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ebd3fd-b258-48b4-ab51-a97ba8174c30/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7eea61d-fb55-421f-a30c-512ba2e70738]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46, portal: 172.16.0.220,3260]
Oct 16 10:06:01 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46, portal: 172.16.0.220,3260] successful.
Oct 16 10:06:01 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb5986a-1833-4929-842a-2042885c6d82]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG nova.compute.manager [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 10:06:01 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Creating image(s)
Oct 16 10:06:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Did not create local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Ensure instance console log exists: /opt/stack/data/nova/instances/7c10cb66-71de-448e-9cb6-fc7e2ef466a2/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Start _get_guest_xml network_info=[{"id": "b4f10a48-743b-4e0f-8909-0ada6ad36930", "address": "fa:16:3e:69:74:44", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4f10a48-74", "ovs_interfaceid": "b4f10a48-743b-4e0f-8909-0ada6ad36930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'attachment_id': 'e47fca9e-bfe4-4f76-aa77-0efc8cdc14dd', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuMOrPkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7c10cb66-71de-448e-9cb6-fc7e2ef466a2', 'attached_at': '', 'detached_at': '', 'volume_id': '9bd3971e-40e0-42a8-9105-740cb01b7562', 'serial': '9bd3971e-40e0-42a8-9105-740cb01b7562'}, 'volume_type': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f086d8c-1cc8-42d6-8a71-d8985eee2297]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 (non-flash)
Oct 16 10:06:01 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 (non-flash)
Oct 16 10:06:01 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:01 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:06:01 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:06:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuMOrPkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:06:01 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:06:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4154392f-3ffa-4794-b3af-8cfca8cc0e8a]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqsHwjgS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.516s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] <== connect_volume: return (1519ms) {'type': 'block', 'scsi_wwn': '23035666563393534', 'path': '/dev/sdb'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23035666563393534', 'path': '/dev/sdb'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.157s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:06:02 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:06:02 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:06:02 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:02 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:06:02 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:06:02 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8446MB free_disk=25.126331329345703GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG nova.objects.instance [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'flavor' on Instance uuid 79ebd3fd-b258-48b4-ab51-a97ba8174c30 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[40db5bf4-969c-4ab4-8117-db110f0d2de3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 10:06:02 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 10:06:02 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:06:02 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 10:06:02 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:06:02 user nova-compute[74342]:   <serial>fdf3098b-02e6-480c-b522-c09e53665a46</serial>
Oct 16 10:06:02 user nova-compute[74342]: </disk>
Oct 16 10:06:02 user nova-compute[74342]:  {{(pid=74342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e68682-1929-436b-a423-3b68250a8b8a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562] added
Oct 16 10:06:02 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa6b118-1596-45d6-bc93-524cd5ee125e]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[883e67df-1869-4069-bbd1-adf5d74df390]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tuMOrPkg {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tuMOrPkg" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[57aa543b-59ba-4edc-82ed-1e55b316c40d]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tuMOrPkg'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3f74f1-a63e-42b4-bffe-704a2e59031c]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a6cfa7-11c9-4a4e-bb35-46cd5ebd324b]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 (non-flash)
Oct 16 10:06:02 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 (non-flash)
Oct 16 10:06:02 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3e08145-4a07-40f0-83e7-74a9846db46b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562, portal: 172.16.0.220,3260]
Oct 16 10:06:02 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562, portal: 172.16.0.220,3260] successful.
Oct 16 10:06:02 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d48fe01-dc94-4def-bab8-fca22c22f4f3]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:02 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance d7607dcc-e70e-42fb-9421-c5f630706241 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 79ebd3fd-b258-48b4-ab51-a97ba8174c30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7c10cb66-71de-448e-9cb6-fc7e2ef466a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 34ef7d18-0724-479a-8448-981b9cf0d6ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7d016ab3-14c4-4c33-bd50-468f71339cd7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b9e700b-661a-4d44-9a42-59e59ec902aa]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 (non-flash)
Oct 16 10:06:03 user nova-compute[74342]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)
Oct 16 10:06:03 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 (non-flash)
Oct 16 10:06:03 user nova-compute[74342]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)
Oct 16 10:06:03 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] HCTL ('34', '-', '-', 0) found on session 33 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebe3d629-9130-45d9-9f40-839f35333322]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: None {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Refreshing inventories for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Updating ProviderTree inventory for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Updating inventory in ProviderTree for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Refreshing aggregate associations for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca, aggregates: None {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] No VIF found with MAC fa:16:3e:1f:d6:92, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Refreshing trait associations for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6ce3dad6-7458-4e53-9ce8-a451331152ca tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.729s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:06:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.820s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:06:04 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Searching for a device in session 33 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 10:06:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuMOrPkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 10:06:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.384s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:06:04 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] <== connect_volume: return (2541ms) {'type': 'block', 'scsi_wwn': '23737373762386663', 'path': '/dev/sdc'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:06:04 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737373762386663', 'path': '/dev/sdc'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 10:06:04 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:05:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1067722179',display_name='tempest-TestVolumeBootPattern-server-1067722179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1067722179',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6sJnf898pay+PIZ2/zPOefJIOtQi4Xc+rReNrpoZgM8isuwz9hj22LY0/hNzdd67mZVqTOLnmuplNPpzcrNUeli+GTP1gNufDr7TumrMEFsIIMVgfBAzUAuJrkUhM+WA==',key_name='tempest-TestVolumeBootPattern-2085750064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='799c265b3d14465a9ca6bd7d5e8a4488',ramdisk_id='',reservation_id='r-ja1a340k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-158744824',owner_user_name='tempest-TestVolumeBootPattern-158744824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:05:21Z,user_data=None,user_id='2cac31e799b743359b93943b68b38acf',uuid=7c10cb66-71de-448e-9cb6-fc7e2ef466a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4f10a48-743b-4e0f-8909-0ada6ad36930", "address": "fa:16:3e:69:74:44", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4f10a48-74", "ovs_interfaceid": "b4f10a48-743b-4e0f-8909-0ada6ad36930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 10:06:04 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converting VIF {"id": "b4f10a48-743b-4e0f-8909-0ada6ad36930", "address": "fa:16:3e:69:74:44", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4f10a48-74", "ovs_interfaceid": "b4f10a48-743b-4e0f-8909-0ada6ad36930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:06:04 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:74:44,bridge_name='br-int',has_traffic_filtering=True,id=b4f10a48-743b-4e0f-8909-0ada6ad36930,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4f10a48-74') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:06:04 user nova-compute[74342]: DEBUG nova.objects.instance [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lazy-loading 'pci_devices' on Instance uuid 7c10cb66-71de-448e-9cb6-fc7e2ef466a2 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:06:04 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] End _get_guest_xml xml=<domain type="kvm">
Oct 16 10:06:04 user nova-compute[74342]:   <uuid>7c10cb66-71de-448e-9cb6-fc7e2ef466a2</uuid>
Oct 16 10:06:04 user nova-compute[74342]:   <name>instance-00000025</name>
Oct 16 10:06:04 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 10:06:04 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 10:06:04 user nova-compute[74342]:   <metadata>
Oct 16 10:06:04 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 10:06:04 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 10:06:04 user nova-compute[74342]:       <nova:name>tempest-TestVolumeBootPattern-server-1067722179</nova:name>
Oct 16 10:06:04 user nova-compute[74342]:       <nova:creationTime>2023-10-16 10:06:01</nova:creationTime>
Oct 16 10:06:04 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 10:06:04 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 10:06:04 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 10:06:04 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 10:06:04 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 10:06:04 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 10:06:04 user nova-compute[74342]:       </nova:flavor>
Oct 16 10:06:04 user nova-compute[74342]:       <nova:owner>
Oct 16 10:06:04 user nova-compute[74342]:         <nova:user uuid="2cac31e799b743359b93943b68b38acf">tempest-TestVolumeBootPattern-158744824-project-member</nova:user>
Oct 16 10:06:04 user nova-compute[74342]:         <nova:project uuid="799c265b3d14465a9ca6bd7d5e8a4488">tempest-TestVolumeBootPattern-158744824</nova:project>
Oct 16 10:06:04 user nova-compute[74342]:       </nova:owner>
Oct 16 10:06:04 user nova-compute[74342]:       <nova:ports>
Oct 16 10:06:04 user nova-compute[74342]:         <nova:port uuid="b4f10a48-743b-4e0f-8909-0ada6ad36930">
Oct 16 10:06:04 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Oct 16 10:06:04 user nova-compute[74342]:         </nova:port>
Oct 16 10:06:04 user nova-compute[74342]:       </nova:ports>
Oct 16 10:06:04 user nova-compute[74342]:     </nova:instance>
Oct 16 10:06:04 user nova-compute[74342]:   </metadata>
Oct 16 10:06:04 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 10:06:04 user nova-compute[74342]:     <system>
Oct 16 10:06:04 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 10:06:04 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 10:06:04 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 10:06:04 user nova-compute[74342]:       <entry name="serial">7c10cb66-71de-448e-9cb6-fc7e2ef466a2</entry>
Oct 16 10:06:04 user nova-compute[74342]:       <entry name="uuid">7c10cb66-71de-448e-9cb6-fc7e2ef466a2</entry>
Oct 16 10:06:04 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 10:06:04 user nova-compute[74342]:     </system>
Oct 16 10:06:04 user nova-compute[74342]:   </sysinfo>
Oct 16 10:06:04 user nova-compute[74342]:   <os>
Oct 16 10:06:04 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 10:06:04 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 10:06:04 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 10:06:04 user nova-compute[74342]:   </os>
Oct 16 10:06:04 user nova-compute[74342]:   <features>
Oct 16 10:06:04 user nova-compute[74342]:     <acpi/>
Oct 16 10:06:04 user nova-compute[74342]:     <apic/>
Oct 16 10:06:04 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 10:06:04 user nova-compute[74342]:   </features>
Oct 16 10:06:04 user nova-compute[74342]:   <clock offset="utc">
Oct 16 10:06:04 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 10:06:04 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 10:06:04 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 10:06:04 user nova-compute[74342]:   </clock>
Oct 16 10:06:04 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 10:06:04 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 10:06:04 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 10:06:04 user nova-compute[74342]:   </cpu>
Oct 16 10:06:04 user nova-compute[74342]:   <devices>
Oct 16 10:06:04 user nova-compute[74342]:     <disk type="block" device="disk">
Oct 16 10:06:04 user nova-compute[74342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:06:04 user nova-compute[74342]:       <source dev="/dev/sdc"/>
Oct 16 10:06:04 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 10:06:04 user nova-compute[74342]:       <serial>9bd3971e-40e0-42a8-9105-740cb01b7562</serial>
Oct 16 10:06:04 user nova-compute[74342]:     </disk>
Oct 16 10:06:04 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 10:06:04 user nova-compute[74342]:       <mac address="fa:16:3e:69:74:44"/>
Oct 16 10:06:04 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:06:04 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 10:06:04 user nova-compute[74342]:       <target dev="tapb4f10a48-74"/>
Oct 16 10:06:04 user nova-compute[74342]:     </interface>
Oct 16 10:06:04 user nova-compute[74342]:     <serial type="pty">
Oct 16 10:06:04 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/7c10cb66-71de-448e-9cb6-fc7e2ef466a2/console.log" append="off"/>
Oct 16 10:06:04 user nova-compute[74342]:     </serial>
Oct 16 10:06:04 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 10:06:04 user nova-compute[74342]:     <video>
Oct 16 10:06:04 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:06:04 user nova-compute[74342]:     </video>
Oct 16 10:06:04 user nova-compute[74342]:     <rng model="virtio">
Oct 16 10:06:04 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 10:06:04 user nova-compute[74342]:     </rng>
Oct 16 10:06:04 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 10:06:04 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 10:06:04 user nova-compute[74342]:       <stats period="10"/>
Oct 16 10:06:04 user nova-compute[74342]:     </memballoon>
Oct 16 10:06:04 user nova-compute[74342]:   </devices>
Oct 16 10:06:04 user nova-compute[74342]: </domain>
Oct 16 10:06:04 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 10:06:04 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:05:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1067722179',display_name='tempest-TestVolumeBootPattern-server-1067722179',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1067722179',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6sJnf898pay+PIZ2/zPOefJIOtQi4Xc+rReNrpoZgM8isuwz9hj22LY0/hNzdd67mZVqTOLnmuplNPpzcrNUeli+GTP1gNufDr7TumrMEFsIIMVgfBAzUAuJrkUhM+WA==',key_name='tempest-TestVolumeBootPattern-2085750064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='799c265b3d14465a9ca6bd7d5e8a4488',ramdisk_id='',reservation_id='r-ja1a340k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-158744824',owner_user_name='tempest-TestVolumeBootPattern-158744824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:05:21Z,user_data=None,user_id='2cac31e799b743359b93943b68b38acf',uuid=7c10cb66-71de-448e-9cb6-fc7e2ef466a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4f10a48-743b-4e0f-8909-0ada6ad36930", "address": "fa:16:3e:69:74:44", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4f10a48-74", "ovs_interfaceid": "b4f10a48-743b-4e0f-8909-0ada6ad36930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 10:06:04 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converting VIF {"id": "b4f10a48-743b-4e0f-8909-0ada6ad36930", "address": "fa:16:3e:69:74:44", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4f10a48-74", "ovs_interfaceid": "b4f10a48-743b-4e0f-8909-0ada6ad36930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:06:04 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:74:44,bridge_name='br-int',has_traffic_filtering=True,id=b4f10a48-743b-4e0f-8909-0ada6ad36930,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4f10a48-74') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:06:04 user nova-compute[74342]: DEBUG os_vif [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:74:44,bridge_name='br-int',has_traffic_filtering=True,id=b4f10a48-743b-4e0f-8909-0ada6ad36930,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4f10a48-74') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 10:06:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:06:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 10:06:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ec69e0ce-618b-5224-9fbe-518241ce3a0e', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:06:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:06:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4f10a48-74, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:06:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4f10a48-74, col_values=(('qos', UUID('a2139d47-3baf-4d23-a238-66b9fb0dc78f')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:06:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4f10a48-74, col_values=(('external_ids', {'iface-id': 'b4f10a48-743b-4e0f-8909-0ada6ad36930', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:74:44', 'vm-uuid': '7c10cb66-71de-448e-9cb6-fc7e2ef466a2'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:06:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:06:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:04 user nova-compute[74342]: INFO os_vif [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:74:44,bridge_name='br-int',has_traffic_filtering=True,id=b4f10a48-743b-4e0f-8909-0ada6ad36930,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4f10a48-74')
Oct 16 10:06:04 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:06:04 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] No VIF found with MAC fa:16:3e:69:74:44, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:06:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:05 user nova-compute[74342]: DEBUG nova.compute.manager [req-1e20c78c-4cb3-40f6-b5d6-5702dfdd54d6 req-a6697e9c-cb28-45f8-ab01-706412c8dba1 service nova] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Received event network-vif-plugged-b4f10a48-743b-4e0f-8909-0ada6ad36930 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:06:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-1e20c78c-4cb3-40f6-b5d6-5702dfdd54d6 req-a6697e9c-cb28-45f8-ab01-706412c8dba1 service nova] Acquiring lock "7c10cb66-71de-448e-9cb6-fc7e2ef466a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:06:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-1e20c78c-4cb3-40f6-b5d6-5702dfdd54d6 req-a6697e9c-cb28-45f8-ab01-706412c8dba1 service nova] Lock "7c10cb66-71de-448e-9cb6-fc7e2ef466a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:06:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-1e20c78c-4cb3-40f6-b5d6-5702dfdd54d6 req-a6697e9c-cb28-45f8-ab01-706412c8dba1 service nova] Lock "7c10cb66-71de-448e-9cb6-fc7e2ef466a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:06:05 user nova-compute[74342]: DEBUG nova.compute.manager [req-1e20c78c-4cb3-40f6-b5d6-5702dfdd54d6 req-a6697e9c-cb28-45f8-ab01-706412c8dba1 service nova] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] No waiting events found dispatching network-vif-plugged-b4f10a48-743b-4e0f-8909-0ada6ad36930 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:06:05 user nova-compute[74342]: WARNING nova.compute.manager [req-1e20c78c-4cb3-40f6-b5d6-5702dfdd54d6 req-a6697e9c-cb28-45f8-ab01-706412c8dba1 service nova] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Received unexpected event network-vif-plugged-b4f10a48-743b-4e0f-8909-0ada6ad36930 for instance with vm_state building and task_state spawning.
Oct 16 10:06:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:07 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:06:07 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:06:07 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:06:07 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Rebuilding the list of instances to heal {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 10:06:07 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Skipping network cache update for instance because it is Building. {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 16 10:06:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-d7607dcc-e70e-42fb-9421-c5f630706241" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:06:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-d7607dcc-e70e-42fb-9421-c5f630706241" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:06:07 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:06:07 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lazy-loading 'info_cache' on Instance uuid d7607dcc-e70e-42fb-9421-c5f630706241 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:06:07 user nova-compute[74342]: DEBUG nova.compute.manager [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 10:06:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 10:06:07 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Instance spawned successfully.
Oct 16 10:06:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 10:06:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:06:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:06:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:06:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:06:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:06:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:06:07 user nova-compute[74342]: INFO nova.compute.manager [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Took 6.38 seconds to spawn the instance on the hypervisor.
Oct 16 10:06:07 user nova-compute[74342]: DEBUG nova.compute.manager [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:06:07 user nova-compute[74342]: INFO nova.compute.manager [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Took 47.38 seconds to build instance.
Oct 16 10:06:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d2bc5316-1403-4e1c-822b-834233c4decb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "7c10cb66-71de-448e-9cb6-fc7e2ef466a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 47.479s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:06:07 user nova-compute[74342]: DEBUG nova.compute.manager [req-32d5d489-c645-41d5-9a91-1bb46684220a req-3f06aeb5-4e2c-48ba-90eb-715a1989f09d service nova] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Received event network-vif-plugged-b4f10a48-743b-4e0f-8909-0ada6ad36930 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:06:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-32d5d489-c645-41d5-9a91-1bb46684220a req-3f06aeb5-4e2c-48ba-90eb-715a1989f09d service nova] Acquiring lock "7c10cb66-71de-448e-9cb6-fc7e2ef466a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:06:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-32d5d489-c645-41d5-9a91-1bb46684220a req-3f06aeb5-4e2c-48ba-90eb-715a1989f09d service nova] Lock "7c10cb66-71de-448e-9cb6-fc7e2ef466a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:06:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-32d5d489-c645-41d5-9a91-1bb46684220a req-3f06aeb5-4e2c-48ba-90eb-715a1989f09d service nova] Lock "7c10cb66-71de-448e-9cb6-fc7e2ef466a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:06:07 user nova-compute[74342]: DEBUG nova.compute.manager [req-32d5d489-c645-41d5-9a91-1bb46684220a req-3f06aeb5-4e2c-48ba-90eb-715a1989f09d service nova] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] No waiting events found dispatching network-vif-plugged-b4f10a48-743b-4e0f-8909-0ada6ad36930 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:06:07 user nova-compute[74342]: WARNING nova.compute.manager [req-32d5d489-c645-41d5-9a91-1bb46684220a req-3f06aeb5-4e2c-48ba-90eb-715a1989f09d service nova] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Received unexpected event network-vif-plugged-b4f10a48-743b-4e0f-8909-0ada6ad36930 for instance with vm_state active and task_state None.
Oct 16 10:06:08 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Updating instance_info_cache with network_info: [{"id": "f9bd07aa-abd7-4ff6-afd3-388251345ec0", "address": "fa:16:3e:f5:80:2e", "network": {"id": "19a96357-4b1f-4da6-a8f4-795a37500116", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1856971527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8a3c19c78264cc7a4083e20cf4598ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9bd07aa-ab", "ovs_interfaceid": "f9bd07aa-abd7-4ff6-afd3-388251345ec0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:06:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-d7607dcc-e70e-42fb-9421-c5f630706241" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:06:08 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:06:08 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:06:08 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:06:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:06:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.004s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:06:10 user nova-compute[74342]: DEBUG nova.objects.instance [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'flavor' on Instance uuid 79ebd3fd-b258-48b4-ab51-a97ba8174c30 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:06:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.088s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:06:10 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:06:10 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:06:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:06:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:06:10 user nova-compute[74342]: INFO nova.compute.manager [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Attaching volume 87d2cf96-eeb4-4604-9491-2e4897de39d6 to /dev/vdc
Oct 16 10:06:10 user nova-compute[74342]: DEBUG os_brick.utils [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:06:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[195984cc-77fd-4b3a-940b-bfd602954b7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[01f7d3db-ab7f-442c-bbeb-784eff55c9c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d397a5d-3787-45af-91ba-5b6d47de94bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[96704027-65b2-414d-8d87-4c10b8793ecb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:06:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 10:06:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:06:10 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 10:06:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb947f9-988e-44fc-9df0-8770c6bf42ba]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 10:06:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 10:06:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 10:06:10 user nova-compute[74342]: DEBUG os_brick.utils [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] <== get_connector_properties: return (146ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:06:10 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Updating existing volume attachment record: 7bce8a5d-4a22-42b8-a3fb-503bdb20a16c {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 10:06:11 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:06:11 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:06:11 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:06:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f7d8af70-3075-4f5c-bf2f-1f62e4408bb9 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Acquiring lock "d7607dcc-e70e-42fb-9421-c5f630706241" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:06:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f7d8af70-3075-4f5c-bf2f-1f62e4408bb9 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "d7607dcc-e70e-42fb-9421-c5f630706241" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:06:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f7d8af70-3075-4f5c-bf2f-1f62e4408bb9 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Acquiring lock "d7607dcc-e70e-42fb-9421-c5f630706241-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:06:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f7d8af70-3075-4f5c-bf2f-1f62e4408bb9 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "d7607dcc-e70e-42fb-9421-c5f630706241-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:06:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f7d8af70-3075-4f5c-bf2f-1f62e4408bb9 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "d7607dcc-e70e-42fb-9421-c5f630706241-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:06:19 user nova-compute[74342]: INFO nova.compute.manager [None req-f7d8af70-3075-4f5c-bf2f-1f62e4408bb9 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Terminating instance
Oct 16 10:06:20 user nova-compute[74342]: DEBUG nova.compute.manager [None req-f7d8af70-3075-4f5c-bf2f-1f62e4408bb9 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 10:06:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:20 user nova-compute[74342]: DEBUG nova.compute.manager [req-f10ab313-5e29-4615-b1d8-a54b14f17d00 req-d31ab5f0-77c3-4de7-aa24-ff8eb550faee service nova] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Received event network-vif-unplugged-f9bd07aa-abd7-4ff6-afd3-388251345ec0 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:06:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f10ab313-5e29-4615-b1d8-a54b14f17d00 req-d31ab5f0-77c3-4de7-aa24-ff8eb550faee service nova] Acquiring lock "d7607dcc-e70e-42fb-9421-c5f630706241-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:06:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f10ab313-5e29-4615-b1d8-a54b14f17d00 req-d31ab5f0-77c3-4de7-aa24-ff8eb550faee service nova] Lock "d7607dcc-e70e-42fb-9421-c5f630706241-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:06:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f10ab313-5e29-4615-b1d8-a54b14f17d00 req-d31ab5f0-77c3-4de7-aa24-ff8eb550faee service nova] Lock "d7607dcc-e70e-42fb-9421-c5f630706241-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:06:20 user nova-compute[74342]: DEBUG nova.compute.manager [req-f10ab313-5e29-4615-b1d8-a54b14f17d00 req-d31ab5f0-77c3-4de7-aa24-ff8eb550faee service nova] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] No waiting events found dispatching network-vif-unplugged-f9bd07aa-abd7-4ff6-afd3-388251345ec0 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:06:20 user nova-compute[74342]: DEBUG nova.compute.manager [req-f10ab313-5e29-4615-b1d8-a54b14f17d00 req-d31ab5f0-77c3-4de7-aa24-ff8eb550faee service nova] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Received event network-vif-unplugged-f9bd07aa-abd7-4ff6-afd3-388251345ec0 for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 10:06:20 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Instance destroyed successfully.
Oct 16 10:06:20 user nova-compute[74342]: DEBUG nova.objects.instance [None req-f7d8af70-3075-4f5c-bf2f-1f62e4408bb9 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lazy-loading 'resources' on Instance uuid d7607dcc-e70e-42fb-9421-c5f630706241 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:06:20 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-f7d8af70-3075-4f5c-bf2f-1f62e4408bb9 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T09:57:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1804813188',display_name='tempest-ServersNegativeTestJSON-server-1804813188',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1804813188',id=30,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T09:57:17Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e8a3c19c78264cc7a4083e20cf4598ec',ramdisk_id='',reservation_id='r-ac840jfw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-2110827578',owner_user_name='tempest-ServersNegativeTestJSON-2110827578-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T09:57:18Z,user_data=None,user_id='21ee41cd47eb4493ac26a4199e8b5902',uuid=d7607dcc-e70e-42fb-9421-c5f630706241,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9bd07aa-abd7-4ff6-afd3-388251345ec0", "address": "fa:16:3e:f5:80:2e", "network": {"id": "19a96357-4b1f-4da6-a8f4-795a37500116", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1856971527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8a3c19c78264cc7a4083e20cf4598ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9bd07aa-ab", "ovs_interfaceid": "f9bd07aa-abd7-4ff6-afd3-388251345ec0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 10:06:20 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-f7d8af70-3075-4f5c-bf2f-1f62e4408bb9 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Converting VIF {"id": "f9bd07aa-abd7-4ff6-afd3-388251345ec0", "address": "fa:16:3e:f5:80:2e", "network": {"id": "19a96357-4b1f-4da6-a8f4-795a37500116", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1856971527-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e8a3c19c78264cc7a4083e20cf4598ec", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9bd07aa-ab", "ovs_interfaceid": "f9bd07aa-abd7-4ff6-afd3-388251345ec0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:06:20 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-f7d8af70-3075-4f5c-bf2f-1f62e4408bb9 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f5:80:2e,bridge_name='br-int',has_traffic_filtering=True,id=f9bd07aa-abd7-4ff6-afd3-388251345ec0,network=Network(19a96357-4b1f-4da6-a8f4-795a37500116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9bd07aa-ab') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:06:20 user nova-compute[74342]: DEBUG os_vif [None req-f7d8af70-3075-4f5c-bf2f-1f62e4408bb9 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:80:2e,bridge_name='br-int',has_traffic_filtering=True,id=f9bd07aa-abd7-4ff6-afd3-388251345ec0,network=Network(19a96357-4b1f-4da6-a8f4-795a37500116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9bd07aa-ab') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 10:06:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9bd07aa-ab, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:06:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e7dd88f-7ac1-4bd1-8e63-8db128aa9496) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:06:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:20 user nova-compute[74342]: INFO os_vif [None req-f7d8af70-3075-4f5c-bf2f-1f62e4408bb9 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f5:80:2e,bridge_name='br-int',has_traffic_filtering=True,id=f9bd07aa-abd7-4ff6-afd3-388251345ec0,network=Network(19a96357-4b1f-4da6-a8f4-795a37500116),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9bd07aa-ab')
Oct 16 10:06:20 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-f7d8af70-3075-4f5c-bf2f-1f62e4408bb9 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Deleting instance files /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241_del
Oct 16 10:06:20 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-f7d8af70-3075-4f5c-bf2f-1f62e4408bb9 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Deletion of /opt/stack/data/nova/instances/d7607dcc-e70e-42fb-9421-c5f630706241_del complete
Oct 16 10:06:20 user nova-compute[74342]: INFO nova.compute.manager [None req-f7d8af70-3075-4f5c-bf2f-1f62e4408bb9 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 16 10:06:20 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-f7d8af70-3075-4f5c-bf2f-1f62e4408bb9 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 10:06:20 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 10:06:20 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 10:06:21 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:06:21 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Took 0.48 seconds to deallocate network for instance.
Oct 16 10:06:21 user nova-compute[74342]: DEBUG nova.compute.manager [req-af824858-d791-4fab-a1ce-10dda023ea56 req-8b3afae2-a7f9-4022-b80e-3e6f89fbabe8 service nova] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Received event network-vif-deleted-f9bd07aa-abd7-4ff6-afd3-388251345ec0 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:06:21 user nova-compute[74342]: INFO nova.compute.manager [req-af824858-d791-4fab-a1ce-10dda023ea56 req-8b3afae2-a7f9-4022-b80e-3e6f89fbabe8 service nova] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Neutron deleted interface f9bd07aa-abd7-4ff6-afd3-388251345ec0; detaching it from the instance and deleting it from the info cache
Oct 16 10:06:21 user nova-compute[74342]: DEBUG nova.network.neutron [req-af824858-d791-4fab-a1ce-10dda023ea56 req-8b3afae2-a7f9-4022-b80e-3e6f89fbabe8 service nova] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:06:21 user nova-compute[74342]: DEBUG nova.compute.manager [req-af824858-d791-4fab-a1ce-10dda023ea56 req-8b3afae2-a7f9-4022-b80e-3e6f89fbabe8 service nova] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Detach interface failed, port_id=f9bd07aa-abd7-4ff6-afd3-388251345ec0, reason: Instance d7607dcc-e70e-42fb-9421-c5f630706241 could not be found. {{(pid=74342) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 10:06:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f7d8af70-3075-4f5c-bf2f-1f62e4408bb9 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:06:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f7d8af70-3075-4f5c-bf2f-1f62e4408bb9 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:06:21 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-f7d8af70-3075-4f5c-bf2f-1f62e4408bb9 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:06:21 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-f7d8af70-3075-4f5c-bf2f-1f62e4408bb9 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:06:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f7d8af70-3075-4f5c-bf2f-1f62e4408bb9 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.204s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:06:21 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-f7d8af70-3075-4f5c-bf2f-1f62e4408bb9 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Deleted allocations for instance d7607dcc-e70e-42fb-9421-c5f630706241
Oct 16 10:06:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f7d8af70-3075-4f5c-bf2f-1f62e4408bb9 tempest-ServersNegativeTestJSON-2110827578 tempest-ServersNegativeTestJSON-2110827578-project-member] Lock "d7607dcc-e70e-42fb-9421-c5f630706241" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.779s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:06:22 user nova-compute[74342]: DEBUG nova.compute.manager [req-f44facf9-77aa-4c57-82dd-c040cdb5367e req-1f21cb1d-028e-477a-be94-5f572d9f8ae6 service nova] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Received event network-vif-plugged-f9bd07aa-abd7-4ff6-afd3-388251345ec0 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:06:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f44facf9-77aa-4c57-82dd-c040cdb5367e req-1f21cb1d-028e-477a-be94-5f572d9f8ae6 service nova] Acquiring lock "d7607dcc-e70e-42fb-9421-c5f630706241-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:06:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f44facf9-77aa-4c57-82dd-c040cdb5367e req-1f21cb1d-028e-477a-be94-5f572d9f8ae6 service nova] Lock "d7607dcc-e70e-42fb-9421-c5f630706241-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:06:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f44facf9-77aa-4c57-82dd-c040cdb5367e req-1f21cb1d-028e-477a-be94-5f572d9f8ae6 service nova] Lock "d7607dcc-e70e-42fb-9421-c5f630706241-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:06:22 user nova-compute[74342]: DEBUG nova.compute.manager [req-f44facf9-77aa-4c57-82dd-c040cdb5367e req-1f21cb1d-028e-477a-be94-5f572d9f8ae6 service nova] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] No waiting events found dispatching network-vif-plugged-f9bd07aa-abd7-4ff6-afd3-388251345ec0 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:06:22 user nova-compute[74342]: WARNING nova.compute.manager [req-f44facf9-77aa-4c57-82dd-c040cdb5367e req-1f21cb1d-028e-477a-be94-5f572d9f8ae6 service nova] [instance: d7607dcc-e70e-42fb-9421-c5f630706241] Received unexpected event network-vif-plugged-f9bd07aa-abd7-4ff6-afd3-388251345ec0 for instance with vm_state deleted and task_state None.
Oct 16 10:06:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XucPjbxA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:06:44 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:06:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:06:44 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:06:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:06:44 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a8a2caa-8af4-477a-8d3c-fa741380ec99]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 10:06:44 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab90ab6-937d-4ff1-b7b1-8f271e5555a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6] added
Oct 16 10:06:44 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[053d18b6-fbf6-44c8-b6a8-f810dd552bee]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cc0745c-471a-4182-8a9f-17a009296458]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XucPjbxA {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XucPjbxA" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0083aa0f-6b60-4553-9f15-d05617a19866]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XucPjbxA'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e323b181-d847-4c5c-bbe7-5ce7088c928e]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b5d82d-9c1c-4c19-89bc-5b8acc495433]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 (non-flash)
Oct 16 10:06:44 user nova-compute[74342]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)
Oct 16 10:06:44 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 (non-flash)
Oct 16 10:06:44 user nova-compute[74342]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)
Oct 16 10:06:44 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b80cdc6-8af8-4809-be86-736a7c3fd74b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6, portal: 172.16.0.220,3260]
Oct 16 10:06:44 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6, portal: 172.16.0.220,3260] successful.
Oct 16 10:06:44 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b170dc-f2a3-4018-90e2-0df34d9dc31f]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[153c101e-91bf-4ee7-a0e9-069f6bb469cd]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 (non-flash)
Oct 16 10:06:44 user nova-compute[74342]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)
Oct 16 10:06:44 user nova-compute[74342]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 (non-flash)
Oct 16 10:06:44 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 (non-flash)
Oct 16 10:06:44 user nova-compute[74342]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)
Oct 16 10:06:44 user nova-compute[74342]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 (non-flash)
Oct 16 10:06:44 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2170e8-c9c7-4c60-bee8-13f0eb224a88]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:06:44 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: None {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 10:06:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:45 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 10:06:45 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XucPjbxA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 10:06:45 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.341s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:06:45 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '26361613339376433', 'path': '/dev/sdd'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:06:45 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26361613339376433', 'path': '/dev/sdd'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 10:06:45 user nova-compute[74342]: DEBUG nova.objects.instance [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'flavor' on Instance uuid 79ebd3fd-b258-48b4-ab51-a97ba8174c30 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:06:45 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 10:06:45 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:06:45 user nova-compute[74342]:   <source dev="/dev/sdd"/>
Oct 16 10:06:45 user nova-compute[74342]:   <target dev="vdc" bus="virtio"/>
Oct 16 10:06:45 user nova-compute[74342]:   <serial>87d2cf96-eeb4-4604-9491-2e4897de39d6</serial>
Oct 16 10:06:45 user nova-compute[74342]: </disk>
Oct 16 10:06:45 user nova-compute[74342]:  {{(pid=74342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 10:06:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:06:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:06:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] No BDM found with device name vdc, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:06:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] No VIF found with MAC fa:16:3e:1f:d6:92, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:06:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-446cc797-b8b6-43a9-93dc-6e37e991fd0d tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 35.983s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:06:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:47 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:06:47 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:06:47 user nova-compute[74342]: INFO nova.compute.manager [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Detaching volume fdf3098b-02e6-480c-b522-c09e53665a46
Oct 16 10:06:47 user nova-compute[74342]: INFO nova.virt.block_device [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Attempting to driver detach volume fdf3098b-02e6-480c-b522-c09e53665a46 from mountpoint /dev/vdb
Oct 16 10:06:47 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Attempting to detach device vdb from instance 79ebd3fd-b258-48b4-ab51-a97ba8174c30 from the persistent domain config. {{(pid=74342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 10:06:47 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 10:06:47 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:06:47 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 10:06:47 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:06:47 user nova-compute[74342]:   <serial>fdf3098b-02e6-480c-b522-c09e53665a46</serial>
Oct 16 10:06:47 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 10:06:47 user nova-compute[74342]: </disk>
Oct 16 10:06:47 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 10:06:47 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Successfully detached device vdb from instance 79ebd3fd-b258-48b4-ab51-a97ba8174c30 from the persistent domain config.
Oct 16 10:06:47 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 79ebd3fd-b258-48b4-ab51-a97ba8174c30 from the live domain config. {{(pid=74342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 10:06:47 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 10:06:47 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:06:47 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 10:06:47 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:06:47 user nova-compute[74342]:   <serial>fdf3098b-02e6-480c-b522-c09e53665a46</serial>
Oct 16 10:06:47 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 10:06:47 user nova-compute[74342]: </disk>
Oct 16 10:06:47 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 10:06:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:48 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 79ebd3fd-b258-48b4-ab51-a97ba8174c30 {{(pid=74342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 10:06:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:06:55 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:06:59 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:07:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:01 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:07:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:07:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:07:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:07:01 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:07:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 10:07:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ebd3fd-b258-48b4-ab51-a97ba8174c30/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ebd3fd-b258-48b4-ab51-a97ba8174c30/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ebd3fd-b258-48b4-ab51-a97ba8174c30/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/79ebd3fd-b258-48b4-ab51-a97ba8174c30/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 10:07:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:03 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:07:03 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:07:03 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8486MB free_disk=25.142147064208984GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:07:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:07:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:07:03 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 79ebd3fd-b258-48b4-ab51-a97ba8174c30 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:07:03 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7c10cb66-71de-448e-9cb6-fc7e2ef466a2 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:07:03 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 34ef7d18-0724-479a-8448-981b9cf0d6ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:07:03 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7d016ab3-14c4-4c33-bd50-468f71339cd7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:07:03 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:07:03 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:07:03 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:07:03 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:07:03 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:07:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.291s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:07:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:07:07 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:07:07 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:07:08 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 79ebd3fd-b258-48b4-ab51-a97ba8174c30 is timed out.
Oct 16 10:07:08 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Successfully detached device vdb from instance 79ebd3fd-b258-48b4-ab51-a97ba8174c30 from the live domain config.
Oct 16 10:07:08 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VqsHwjgS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:07:08 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:07:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4f8f58-8d0f-45aa-9274-d5725bd6f94d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 10:07:08 user nova-compute[74342]: No targets found.
Oct 16 10:07:08 user nova-compute[74342]: iSNS:
Oct 16 10:07:08 user nova-compute[74342]: No targets found.
Oct 16 10:07:08 user nova-compute[74342]: STATIC:
Oct 16 10:07:08 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6
Oct 16 10:07:08 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:07:08 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:07:08 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46
Oct 16 10:07:08 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:07:08 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:07:08 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562
Oct 16 10:07:08 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:07:08 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:07:08 user nova-compute[74342]: FIRMWARE:
Oct 16 10:07:08 user nova-compute[74342]: No targets found.
Oct 16 10:07:08 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 10:07:08 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 10:07:08 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e56fb5c-6850-4b37-98ca-244a654e4b32]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-79ebd3fd-b258-48b4-ab51-a97ba8174c30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-79ebd3fd-b258-48b4-ab51-a97ba8174c30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0a1d64-4df7-468d-aab7-baa4134625dd]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 (non-flash)
Oct 16 10:07:08 user nova-compute[74342]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)
Oct 16 10:07:08 user nova-compute[74342]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 (non-flash)
Oct 16 10:07:08 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 (non-flash)
Oct 16 10:07:08 user nova-compute[74342]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)
Oct 16 10:07:08 user nova-compute[74342]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 (non-flash)
Oct 16 10:07:08 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b801bd870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46'): ({'sdb'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Removing single pathed devices sdb {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f42401-b344-4f63-b4d8-fd3f3e5f0c4c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d11dcb7-fc3f-446c-a5f5-c52016001b80]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Flushing IO for device /dev/sdb {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e883f3d2-fdff-460d-b195-570936693a41]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53568a0-f9b3-46e1-ab5b-da29defe3d8f]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eef62bb-f7f5-4d6f-bb20-02e902675884]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e399f8-b43c-4013-8ac2-232efeefd3be]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46, portal: 172.16.0.220,3260]
Oct 16 10:07:08 user nova-compute[74342]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46, portal: 172.16.0.220,3260] successful.
Oct 16 10:07:08 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fdf3098b-02e6-480c-b522-c09e53665a46 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e15625be-181c-4551-9ecd-746713fd4eb8]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] <== disconnect_volume: return (350ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Updating instance_info_cache with network_info: [{"id": "6bb97021-afe7-4ea2-9237-3b0d5a410034", "address": "fa:16:3e:1f:d6:92", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bb97021-af", "ovs_interfaceid": "6bb97021-afe7-4ea2-9237-3b0d5a410034", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-79ebd3fd-b258-48b4-ab51-a97ba8174c30" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:07:08 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:07:09 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:07:10 user nova-compute[74342]: DEBUG nova.objects.instance [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'flavor' on Instance uuid 79ebd3fd-b258-48b4-ab51-a97ba8174c30 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:07:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-bead23e1-fa8d-4727-8892-43f5f4d820e2 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.537s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:07:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:07:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:07:10 user nova-compute[74342]: INFO nova.compute.manager [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Detaching volume 87d2cf96-eeb4-4604-9491-2e4897de39d6
Oct 16 10:07:10 user nova-compute[74342]: INFO nova.virt.block_device [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Attempting to driver detach volume 87d2cf96-eeb4-4604-9491-2e4897de39d6 from mountpoint /dev/vdc
Oct 16 10:07:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Attempting to detach device vdc from instance 79ebd3fd-b258-48b4-ab51-a97ba8174c30 from the persistent domain config. {{(pid=74342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 10:07:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 10:07:10 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:07:10 user nova-compute[74342]:   <source dev="/dev/sdd"/>
Oct 16 10:07:10 user nova-compute[74342]:   <target dev="vdc" bus="virtio"/>
Oct 16 10:07:10 user nova-compute[74342]:   <serial>87d2cf96-eeb4-4604-9491-2e4897de39d6</serial>
Oct 16 10:07:10 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 16 10:07:10 user nova-compute[74342]: </disk>
Oct 16 10:07:10 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 10:07:10 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Successfully detached device vdc from instance 79ebd3fd-b258-48b4-ab51-a97ba8174c30 from the persistent domain config.
Oct 16 10:07:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 79ebd3fd-b258-48b4-ab51-a97ba8174c30 from the live domain config. {{(pid=74342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 10:07:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 10:07:10 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:07:10 user nova-compute[74342]:   <source dev="/dev/sdd"/>
Oct 16 10:07:10 user nova-compute[74342]:   <target dev="vdc" bus="virtio"/>
Oct 16 10:07:10 user nova-compute[74342]:   <serial>87d2cf96-eeb4-4604-9491-2e4897de39d6</serial>
Oct 16 10:07:10 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Oct 16 10:07:10 user nova-compute[74342]: </disk>
Oct 16 10:07:10 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 10:07:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:07:11 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 79ebd3fd-b258-48b4-ab51-a97ba8174c30 {{(pid=74342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 10:07:11 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:07:12 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:07:12 user nova-compute[74342]: DEBUG nova.compute.manager [req-05e53f94-656a-4fa7-b779-21b6a8083af4 req-1784e880-76df-4c92-bc9e-29347063d557 service nova] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Received event network-changed-b4f10a48-743b-4e0f-8909-0ada6ad36930 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:07:12 user nova-compute[74342]: DEBUG nova.compute.manager [req-05e53f94-656a-4fa7-b779-21b6a8083af4 req-1784e880-76df-4c92-bc9e-29347063d557 service nova] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Refreshing instance network info cache due to event network-changed-b4f10a48-743b-4e0f-8909-0ada6ad36930. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:07:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-05e53f94-656a-4fa7-b779-21b6a8083af4 req-1784e880-76df-4c92-bc9e-29347063d557 service nova] Acquiring lock "refresh_cache-7c10cb66-71de-448e-9cb6-fc7e2ef466a2" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:07:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-05e53f94-656a-4fa7-b779-21b6a8083af4 req-1784e880-76df-4c92-bc9e-29347063d557 service nova] Acquired lock "refresh_cache-7c10cb66-71de-448e-9cb6-fc7e2ef466a2" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:07:12 user nova-compute[74342]: DEBUG nova.network.neutron [req-05e53f94-656a-4fa7-b779-21b6a8083af4 req-1784e880-76df-4c92-bc9e-29347063d557 service nova] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Refreshing network info cache for port b4f10a48-743b-4e0f-8909-0ada6ad36930 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:07:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "7c10cb66-71de-448e-9cb6-fc7e2ef466a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:07:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "7c10cb66-71de-448e-9cb6-fc7e2ef466a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:07:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "7c10cb66-71de-448e-9cb6-fc7e2ef466a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:07:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "7c10cb66-71de-448e-9cb6-fc7e2ef466a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:07:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "7c10cb66-71de-448e-9cb6-fc7e2ef466a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:07:13 user nova-compute[74342]: INFO nova.compute.manager [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Terminating instance
Oct 16 10:07:13 user nova-compute[74342]: DEBUG nova.compute.manager [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 10:07:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:13 user nova-compute[74342]: DEBUG nova.network.neutron [req-05e53f94-656a-4fa7-b779-21b6a8083af4 req-1784e880-76df-4c92-bc9e-29347063d557 service nova] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Updated VIF entry in instance network info cache for port b4f10a48-743b-4e0f-8909-0ada6ad36930. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:07:13 user nova-compute[74342]: DEBUG nova.network.neutron [req-05e53f94-656a-4fa7-b779-21b6a8083af4 req-1784e880-76df-4c92-bc9e-29347063d557 service nova] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Updating instance_info_cache with network_info: [{"id": "b4f10a48-743b-4e0f-8909-0ada6ad36930", "address": "fa:16:3e:69:74:44", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.157", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4f10a48-74", "ovs_interfaceid": "b4f10a48-743b-4e0f-8909-0ada6ad36930", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:07:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-05e53f94-656a-4fa7-b779-21b6a8083af4 req-1784e880-76df-4c92-bc9e-29347063d557 service nova] Releasing lock "refresh_cache-7c10cb66-71de-448e-9cb6-fc7e2ef466a2" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:07:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:13 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:07:13 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:07:13 user nova-compute[74342]: INFO nova.compute.manager [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Rescuing
Oct 16 10:07:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "refresh_cache-7d016ab3-14c4-4c33-bd50-468f71339cd7" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:07:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquired lock "refresh_cache-7d016ab3-14c4-4c33-bd50-468f71339cd7" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:07:13 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:07:13 user nova-compute[74342]: DEBUG nova.compute.manager [req-88090bd0-dcbc-47d5-a106-64e26c32499a req-61acf6da-dace-490f-9c2e-323542331ee4 service nova] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Received event network-vif-unplugged-b4f10a48-743b-4e0f-8909-0ada6ad36930 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:07:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-88090bd0-dcbc-47d5-a106-64e26c32499a req-61acf6da-dace-490f-9c2e-323542331ee4 service nova] Acquiring lock "7c10cb66-71de-448e-9cb6-fc7e2ef466a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:07:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-88090bd0-dcbc-47d5-a106-64e26c32499a req-61acf6da-dace-490f-9c2e-323542331ee4 service nova] Lock "7c10cb66-71de-448e-9cb6-fc7e2ef466a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:07:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-88090bd0-dcbc-47d5-a106-64e26c32499a req-61acf6da-dace-490f-9c2e-323542331ee4 service nova] Lock "7c10cb66-71de-448e-9cb6-fc7e2ef466a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:07:13 user nova-compute[74342]: DEBUG nova.compute.manager [req-88090bd0-dcbc-47d5-a106-64e26c32499a req-61acf6da-dace-490f-9c2e-323542331ee4 service nova] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] No waiting events found dispatching network-vif-unplugged-b4f10a48-743b-4e0f-8909-0ada6ad36930 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:07:13 user nova-compute[74342]: DEBUG nova.compute.manager [req-88090bd0-dcbc-47d5-a106-64e26c32499a req-61acf6da-dace-490f-9c2e-323542331ee4 service nova] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Received event network-vif-unplugged-b4f10a48-743b-4e0f-8909-0ada6ad36930 for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 10:07:14 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Instance destroyed successfully.
Oct 16 10:07:14 user nova-compute[74342]: DEBUG nova.objects.instance [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lazy-loading 'resources' on Instance uuid 7c10cb66-71de-448e-9cb6-fc7e2ef466a2 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:05:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1067722179',display_name='tempest-TestVolumeBootPattern-server-1067722179',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1067722179',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6sJnf898pay+PIZ2/zPOefJIOtQi4Xc+rReNrpoZgM8isuwz9hj22LY0/hNzdd67mZVqTOLnmuplNPpzcrNUeli+GTP1gNufDr7TumrMEFsIIMVgfBAzUAuJrkUhM+WA==',key_name='tempest-TestVolumeBootPattern-2085750064',keypairs=<?>,launch_index=0,launched_at=2023-10-16T10:06:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='799c265b3d14465a9ca6bd7d5e8a4488',ramdisk_id='',reservation_id='r-ja1a340k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-158744824',owner_user_name='tempest-TestVolumeBootPattern-158744824-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T10:06:08Z,user_data=None,user_id='2cac31e799b743359b93943b68b38acf',uuid=7c10cb66-71de-448e-9cb6-fc7e2ef466a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4f10a48-743b-4e0f-8909-0ada6ad36930", "address": "fa:16:3e:69:74:44", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4f10a48-74", "ovs_interfaceid": "b4f10a48-743b-4e0f-8909-0ada6ad36930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converting VIF {"id": "b4f10a48-743b-4e0f-8909-0ada6ad36930", "address": "fa:16:3e:69:74:44", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4f10a48-74", "ovs_interfaceid": "b4f10a48-743b-4e0f-8909-0ada6ad36930", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:74:44,bridge_name='br-int',has_traffic_filtering=True,id=b4f10a48-743b-4e0f-8909-0ada6ad36930,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4f10a48-74') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG os_vif [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:74:44,bridge_name='br-int',has_traffic_filtering=True,id=b4f10a48-743b-4e0f-8909-0ada6ad36930,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4f10a48-74') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4f10a48-74, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a2139d47-3baf-4d23-a238-66b9fb0dc78f) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:14 user nova-compute[74342]: INFO os_vif [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:74:44,bridge_name='br-int',has_traffic_filtering=True,id=b4f10a48-743b-4e0f-8909-0ada6ad36930,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4f10a48-74')
Oct 16 10:07:14 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Updating instance_info_cache with network_info: [{"id": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "address": "fa:16:3e:de:cb:e3", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74fa1b3-86", "ovs_interfaceid": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuMOrPkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:07:14 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:07:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Releasing lock "refresh_cache-7d016ab3-14c4-4c33-bd50-468f71339cd7" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fc1f2a-d661-42e8-bfa1-65c63592e1c8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 10:07:14 user nova-compute[74342]: No targets found.
Oct 16 10:07:14 user nova-compute[74342]: iSNS:
Oct 16 10:07:14 user nova-compute[74342]: No targets found.
Oct 16 10:07:14 user nova-compute[74342]: STATIC:
Oct 16 10:07:14 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6
Oct 16 10:07:14 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:07:14 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:07:14 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562
Oct 16 10:07:14 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:07:14 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:07:14 user nova-compute[74342]: FIRMWARE:
Oct 16 10:07:14 user nova-compute[74342]: No targets found.
Oct 16 10:07:14 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 10:07:14 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 10:07:14 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7207fe-ab3c-4ce6-81dd-73adfb0cb499]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d3b290-628a-4372-b907-7b8dea48302a]: (4, ('tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)
Oct 16 10:07:14 user nova-compute[74342]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 (non-flash)
Oct 16 10:07:14 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsi session list stdout=tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)
Oct 16 10:07:14 user nova-compute[74342]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 (non-flash)
Oct 16 10:07:14 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b60291480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562'): ({'sdc'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Removing single pathed devices sdc {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c7a248-1f74-4839-a414-684e9008226e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.031s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c42057-cc61-4c11-9fc2-e9acacf7e1c3]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Flushing IO for device /dev/sdc {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[777f49ab-eec3-4172-81cb-2e2b3d89d70b]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.061s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[af578537-e5a3-4d03-b377-4bef6fd9e4b1]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] SCSI volumes sdc have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[42282abd-689c-47ca-af43-b726a66d62ae]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bed9159-e803-4985-9723-884af667fed6]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562, portal: 172.16.0.220,3260]
Oct 16 10:07:14 user nova-compute[74342]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562, portal: 172.16.0.220,3260] successful.
Oct 16 10:07:14 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d057a90b-0873-4ef1-9bcf-27732785fc8e]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] <== disconnect_volume: return (388ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 10:07:14 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Deleting instance files /opt/stack/data/nova/instances/7c10cb66-71de-448e-9cb6-fc7e2ef466a2_del
Oct 16 10:07:14 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Deletion of /opt/stack/data/nova/instances/7c10cb66-71de-448e-9cb6-fc7e2ef466a2_del complete
Oct 16 10:07:14 user nova-compute[74342]: INFO nova.compute.manager [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Took 1.35 seconds to destroy the instance on the hypervisor.
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:14 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Instance destroyed successfully.
Oct 16 10:07:14 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Attempting rescue
Oct 16 10:07:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74342) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Instance directory exists: not creating {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 16 10:07:14 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Creating image(s)
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "/opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "/opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "/opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG nova.objects.instance [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7d016ab3-14c4-4c33-bd50-468f71339cd7 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:07:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.198s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue" returned: 0 in 0.052s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.objects.instance [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lazy-loading 'migration_context' on Instance uuid 7d016ab3-14c4-4c33-bd50-468f71339cd7 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.objects.base [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Object Instance<7d016ab3-14c4-4c33-bd50-468f71339cd7> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Start _get_guest_xml network_info=[{"id": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "address": "fa:16:3e:de:cb:e3", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "vif_mac": "fa:16:3e:de:cb:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74fa1b3-86", "ovs_interfaceid": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.objects.instance [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lazy-loading 'resources' on Instance uuid 7d016ab3-14c4-4c33-bd50-468f71339cd7 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.objects.base [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Object Instance<7d016ab3-14c4-4c33-bd50-468f71339cd7> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.objects.instance [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lazy-loading 'numa_topology' on Instance uuid 7d016ab3-14c4-4c33-bd50-468f71339cd7 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.objects.base [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Object Instance<7d016ab3-14c4-4c33-bd50-468f71339cd7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:07:15 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:07:15 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.objects.instance [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7d016ab3-14c4-4c33-bd50-468f71339cd7 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:07:15 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Took 0.78 seconds to deallocate network for instance.
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.objects.base [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Object Instance<7d016ab3-14c4-4c33-bd50-468f71339cd7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:05:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-360954549',display_name='tempest-ServerRescueNegativeTestJSON-server-360954549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-360954549',id=39,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T10:05:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2453f549532c465da8952474a5218357',ramdisk_id='',reservation_id='r-pmlvt0py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1027819060',owner_user_name='tempest-ServerRescueNegativeTestJSON-1027819060-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:05:32Z,user_data=None,user_id='2ca9ac24fcad4d9fbf8cb2fd7ec6a3f0',uuid=7d016ab3-14c4-4c33-bd50-468f71339cd7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "address": "fa:16:3e:de:cb:e3", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "vif_mac": "fa:16:3e:de:cb:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74fa1b3-86", "ovs_interfaceid": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Converting VIF {"id": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "address": "fa:16:3e:de:cb:e3", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "vif_mac": "fa:16:3e:de:cb:e3"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74fa1b3-86", "ovs_interfaceid": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:cb:e3,bridge_name='br-int',has_traffic_filtering=True,id=a74fa1b3-860c-44de-bc9d-207dc8ec9982,network=Network(c8edc360-319a-4e77-8af6-5b8e7a87ae82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa74fa1b3-86') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.objects.instance [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lazy-loading 'pci_devices' on Instance uuid 7d016ab3-14c4-4c33-bd50-468f71339cd7 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-78a91b23-6708-44bb-9f06-e439506e3544 req-0a5767ab-118a-4ab8-be77-63012dd4d248 service nova] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Received event network-vif-deleted-b4f10a48-743b-4e0f-8909-0ada6ad36930 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.objects.base [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Object Instance<7d016ab3-14c4-4c33-bd50-468f71339cd7> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] End _get_guest_xml xml=<domain type="kvm">
Oct 16 10:07:15 user nova-compute[74342]:   <uuid>7d016ab3-14c4-4c33-bd50-468f71339cd7</uuid>
Oct 16 10:07:15 user nova-compute[74342]:   <name>instance-00000027</name>
Oct 16 10:07:15 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 10:07:15 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 10:07:15 user nova-compute[74342]:   <metadata>
Oct 16 10:07:15 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 10:07:15 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 10:07:15 user nova-compute[74342]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-360954549</nova:name>
Oct 16 10:07:15 user nova-compute[74342]:       <nova:creationTime>2023-10-16 10:07:15</nova:creationTime>
Oct 16 10:07:15 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 10:07:15 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 10:07:15 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 10:07:15 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 10:07:15 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 10:07:15 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 10:07:15 user nova-compute[74342]:       </nova:flavor>
Oct 16 10:07:15 user nova-compute[74342]:       <nova:owner>
Oct 16 10:07:15 user nova-compute[74342]:         <nova:user uuid="2ca9ac24fcad4d9fbf8cb2fd7ec6a3f0">tempest-ServerRescueNegativeTestJSON-1027819060-project-member</nova:user>
Oct 16 10:07:15 user nova-compute[74342]:         <nova:project uuid="2453f549532c465da8952474a5218357">tempest-ServerRescueNegativeTestJSON-1027819060</nova:project>
Oct 16 10:07:15 user nova-compute[74342]:       </nova:owner>
Oct 16 10:07:15 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 10:07:15 user nova-compute[74342]:       <nova:ports>
Oct 16 10:07:15 user nova-compute[74342]:         <nova:port uuid="a74fa1b3-860c-44de-bc9d-207dc8ec9982">
Oct 16 10:07:15 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 16 10:07:15 user nova-compute[74342]:         </nova:port>
Oct 16 10:07:15 user nova-compute[74342]:       </nova:ports>
Oct 16 10:07:15 user nova-compute[74342]:     </nova:instance>
Oct 16 10:07:15 user nova-compute[74342]:   </metadata>
Oct 16 10:07:15 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 10:07:15 user nova-compute[74342]:     <system>
Oct 16 10:07:15 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 10:07:15 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 10:07:15 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 10:07:15 user nova-compute[74342]:       <entry name="serial">7d016ab3-14c4-4c33-bd50-468f71339cd7</entry>
Oct 16 10:07:15 user nova-compute[74342]:       <entry name="uuid">7d016ab3-14c4-4c33-bd50-468f71339cd7</entry>
Oct 16 10:07:15 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 10:07:15 user nova-compute[74342]:     </system>
Oct 16 10:07:15 user nova-compute[74342]:   </sysinfo>
Oct 16 10:07:15 user nova-compute[74342]:   <os>
Oct 16 10:07:15 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 10:07:15 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 10:07:15 user nova-compute[74342]:   </os>
Oct 16 10:07:15 user nova-compute[74342]:   <features>
Oct 16 10:07:15 user nova-compute[74342]:     <acpi/>
Oct 16 10:07:15 user nova-compute[74342]:     <apic/>
Oct 16 10:07:15 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 10:07:15 user nova-compute[74342]:   </features>
Oct 16 10:07:15 user nova-compute[74342]:   <clock offset="utc">
Oct 16 10:07:15 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 10:07:15 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 10:07:15 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 10:07:15 user nova-compute[74342]:   </clock>
Oct 16 10:07:15 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 10:07:15 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 10:07:15 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 10:07:15 user nova-compute[74342]:   </cpu>
Oct 16 10:07:15 user nova-compute[74342]:   <devices>
Oct 16 10:07:15 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 10:07:15 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 10:07:15 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue"/>
Oct 16 10:07:15 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 10:07:15 user nova-compute[74342]:     </disk>
Oct 16 10:07:15 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 10:07:15 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 10:07:15 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk"/>
Oct 16 10:07:15 user nova-compute[74342]:       <target dev="vdb" bus="virtio"/>
Oct 16 10:07:15 user nova-compute[74342]:     </disk>
Oct 16 10:07:15 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 10:07:15 user nova-compute[74342]:       <mac address="fa:16:3e:de:cb:e3"/>
Oct 16 10:07:15 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:07:15 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 10:07:15 user nova-compute[74342]:       <target dev="tapa74fa1b3-86"/>
Oct 16 10:07:15 user nova-compute[74342]:     </interface>
Oct 16 10:07:15 user nova-compute[74342]:     <serial type="pty">
Oct 16 10:07:15 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/console.log" append="off"/>
Oct 16 10:07:15 user nova-compute[74342]:     </serial>
Oct 16 10:07:15 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 10:07:15 user nova-compute[74342]:     <video>
Oct 16 10:07:15 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:07:15 user nova-compute[74342]:     </video>
Oct 16 10:07:15 user nova-compute[74342]:     <rng model="virtio">
Oct 16 10:07:15 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 10:07:15 user nova-compute[74342]:     </rng>
Oct 16 10:07:15 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 10:07:15 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 10:07:15 user nova-compute[74342]:       <stats period="10"/>
Oct 16 10:07:15 user nova-compute[74342]:     </memballoon>
Oct 16 10:07:15 user nova-compute[74342]:   </devices>
Oct 16 10:07:15 user nova-compute[74342]: </domain>
Oct 16 10:07:15 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 10:07:15 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Instance destroyed successfully.
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] No VIF found with MAC fa:16:3e:de:cb:e3, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-0f0520aa-bc1c-4e74-8113-fb42bd323d17 req-19ceb3d4-a539-40f9-acb5-53523d5636de service nova] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Received event network-vif-plugged-b4f10a48-743b-4e0f-8909-0ada6ad36930 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0f0520aa-bc1c-4e74-8113-fb42bd323d17 req-19ceb3d4-a539-40f9-acb5-53523d5636de service nova] Acquiring lock "7c10cb66-71de-448e-9cb6-fc7e2ef466a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0f0520aa-bc1c-4e74-8113-fb42bd323d17 req-19ceb3d4-a539-40f9-acb5-53523d5636de service nova] Lock "7c10cb66-71de-448e-9cb6-fc7e2ef466a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0f0520aa-bc1c-4e74-8113-fb42bd323d17 req-19ceb3d4-a539-40f9-acb5-53523d5636de service nova] Lock "7c10cb66-71de-448e-9cb6-fc7e2ef466a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-0f0520aa-bc1c-4e74-8113-fb42bd323d17 req-19ceb3d4-a539-40f9-acb5-53523d5636de service nova] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] No waiting events found dispatching network-vif-plugged-b4f10a48-743b-4e0f-8909-0ada6ad36930 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:07:15 user nova-compute[74342]: WARNING nova.compute.manager [req-0f0520aa-bc1c-4e74-8113-fb42bd323d17 req-19ceb3d4-a539-40f9-acb5-53523d5636de service nova] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Received unexpected event network-vif-plugged-b4f10a48-743b-4e0f-8909-0ada6ad36930 for instance with vm_state active and task_state deleting.
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-0f0520aa-bc1c-4e74-8113-fb42bd323d17 req-19ceb3d4-a539-40f9-acb5-53523d5636de service nova] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Received event network-vif-unplugged-a74fa1b3-860c-44de-bc9d-207dc8ec9982 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0f0520aa-bc1c-4e74-8113-fb42bd323d17 req-19ceb3d4-a539-40f9-acb5-53523d5636de service nova] Acquiring lock "7d016ab3-14c4-4c33-bd50-468f71339cd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0f0520aa-bc1c-4e74-8113-fb42bd323d17 req-19ceb3d4-a539-40f9-acb5-53523d5636de service nova] Lock "7d016ab3-14c4-4c33-bd50-468f71339cd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0f0520aa-bc1c-4e74-8113-fb42bd323d17 req-19ceb3d4-a539-40f9-acb5-53523d5636de service nova] Lock "7d016ab3-14c4-4c33-bd50-468f71339cd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-0f0520aa-bc1c-4e74-8113-fb42bd323d17 req-19ceb3d4-a539-40f9-acb5-53523d5636de service nova] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] No waiting events found dispatching network-vif-unplugged-a74fa1b3-860c-44de-bc9d-207dc8ec9982 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:07:15 user nova-compute[74342]: WARNING nova.compute.manager [req-0f0520aa-bc1c-4e74-8113-fb42bd323d17 req-19ceb3d4-a539-40f9-acb5-53523d5636de service nova] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Received unexpected event network-vif-unplugged-a74fa1b3-860c-44de-bc9d-207dc8ec9982 for instance with vm_state active and task_state rescuing.
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-0f0520aa-bc1c-4e74-8113-fb42bd323d17 req-19ceb3d4-a539-40f9-acb5-53523d5636de service nova] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Received event network-vif-plugged-a74fa1b3-860c-44de-bc9d-207dc8ec9982 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0f0520aa-bc1c-4e74-8113-fb42bd323d17 req-19ceb3d4-a539-40f9-acb5-53523d5636de service nova] Acquiring lock "7d016ab3-14c4-4c33-bd50-468f71339cd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0f0520aa-bc1c-4e74-8113-fb42bd323d17 req-19ceb3d4-a539-40f9-acb5-53523d5636de service nova] Lock "7d016ab3-14c4-4c33-bd50-468f71339cd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0f0520aa-bc1c-4e74-8113-fb42bd323d17 req-19ceb3d4-a539-40f9-acb5-53523d5636de service nova] Lock "7d016ab3-14c4-4c33-bd50-468f71339cd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:07:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-0f0520aa-bc1c-4e74-8113-fb42bd323d17 req-19ceb3d4-a539-40f9-acb5-53523d5636de service nova] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] No waiting events found dispatching network-vif-plugged-a74fa1b3-860c-44de-bc9d-207dc8ec9982 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:07:15 user nova-compute[74342]: WARNING nova.compute.manager [req-0f0520aa-bc1c-4e74-8113-fb42bd323d17 req-19ceb3d4-a539-40f9-acb5-53523d5636de service nova] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Received unexpected event network-vif-plugged-a74fa1b3-860c-44de-bc9d-207dc8ec9982 for instance with vm_state active and task_state rescuing.
Oct 16 10:07:16 user nova-compute[74342]: INFO nova.compute.manager [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: 7c10cb66-71de-448e-9cb6-fc7e2ef466a2] Took 1.01 seconds to detach 1 volumes for instance.
Oct 16 10:07:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:07:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:07:16 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:07:16 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:07:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.207s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:07:16 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Deleted allocations for instance 7c10cb66-71de-448e-9cb6-fc7e2ef466a2
Oct 16 10:07:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-361381a1-5d26-44cd-94c9-e73f6ca52feb tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "7c10cb66-71de-448e-9cb6-fc7e2ef466a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.550s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:07:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:17 user nova-compute[74342]: DEBUG nova.compute.manager [req-05751ad7-4800-40d3-850c-498990cfb9c1 req-218ba451-b25a-4ec8-ad89-9e98a7467fed service nova] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Received event network-vif-plugged-a74fa1b3-860c-44de-bc9d-207dc8ec9982 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:07:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-05751ad7-4800-40d3-850c-498990cfb9c1 req-218ba451-b25a-4ec8-ad89-9e98a7467fed service nova] Acquiring lock "7d016ab3-14c4-4c33-bd50-468f71339cd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:07:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-05751ad7-4800-40d3-850c-498990cfb9c1 req-218ba451-b25a-4ec8-ad89-9e98a7467fed service nova] Lock "7d016ab3-14c4-4c33-bd50-468f71339cd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:07:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-05751ad7-4800-40d3-850c-498990cfb9c1 req-218ba451-b25a-4ec8-ad89-9e98a7467fed service nova] Lock "7d016ab3-14c4-4c33-bd50-468f71339cd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:07:17 user nova-compute[74342]: DEBUG nova.compute.manager [req-05751ad7-4800-40d3-850c-498990cfb9c1 req-218ba451-b25a-4ec8-ad89-9e98a7467fed service nova] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] No waiting events found dispatching network-vif-plugged-a74fa1b3-860c-44de-bc9d-207dc8ec9982 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:07:17 user nova-compute[74342]: WARNING nova.compute.manager [req-05751ad7-4800-40d3-850c-498990cfb9c1 req-218ba451-b25a-4ec8-ad89-9e98a7467fed service nova] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Received unexpected event network-vif-plugged-a74fa1b3-860c-44de-bc9d-207dc8ec9982 for instance with vm_state active and task_state rescuing.
Oct 16 10:07:17 user nova-compute[74342]: DEBUG nova.compute.manager [req-05751ad7-4800-40d3-850c-498990cfb9c1 req-218ba451-b25a-4ec8-ad89-9e98a7467fed service nova] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Received event network-vif-plugged-a74fa1b3-860c-44de-bc9d-207dc8ec9982 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:07:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-05751ad7-4800-40d3-850c-498990cfb9c1 req-218ba451-b25a-4ec8-ad89-9e98a7467fed service nova] Acquiring lock "7d016ab3-14c4-4c33-bd50-468f71339cd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:07:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-05751ad7-4800-40d3-850c-498990cfb9c1 req-218ba451-b25a-4ec8-ad89-9e98a7467fed service nova] Lock "7d016ab3-14c4-4c33-bd50-468f71339cd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:07:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-05751ad7-4800-40d3-850c-498990cfb9c1 req-218ba451-b25a-4ec8-ad89-9e98a7467fed service nova] Lock "7d016ab3-14c4-4c33-bd50-468f71339cd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:07:17 user nova-compute[74342]: DEBUG nova.compute.manager [req-05751ad7-4800-40d3-850c-498990cfb9c1 req-218ba451-b25a-4ec8-ad89-9e98a7467fed service nova] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] No waiting events found dispatching network-vif-plugged-a74fa1b3-860c-44de-bc9d-207dc8ec9982 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:07:17 user nova-compute[74342]: WARNING nova.compute.manager [req-05751ad7-4800-40d3-850c-498990cfb9c1 req-218ba451-b25a-4ec8-ad89-9e98a7467fed service nova] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Received unexpected event network-vif-plugged-a74fa1b3-860c-44de-bc9d-207dc8ec9982 for instance with vm_state active and task_state rescuing.
Oct 16 10:07:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:19 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c0f793be-99c1-49a8-99e3-50486ce22f0c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:07:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:31 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 79ebd3fd-b258-48b4-ab51-a97ba8174c30 is timed out.
Oct 16 10:07:31 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Successfully detached device vdc from instance 79ebd3fd-b258-48b4-ab51-a97ba8174c30 from the live domain config.
Oct 16 10:07:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XucPjbxA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:07:31 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:07:31 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bf5ccaf-f963-4fa3-aecf-cf003ad94c72]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 10:07:31 user nova-compute[74342]: No targets found.
Oct 16 10:07:31 user nova-compute[74342]: iSNS:
Oct 16 10:07:31 user nova-compute[74342]: No targets found.
Oct 16 10:07:31 user nova-compute[74342]: STATIC:
Oct 16 10:07:31 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6
Oct 16 10:07:31 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:07:31 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:07:31 user nova-compute[74342]: FIRMWARE:
Oct 16 10:07:31 user nova-compute[74342]: No targets found.
Oct 16 10:07:31 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 10:07:31 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 10:07:31 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5f8649e-5049-4f14-8c87-a3aff24e57fd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[960f7461-1591-48d2-b5c4-5530449fd9d9]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 (non-flash)
Oct 16 10:07:31 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 (non-flash)
Oct 16 10:07:31 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b8b5f3370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6'): ({'sdd'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Removing single pathed devices sdd {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb015ef-dc5d-4d98-9b87-809e1afcdb23]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea524129-f44a-4d35-b460-30fef4788784]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Flushing IO for device /dev/sdd {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb362f96-beb6-40bc-9921-29d04ff04abd]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.044s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc480980-e2f8-49ec-8786-f3c0e28d7b5b]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] SCSI volumes sdd have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2458aeae-03b1-4296-8039-ef01604bd451]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[343df06e-733a-4904-94a1-a25d45d991cc]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6, portal: 172.16.0.220,3260]
Oct 16 10:07:31 user nova-compute[74342]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6, portal: 172.16.0.220,3260] successful.
Oct 16 10:07:31 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:87d2cf96-eeb4-4604-9491-2e4897de39d6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8fcdbe-7f40-4396-b365-e8c80fcae19f]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] <== disconnect_volume: return (323ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:07:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 10:07:32 user nova-compute[74342]: DEBUG nova.objects.instance [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'flavor' on Instance uuid 79ebd3fd-b258-48b4-ab51-a97ba8174c30 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:07:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-84af30ab-ac91-4c7f-8c00-4a8194ea78be tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.822s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:07:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-aa8a3db4-9474-436b-b4a0-07aa398fb519 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:07:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-aa8a3db4-9474-436b-b4a0-07aa398fb519 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:07:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-aa8a3db4-9474-436b-b4a0-07aa398fb519 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:07:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-aa8a3db4-9474-436b-b4a0-07aa398fb519 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:07:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-aa8a3db4-9474-436b-b4a0-07aa398fb519 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:07:33 user nova-compute[74342]: INFO nova.compute.manager [None req-aa8a3db4-9474-436b-b4a0-07aa398fb519 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Terminating instance
Oct 16 10:07:33 user nova-compute[74342]: DEBUG nova.compute.manager [None req-aa8a3db4-9474-436b-b4a0-07aa398fb519 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 10:07:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:34 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Instance destroyed successfully.
Oct 16 10:07:34 user nova-compute[74342]: DEBUG nova.objects.instance [None req-aa8a3db4-9474-436b-b4a0-07aa398fb519 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lazy-loading 'resources' on Instance uuid 79ebd3fd-b258-48b4-ab51-a97ba8174c30 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:07:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-aa8a3db4-9474-436b-b4a0-07aa398fb519 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:03:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1964832210',display_name='tempest-AttachVolumeTestJSON-server-1964832210',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1964832210',id=36,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB5pJIhc+XSoy3+VnlkC/661RxvWaE4z581j+N9a/Qc6Xv7PjNZzsDnJzk+KLTM2OEoJVNLV0BRDHNG0IY7fGFVjT97De3Ub99qPnfIZF2N2K+l6z7GMuhht/KEhCrN5vw==',key_name='tempest-keypair-646353730',keypairs=<?>,launch_index=0,launched_at=2023-10-16T10:03:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c28511c6c42147db9a0992cf40e044bb',ramdisk_id='',reservation_id='r-84gp0b8b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-965713551',owner_user_name='tempest-AttachVolumeTestJSON-965713551-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T10:03:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='bc0dfbfdb77347cda95ba991d37c311d',uuid=79ebd3fd-b258-48b4-ab51-a97ba8174c30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6bb97021-afe7-4ea2-9237-3b0d5a410034", "address": "fa:16:3e:1f:d6:92", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bb97021-af", "ovs_interfaceid": "6bb97021-afe7-4ea2-9237-3b0d5a410034", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 10:07:34 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-aa8a3db4-9474-436b-b4a0-07aa398fb519 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Converting VIF {"id": "6bb97021-afe7-4ea2-9237-3b0d5a410034", "address": "fa:16:3e:1f:d6:92", "network": {"id": "54ba0b2e-1a1f-44a4-ba26-8a96960d4165", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-244141486-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c28511c6c42147db9a0992cf40e044bb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bb97021-af", "ovs_interfaceid": "6bb97021-afe7-4ea2-9237-3b0d5a410034", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:07:34 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-aa8a3db4-9474-436b-b4a0-07aa398fb519 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:d6:92,bridge_name='br-int',has_traffic_filtering=True,id=6bb97021-afe7-4ea2-9237-3b0d5a410034,network=Network(54ba0b2e-1a1f-44a4-ba26-8a96960d4165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bb97021-af') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:07:34 user nova-compute[74342]: DEBUG os_vif [None req-aa8a3db4-9474-436b-b4a0-07aa398fb519 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:d6:92,bridge_name='br-int',has_traffic_filtering=True,id=6bb97021-afe7-4ea2-9237-3b0d5a410034,network=Network(54ba0b2e-1a1f-44a4-ba26-8a96960d4165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bb97021-af') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 10:07:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6bb97021-af, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:07:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=67d69024-1624-4297-9b73-287e8ca33651) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:07:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:07:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:34 user nova-compute[74342]: INFO os_vif [None req-aa8a3db4-9474-436b-b4a0-07aa398fb519 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:d6:92,bridge_name='br-int',has_traffic_filtering=True,id=6bb97021-afe7-4ea2-9237-3b0d5a410034,network=Network(54ba0b2e-1a1f-44a4-ba26-8a96960d4165),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bb97021-af')
Oct 16 10:07:34 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-aa8a3db4-9474-436b-b4a0-07aa398fb519 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Deleting instance files /opt/stack/data/nova/instances/79ebd3fd-b258-48b4-ab51-a97ba8174c30_del
Oct 16 10:07:34 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-aa8a3db4-9474-436b-b4a0-07aa398fb519 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Deletion of /opt/stack/data/nova/instances/79ebd3fd-b258-48b4-ab51-a97ba8174c30_del complete
Oct 16 10:07:34 user nova-compute[74342]: INFO nova.compute.manager [None req-aa8a3db4-9474-436b-b4a0-07aa398fb519 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Took 0.93 seconds to destroy the instance on the hypervisor.
Oct 16 10:07:34 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-aa8a3db4-9474-436b-b4a0-07aa398fb519 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 10:07:34 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 10:07:34 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 10:07:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:35 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:07:35 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Took 0.70 seconds to deallocate network for instance.
Oct 16 10:07:35 user nova-compute[74342]: DEBUG nova.compute.manager [req-43685b12-1522-4753-96cf-a9d2a5228e5a req-61195a46-5a81-4071-b6fa-7f77be6066fd service nova] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Received event network-vif-deleted-6bb97021-afe7-4ea2-9237-3b0d5a410034 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:07:35 user nova-compute[74342]: INFO nova.compute.manager [req-43685b12-1522-4753-96cf-a9d2a5228e5a req-61195a46-5a81-4071-b6fa-7f77be6066fd service nova] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Neutron deleted interface 6bb97021-afe7-4ea2-9237-3b0d5a410034; detaching it from the instance and deleting it from the info cache
Oct 16 10:07:35 user nova-compute[74342]: DEBUG nova.network.neutron [req-43685b12-1522-4753-96cf-a9d2a5228e5a req-61195a46-5a81-4071-b6fa-7f77be6066fd service nova] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:07:35 user nova-compute[74342]: DEBUG nova.compute.manager [req-43685b12-1522-4753-96cf-a9d2a5228e5a req-61195a46-5a81-4071-b6fa-7f77be6066fd service nova] [instance: 79ebd3fd-b258-48b4-ab51-a97ba8174c30] Detach interface failed, port_id=6bb97021-afe7-4ea2-9237-3b0d5a410034, reason: Instance 79ebd3fd-b258-48b4-ab51-a97ba8174c30 could not be found. {{(pid=74342) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 10:07:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-aa8a3db4-9474-436b-b4a0-07aa398fb519 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:07:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-aa8a3db4-9474-436b-b4a0-07aa398fb519 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:07:35 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-aa8a3db4-9474-436b-b4a0-07aa398fb519 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:07:35 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-aa8a3db4-9474-436b-b4a0-07aa398fb519 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:07:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-aa8a3db4-9474-436b-b4a0-07aa398fb519 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.181s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:07:35 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-aa8a3db4-9474-436b-b4a0-07aa398fb519 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Deleted allocations for instance 79ebd3fd-b258-48b4-ab51-a97ba8174c30
Oct 16 10:07:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-aa8a3db4-9474-436b-b4a0-07aa398fb519 tempest-AttachVolumeTestJSON-965713551 tempest-AttachVolumeTestJSON-965713551-project-member] Lock "79ebd3fd-b258-48b4-ab51-a97ba8174c30" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.132s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:07:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Acquiring lock "953f0937-5a7e-4629-99eb-276716802041" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:07:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "953f0937-5a7e-4629-99eb-276716802041" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:07:39 user nova-compute[74342]: DEBUG nova.compute.manager [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 10:07:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:07:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:07:40 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 10:07:40 user nova-compute[74342]: INFO nova.compute.claims [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Claim successful on node user
Oct 16 10:07:40 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:07:40 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:07:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.322s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:07:40 user nova-compute[74342]: DEBUG nova.compute.manager [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 10:07:40 user nova-compute[74342]: DEBUG nova.compute.manager [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 10:07:40 user nova-compute[74342]: DEBUG nova.network.neutron [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 10:07:40 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 10:07:40 user nova-compute[74342]: DEBUG nova.compute.manager [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 10:07:40 user nova-compute[74342]: DEBUG nova.policy [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a9e5d4c21de14697a7fad1c6264869f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6c4540e0746f9939a26d4cc4be7ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 10:07:40 user nova-compute[74342]: DEBUG nova.compute.manager [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 10:07:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 10:07:40 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Creating image(s)
Oct 16 10:07:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Acquiring lock "/opt/stack/data/nova/instances/953f0937-5a7e-4629-99eb-276716802041/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:07:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "/opt/stack/data/nova/instances/953f0937-5a7e-4629-99eb-276716802041/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:07:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "/opt/stack/data/nova/instances/953f0937-5a7e-4629-99eb-276716802041/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:07:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.278s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:07:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:07:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.209s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/953f0937-5a7e-4629-99eb-276716802041/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/953f0937-5a7e-4629-99eb-276716802041/disk 1073741824" returned: 0 in 0.066s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.283s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:07:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:41 user nova-compute[74342]: DEBUG nova.network.neutron [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Successfully created port: 489066fb-94a0-4965-8fa8-3227a1a233ad {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 10:07:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.190s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:41 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Checking if we can resize image /opt/stack/data/nova/instances/953f0937-5a7e-4629-99eb-276716802041/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 10:07:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953f0937-5a7e-4629-99eb-276716802041/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953f0937-5a7e-4629-99eb-276716802041/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:41 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Cannot resize image /opt/stack/data/nova/instances/953f0937-5a7e-4629-99eb-276716802041/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 10:07:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 10:07:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Ensure instance console log exists: /opt/stack/data/nova/instances/953f0937-5a7e-4629-99eb-276716802041/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 10:07:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:07:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:07:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:07:41 user nova-compute[74342]: DEBUG nova.network.neutron [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Successfully updated port: 489066fb-94a0-4965-8fa8-3227a1a233ad {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Acquiring lock "refresh_cache-953f0937-5a7e-4629-99eb-276716802041" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Acquired lock "refresh_cache-953f0937-5a7e-4629-99eb-276716802041" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.network.neutron [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.compute.manager [req-abf5e6f5-fced-4a6f-a7cc-9f86b856143b req-ec13086e-a081-4bc9-ad14-467f743eb24a service nova] [instance: 953f0937-5a7e-4629-99eb-276716802041] Received event network-changed-489066fb-94a0-4965-8fa8-3227a1a233ad {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.compute.manager [req-abf5e6f5-fced-4a6f-a7cc-9f86b856143b req-ec13086e-a081-4bc9-ad14-467f743eb24a service nova] [instance: 953f0937-5a7e-4629-99eb-276716802041] Refreshing instance network info cache due to event network-changed-489066fb-94a0-4965-8fa8-3227a1a233ad. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-abf5e6f5-fced-4a6f-a7cc-9f86b856143b req-ec13086e-a081-4bc9-ad14-467f743eb24a service nova] Acquiring lock "refresh_cache-953f0937-5a7e-4629-99eb-276716802041" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.network.neutron [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.network.neutron [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Updating instance_info_cache with network_info: [{"id": "489066fb-94a0-4965-8fa8-3227a1a233ad", "address": "fa:16:3e:4c:be:77", "network": {"id": "694e4583-ab39-4b9d-b166-c025853d10a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1799473053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f6c4540e0746f9939a26d4cc4be7ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap489066fb-94", "ovs_interfaceid": "489066fb-94a0-4965-8fa8-3227a1a233ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Releasing lock "refresh_cache-953f0937-5a7e-4629-99eb-276716802041" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.compute.manager [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Instance network_info: |[{"id": "489066fb-94a0-4965-8fa8-3227a1a233ad", "address": "fa:16:3e:4c:be:77", "network": {"id": "694e4583-ab39-4b9d-b166-c025853d10a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1799473053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f6c4540e0746f9939a26d4cc4be7ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap489066fb-94", "ovs_interfaceid": "489066fb-94a0-4965-8fa8-3227a1a233ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-abf5e6f5-fced-4a6f-a7cc-9f86b856143b req-ec13086e-a081-4bc9-ad14-467f743eb24a service nova] Acquired lock "refresh_cache-953f0937-5a7e-4629-99eb-276716802041" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.network.neutron [req-abf5e6f5-fced-4a6f-a7cc-9f86b856143b req-ec13086e-a081-4bc9-ad14-467f743eb24a service nova] [instance: 953f0937-5a7e-4629-99eb-276716802041] Refreshing network info cache for port 489066fb-94a0-4965-8fa8-3227a1a233ad {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Start _get_guest_xml network_info=[{"id": "489066fb-94a0-4965-8fa8-3227a1a233ad", "address": "fa:16:3e:4c:be:77", "network": {"id": "694e4583-ab39-4b9d-b166-c025853d10a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1799473053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f6c4540e0746f9939a26d4cc4be7ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap489066fb-94", "ovs_interfaceid": "489066fb-94a0-4965-8fa8-3227a1a233ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 10:07:42 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:07:42 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:07:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-272487994',display_name='tempest-VolumesActionsTest-instance-272487994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-272487994',id=40,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3f6c4540e0746f9939a26d4cc4be7ab',ramdisk_id='',reservation_id='r-gg45inph',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-188382855',owner_user_name='tempest-VolumesActionsTest-188382855-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:07:41Z,user_data=None,user_id='a9e5d4c21de14697a7fad1c6264869f8',uuid=953f0937-5a7e-4629-99eb-276716802041,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "489066fb-94a0-4965-8fa8-3227a1a233ad", "address": "fa:16:3e:4c:be:77", "network": {"id": "694e4583-ab39-4b9d-b166-c025853d10a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1799473053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f6c4540e0746f9939a26d4cc4be7ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap489066fb-94", "ovs_interfaceid": "489066fb-94a0-4965-8fa8-3227a1a233ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Converting VIF {"id": "489066fb-94a0-4965-8fa8-3227a1a233ad", "address": "fa:16:3e:4c:be:77", "network": {"id": "694e4583-ab39-4b9d-b166-c025853d10a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1799473053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f6c4540e0746f9939a26d4cc4be7ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap489066fb-94", "ovs_interfaceid": "489066fb-94a0-4965-8fa8-3227a1a233ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:be:77,bridge_name='br-int',has_traffic_filtering=True,id=489066fb-94a0-4965-8fa8-3227a1a233ad,network=Network(694e4583-ab39-4b9d-b166-c025853d10a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap489066fb-94') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.objects.instance [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lazy-loading 'pci_devices' on Instance uuid 953f0937-5a7e-4629-99eb-276716802041 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] End _get_guest_xml xml=<domain type="kvm">
Oct 16 10:07:42 user nova-compute[74342]:   <uuid>953f0937-5a7e-4629-99eb-276716802041</uuid>
Oct 16 10:07:42 user nova-compute[74342]:   <name>instance-00000028</name>
Oct 16 10:07:42 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 10:07:42 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 10:07:42 user nova-compute[74342]:   <metadata>
Oct 16 10:07:42 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 10:07:42 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 10:07:42 user nova-compute[74342]:       <nova:name>tempest-VolumesActionsTest-instance-272487994</nova:name>
Oct 16 10:07:42 user nova-compute[74342]:       <nova:creationTime>2023-10-16 10:07:42</nova:creationTime>
Oct 16 10:07:42 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 10:07:42 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 10:07:42 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 10:07:42 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 10:07:42 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 10:07:42 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 10:07:42 user nova-compute[74342]:       </nova:flavor>
Oct 16 10:07:42 user nova-compute[74342]:       <nova:owner>
Oct 16 10:07:42 user nova-compute[74342]:         <nova:user uuid="a9e5d4c21de14697a7fad1c6264869f8">tempest-VolumesActionsTest-188382855-project-member</nova:user>
Oct 16 10:07:42 user nova-compute[74342]:         <nova:project uuid="c3f6c4540e0746f9939a26d4cc4be7ab">tempest-VolumesActionsTest-188382855</nova:project>
Oct 16 10:07:42 user nova-compute[74342]:       </nova:owner>
Oct 16 10:07:42 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 10:07:42 user nova-compute[74342]:       <nova:ports>
Oct 16 10:07:42 user nova-compute[74342]:         <nova:port uuid="489066fb-94a0-4965-8fa8-3227a1a233ad">
Oct 16 10:07:42 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 16 10:07:42 user nova-compute[74342]:         </nova:port>
Oct 16 10:07:42 user nova-compute[74342]:       </nova:ports>
Oct 16 10:07:42 user nova-compute[74342]:     </nova:instance>
Oct 16 10:07:42 user nova-compute[74342]:   </metadata>
Oct 16 10:07:42 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 10:07:42 user nova-compute[74342]:     <system>
Oct 16 10:07:42 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 10:07:42 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 10:07:42 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 10:07:42 user nova-compute[74342]:       <entry name="serial">953f0937-5a7e-4629-99eb-276716802041</entry>
Oct 16 10:07:42 user nova-compute[74342]:       <entry name="uuid">953f0937-5a7e-4629-99eb-276716802041</entry>
Oct 16 10:07:42 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 10:07:42 user nova-compute[74342]:     </system>
Oct 16 10:07:42 user nova-compute[74342]:   </sysinfo>
Oct 16 10:07:42 user nova-compute[74342]:   <os>
Oct 16 10:07:42 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 10:07:42 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 10:07:42 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 10:07:42 user nova-compute[74342]:   </os>
Oct 16 10:07:42 user nova-compute[74342]:   <features>
Oct 16 10:07:42 user nova-compute[74342]:     <acpi/>
Oct 16 10:07:42 user nova-compute[74342]:     <apic/>
Oct 16 10:07:42 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 10:07:42 user nova-compute[74342]:   </features>
Oct 16 10:07:42 user nova-compute[74342]:   <clock offset="utc">
Oct 16 10:07:42 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 10:07:42 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 10:07:42 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 10:07:42 user nova-compute[74342]:   </clock>
Oct 16 10:07:42 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 10:07:42 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 10:07:42 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 10:07:42 user nova-compute[74342]:   </cpu>
Oct 16 10:07:42 user nova-compute[74342]:   <devices>
Oct 16 10:07:42 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 10:07:42 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 10:07:42 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/953f0937-5a7e-4629-99eb-276716802041/disk"/>
Oct 16 10:07:42 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 10:07:42 user nova-compute[74342]:     </disk>
Oct 16 10:07:42 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 10:07:42 user nova-compute[74342]:       <mac address="fa:16:3e:4c:be:77"/>
Oct 16 10:07:42 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:07:42 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 10:07:42 user nova-compute[74342]:       <target dev="tap489066fb-94"/>
Oct 16 10:07:42 user nova-compute[74342]:     </interface>
Oct 16 10:07:42 user nova-compute[74342]:     <serial type="pty">
Oct 16 10:07:42 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/953f0937-5a7e-4629-99eb-276716802041/console.log" append="off"/>
Oct 16 10:07:42 user nova-compute[74342]:     </serial>
Oct 16 10:07:42 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 10:07:42 user nova-compute[74342]:     <video>
Oct 16 10:07:42 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:07:42 user nova-compute[74342]:     </video>
Oct 16 10:07:42 user nova-compute[74342]:     <rng model="virtio">
Oct 16 10:07:42 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 10:07:42 user nova-compute[74342]:     </rng>
Oct 16 10:07:42 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 10:07:42 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 10:07:42 user nova-compute[74342]:       <stats period="10"/>
Oct 16 10:07:42 user nova-compute[74342]:     </memballoon>
Oct 16 10:07:42 user nova-compute[74342]:   </devices>
Oct 16 10:07:42 user nova-compute[74342]: </domain>
Oct 16 10:07:42 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:07:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-272487994',display_name='tempest-VolumesActionsTest-instance-272487994',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-272487994',id=40,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3f6c4540e0746f9939a26d4cc4be7ab',ramdisk_id='',reservation_id='r-gg45inph',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-188382855',owner_user_name='tempest-VolumesActionsTest-188382855-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:07:41Z,user_data=None,user_id='a9e5d4c21de14697a7fad1c6264869f8',uuid=953f0937-5a7e-4629-99eb-276716802041,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "489066fb-94a0-4965-8fa8-3227a1a233ad", "address": "fa:16:3e:4c:be:77", "network": {"id": "694e4583-ab39-4b9d-b166-c025853d10a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1799473053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f6c4540e0746f9939a26d4cc4be7ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap489066fb-94", "ovs_interfaceid": "489066fb-94a0-4965-8fa8-3227a1a233ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Converting VIF {"id": "489066fb-94a0-4965-8fa8-3227a1a233ad", "address": "fa:16:3e:4c:be:77", "network": {"id": "694e4583-ab39-4b9d-b166-c025853d10a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1799473053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f6c4540e0746f9939a26d4cc4be7ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap489066fb-94", "ovs_interfaceid": "489066fb-94a0-4965-8fa8-3227a1a233ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:be:77,bridge_name='br-int',has_traffic_filtering=True,id=489066fb-94a0-4965-8fa8-3227a1a233ad,network=Network(694e4583-ab39-4b9d-b166-c025853d10a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap489066fb-94') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG os_vif [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:be:77,bridge_name='br-int',has_traffic_filtering=True,id=489066fb-94a0-4965-8fa8-3227a1a233ad,network=Network(694e4583-ab39-4b9d-b166-c025853d10a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap489066fb-94') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3f8be26f-1654-5c82-995e-a1195c2b98d0', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap489066fb-94, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap489066fb-94, col_values=(('qos', UUID('662fa96a-2dda-4420-bae1-3b3eac10817f')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap489066fb-94, col_values=(('external_ids', {'iface-id': '489066fb-94a0-4965-8fa8-3227a1a233ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:be:77', 'vm-uuid': '953f0937-5a7e-4629-99eb-276716802041'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:42 user nova-compute[74342]: INFO os_vif [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:be:77,bridge_name='br-int',has_traffic_filtering=True,id=489066fb-94a0-4965-8fa8-3227a1a233ad,network=Network(694e4583-ab39-4b9d-b166-c025853d10a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap489066fb-94')
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] No VIF found with MAC fa:16:3e:4c:be:77, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.network.neutron [req-abf5e6f5-fced-4a6f-a7cc-9f86b856143b req-ec13086e-a081-4bc9-ad14-467f743eb24a service nova] [instance: 953f0937-5a7e-4629-99eb-276716802041] Updated VIF entry in instance network info cache for port 489066fb-94a0-4965-8fa8-3227a1a233ad. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG nova.network.neutron [req-abf5e6f5-fced-4a6f-a7cc-9f86b856143b req-ec13086e-a081-4bc9-ad14-467f743eb24a service nova] [instance: 953f0937-5a7e-4629-99eb-276716802041] Updating instance_info_cache with network_info: [{"id": "489066fb-94a0-4965-8fa8-3227a1a233ad", "address": "fa:16:3e:4c:be:77", "network": {"id": "694e4583-ab39-4b9d-b166-c025853d10a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1799473053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f6c4540e0746f9939a26d4cc4be7ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap489066fb-94", "ovs_interfaceid": "489066fb-94a0-4965-8fa8-3227a1a233ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:07:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-abf5e6f5-fced-4a6f-a7cc-9f86b856143b req-ec13086e-a081-4bc9-ad14-467f743eb24a service nova] Releasing lock "refresh_cache-953f0937-5a7e-4629-99eb-276716802041" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:07:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:46 user nova-compute[74342]: DEBUG nova.compute.manager [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 10:07:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 10:07:46 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 953f0937-5a7e-4629-99eb-276716802041] Instance spawned successfully.
Oct 16 10:07:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 10:07:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:07:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:07:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:07:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:07:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:07:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:07:46 user nova-compute[74342]: INFO nova.compute.manager [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Took 5.50 seconds to spawn the instance on the hypervisor.
Oct 16 10:07:46 user nova-compute[74342]: DEBUG nova.compute.manager [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:07:46 user nova-compute[74342]: INFO nova.compute.manager [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Took 6.21 seconds to build instance.
Oct 16 10:07:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-920fc4bc-eece-4dcc-a043-49f3e9398527 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "953f0937-5a7e-4629-99eb-276716802041" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.329s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:07:46 user nova-compute[74342]: DEBUG nova.compute.manager [req-9c1a2b40-2746-4d9a-9b4f-b8879c0b265d req-6f4a8268-2f69-4573-8eca-d6cd22238a83 service nova] [instance: 953f0937-5a7e-4629-99eb-276716802041] Received event network-vif-plugged-489066fb-94a0-4965-8fa8-3227a1a233ad {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:07:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9c1a2b40-2746-4d9a-9b4f-b8879c0b265d req-6f4a8268-2f69-4573-8eca-d6cd22238a83 service nova] Acquiring lock "953f0937-5a7e-4629-99eb-276716802041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:07:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9c1a2b40-2746-4d9a-9b4f-b8879c0b265d req-6f4a8268-2f69-4573-8eca-d6cd22238a83 service nova] Lock "953f0937-5a7e-4629-99eb-276716802041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:07:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9c1a2b40-2746-4d9a-9b4f-b8879c0b265d req-6f4a8268-2f69-4573-8eca-d6cd22238a83 service nova] Lock "953f0937-5a7e-4629-99eb-276716802041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:07:46 user nova-compute[74342]: DEBUG nova.compute.manager [req-9c1a2b40-2746-4d9a-9b4f-b8879c0b265d req-6f4a8268-2f69-4573-8eca-d6cd22238a83 service nova] [instance: 953f0937-5a7e-4629-99eb-276716802041] No waiting events found dispatching network-vif-plugged-489066fb-94a0-4965-8fa8-3227a1a233ad {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:07:46 user nova-compute[74342]: WARNING nova.compute.manager [req-9c1a2b40-2746-4d9a-9b4f-b8879c0b265d req-6f4a8268-2f69-4573-8eca-d6cd22238a83 service nova] [instance: 953f0937-5a7e-4629-99eb-276716802041] Received unexpected event network-vif-plugged-489066fb-94a0-4965-8fa8-3227a1a233ad for instance with vm_state active and task_state None.
Oct 16 10:07:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:48 user nova-compute[74342]: DEBUG nova.compute.manager [req-5ebed173-3faa-4bcf-8e47-c38926ea2a15 req-6e45ab65-0570-4c83-bdad-9a620b014578 service nova] [instance: 953f0937-5a7e-4629-99eb-276716802041] Received event network-vif-plugged-489066fb-94a0-4965-8fa8-3227a1a233ad {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:07:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5ebed173-3faa-4bcf-8e47-c38926ea2a15 req-6e45ab65-0570-4c83-bdad-9a620b014578 service nova] Acquiring lock "953f0937-5a7e-4629-99eb-276716802041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:07:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5ebed173-3faa-4bcf-8e47-c38926ea2a15 req-6e45ab65-0570-4c83-bdad-9a620b014578 service nova] Lock "953f0937-5a7e-4629-99eb-276716802041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:07:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5ebed173-3faa-4bcf-8e47-c38926ea2a15 req-6e45ab65-0570-4c83-bdad-9a620b014578 service nova] Lock "953f0937-5a7e-4629-99eb-276716802041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:07:48 user nova-compute[74342]: DEBUG nova.compute.manager [req-5ebed173-3faa-4bcf-8e47-c38926ea2a15 req-6e45ab65-0570-4c83-bdad-9a620b014578 service nova] [instance: 953f0937-5a7e-4629-99eb-276716802041] No waiting events found dispatching network-vif-plugged-489066fb-94a0-4965-8fa8-3227a1a233ad {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:07:48 user nova-compute[74342]: WARNING nova.compute.manager [req-5ebed173-3faa-4bcf-8e47-c38926ea2a15 req-6e45ab65-0570-4c83-bdad-9a620b014578 service nova] [instance: 953f0937-5a7e-4629-99eb-276716802041] Received unexpected event network-vif-plugged-489066fb-94a0-4965-8fa8-3227a1a233ad for instance with vm_state active and task_state None.
Oct 16 10:07:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "b547349a-1126-4700-93ca-d39e1da5c5cd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:07:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "b547349a-1126-4700-93ca-d39e1da5c5cd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:07:56 user nova-compute[74342]: DEBUG nova.compute.manager [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 10:07:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:07:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:07:56 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 10:07:56 user nova-compute[74342]: INFO nova.compute.claims [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Claim successful on node user
Oct 16 10:07:56 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:07:56 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:07:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.307s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:07:56 user nova-compute[74342]: DEBUG nova.compute.manager [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 10:07:56 user nova-compute[74342]: DEBUG nova.compute.manager [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 10:07:56 user nova-compute[74342]: DEBUG nova.network.neutron [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 10:07:56 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 10:07:56 user nova-compute[74342]: DEBUG nova.compute.manager [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 10:07:56 user nova-compute[74342]: DEBUG nova.policy [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '122de085fe2d46d18ff8fff362bf7cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f185c7dee6c4e7f8fe0d7bb2e89e854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 10:07:56 user nova-compute[74342]: DEBUG nova.compute.manager [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 10:07:56 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 10:07:56 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Creating image(s)
Oct 16 10:07:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "/opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:07:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "/opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:07:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "/opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:07:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.240s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:07:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:07:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.226s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk 1073741824" returned: 0 in 0.061s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.295s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:07:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.191s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:57 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 10:07:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:07:57 user nova-compute[74342]: DEBUG nova.network.neutron [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Successfully created port: 841bff3b-23d1-4225-af17-45709c874a35 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 10:07:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:07:57 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Cannot resize image /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 10:07:57 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 10:07:57 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Ensure instance console log exists: /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 10:07:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:07:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:07:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.network.neutron [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Successfully updated port: 841bff3b-23d1-4225-af17-45709c874a35 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "refresh_cache-b547349a-1126-4700-93ca-d39e1da5c5cd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquired lock "refresh_cache-b547349a-1126-4700-93ca-d39e1da5c5cd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.network.neutron [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.compute.manager [req-961ec31c-c168-4a57-a8f6-d92bdcf024a2 req-a3c554ee-50f3-4471-b6d0-8f91c74b995c service nova] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Received event network-changed-841bff3b-23d1-4225-af17-45709c874a35 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.compute.manager [req-961ec31c-c168-4a57-a8f6-d92bdcf024a2 req-a3c554ee-50f3-4471-b6d0-8f91c74b995c service nova] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Refreshing instance network info cache due to event network-changed-841bff3b-23d1-4225-af17-45709c874a35. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-961ec31c-c168-4a57-a8f6-d92bdcf024a2 req-a3c554ee-50f3-4471-b6d0-8f91c74b995c service nova] Acquiring lock "refresh_cache-b547349a-1126-4700-93ca-d39e1da5c5cd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.network.neutron [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.network.neutron [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Updating instance_info_cache with network_info: [{"id": "841bff3b-23d1-4225-af17-45709c874a35", "address": "fa:16:3e:8f:4b:dc", "network": {"id": "ca9b5a27-87ee-46f0-a771-1ba5925e04de", "bridge": "br-int", "label": "tempest-TestStampPattern-847672181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f185c7dee6c4e7f8fe0d7bb2e89e854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841bff3b-23", "ovs_interfaceid": "841bff3b-23d1-4225-af17-45709c874a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Releasing lock "refresh_cache-b547349a-1126-4700-93ca-d39e1da5c5cd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.compute.manager [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Instance network_info: |[{"id": "841bff3b-23d1-4225-af17-45709c874a35", "address": "fa:16:3e:8f:4b:dc", "network": {"id": "ca9b5a27-87ee-46f0-a771-1ba5925e04de", "bridge": "br-int", "label": "tempest-TestStampPattern-847672181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f185c7dee6c4e7f8fe0d7bb2e89e854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841bff3b-23", "ovs_interfaceid": "841bff3b-23d1-4225-af17-45709c874a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-961ec31c-c168-4a57-a8f6-d92bdcf024a2 req-a3c554ee-50f3-4471-b6d0-8f91c74b995c service nova] Acquired lock "refresh_cache-b547349a-1126-4700-93ca-d39e1da5c5cd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.network.neutron [req-961ec31c-c168-4a57-a8f6-d92bdcf024a2 req-a3c554ee-50f3-4471-b6d0-8f91c74b995c service nova] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Refreshing network info cache for port 841bff3b-23d1-4225-af17-45709c874a35 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Start _get_guest_xml network_info=[{"id": "841bff3b-23d1-4225-af17-45709c874a35", "address": "fa:16:3e:8f:4b:dc", "network": {"id": "ca9b5a27-87ee-46f0-a771-1ba5925e04de", "bridge": "br-int", "label": "tempest-TestStampPattern-847672181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f185c7dee6c4e7f8fe0d7bb2e89e854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841bff3b-23", "ovs_interfaceid": "841bff3b-23d1-4225-af17-45709c874a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 10:07:58 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:07:58 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:07:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1363180860',display_name='tempest-TestStampPattern-server-1363180860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1363180860',id=41,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqaEvE2WxtZyUpj/QXmrU1PYxONwCsPW4U4I5X6LON7fZWTJ1Ui7jNxiJSotZ6hnR+YMLAgOjTfsC+JoMGOfw8b+qKTBDFop/S0eo6Ga/23kvhrgO0ezrKiqFMkS1cH3w==',key_name='tempest-TestStampPattern-174449930',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f185c7dee6c4e7f8fe0d7bb2e89e854',ramdisk_id='',reservation_id='r-093q486k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1468188741',owner_user_name='tempest-TestStampPattern-1468188741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:07:57Z,user_data=None,user_id='122de085fe2d46d18ff8fff362bf7cf5',uuid=b547349a-1126-4700-93ca-d39e1da5c5cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "841bff3b-23d1-4225-af17-45709c874a35", "address": "fa:16:3e:8f:4b:dc", "network": {"id": "ca9b5a27-87ee-46f0-a771-1ba5925e04de", "bridge": "br-int", "label": "tempest-TestStampPattern-847672181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f185c7dee6c4e7f8fe0d7bb2e89e854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841bff3b-23", "ovs_interfaceid": "841bff3b-23d1-4225-af17-45709c874a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Converting VIF {"id": "841bff3b-23d1-4225-af17-45709c874a35", "address": "fa:16:3e:8f:4b:dc", "network": {"id": "ca9b5a27-87ee-46f0-a771-1ba5925e04de", "bridge": "br-int", "label": "tempest-TestStampPattern-847672181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f185c7dee6c4e7f8fe0d7bb2e89e854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841bff3b-23", "ovs_interfaceid": "841bff3b-23d1-4225-af17-45709c874a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4b:dc,bridge_name='br-int',has_traffic_filtering=True,id=841bff3b-23d1-4225-af17-45709c874a35,network=Network(ca9b5a27-87ee-46f0-a771-1ba5925e04de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841bff3b-23') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.objects.instance [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lazy-loading 'pci_devices' on Instance uuid b547349a-1126-4700-93ca-d39e1da5c5cd {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] End _get_guest_xml xml=<domain type="kvm">
Oct 16 10:07:58 user nova-compute[74342]:   <uuid>b547349a-1126-4700-93ca-d39e1da5c5cd</uuid>
Oct 16 10:07:58 user nova-compute[74342]:   <name>instance-00000029</name>
Oct 16 10:07:58 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 10:07:58 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 10:07:58 user nova-compute[74342]:   <metadata>
Oct 16 10:07:58 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 10:07:58 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 10:07:58 user nova-compute[74342]:       <nova:name>tempest-TestStampPattern-server-1363180860</nova:name>
Oct 16 10:07:58 user nova-compute[74342]:       <nova:creationTime>2023-10-16 10:07:58</nova:creationTime>
Oct 16 10:07:58 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 10:07:58 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 10:07:58 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 10:07:58 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 10:07:58 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 10:07:58 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 10:07:58 user nova-compute[74342]:       </nova:flavor>
Oct 16 10:07:58 user nova-compute[74342]:       <nova:owner>
Oct 16 10:07:58 user nova-compute[74342]:         <nova:user uuid="122de085fe2d46d18ff8fff362bf7cf5">tempest-TestStampPattern-1468188741-project-member</nova:user>
Oct 16 10:07:58 user nova-compute[74342]:         <nova:project uuid="5f185c7dee6c4e7f8fe0d7bb2e89e854">tempest-TestStampPattern-1468188741</nova:project>
Oct 16 10:07:58 user nova-compute[74342]:       </nova:owner>
Oct 16 10:07:58 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 10:07:58 user nova-compute[74342]:       <nova:ports>
Oct 16 10:07:58 user nova-compute[74342]:         <nova:port uuid="841bff3b-23d1-4225-af17-45709c874a35">
Oct 16 10:07:58 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Oct 16 10:07:58 user nova-compute[74342]:         </nova:port>
Oct 16 10:07:58 user nova-compute[74342]:       </nova:ports>
Oct 16 10:07:58 user nova-compute[74342]:     </nova:instance>
Oct 16 10:07:58 user nova-compute[74342]:   </metadata>
Oct 16 10:07:58 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 10:07:58 user nova-compute[74342]:     <system>
Oct 16 10:07:58 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 10:07:58 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 10:07:58 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 10:07:58 user nova-compute[74342]:       <entry name="serial">b547349a-1126-4700-93ca-d39e1da5c5cd</entry>
Oct 16 10:07:58 user nova-compute[74342]:       <entry name="uuid">b547349a-1126-4700-93ca-d39e1da5c5cd</entry>
Oct 16 10:07:58 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 10:07:58 user nova-compute[74342]:     </system>
Oct 16 10:07:58 user nova-compute[74342]:   </sysinfo>
Oct 16 10:07:58 user nova-compute[74342]:   <os>
Oct 16 10:07:58 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 10:07:58 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 10:07:58 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 10:07:58 user nova-compute[74342]:   </os>
Oct 16 10:07:58 user nova-compute[74342]:   <features>
Oct 16 10:07:58 user nova-compute[74342]:     <acpi/>
Oct 16 10:07:58 user nova-compute[74342]:     <apic/>
Oct 16 10:07:58 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 10:07:58 user nova-compute[74342]:   </features>
Oct 16 10:07:58 user nova-compute[74342]:   <clock offset="utc">
Oct 16 10:07:58 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 10:07:58 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 10:07:58 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 10:07:58 user nova-compute[74342]:   </clock>
Oct 16 10:07:58 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 10:07:58 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 10:07:58 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 10:07:58 user nova-compute[74342]:   </cpu>
Oct 16 10:07:58 user nova-compute[74342]:   <devices>
Oct 16 10:07:58 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 10:07:58 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 10:07:58 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk"/>
Oct 16 10:07:58 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 10:07:58 user nova-compute[74342]:     </disk>
Oct 16 10:07:58 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 10:07:58 user nova-compute[74342]:       <mac address="fa:16:3e:8f:4b:dc"/>
Oct 16 10:07:58 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:07:58 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 10:07:58 user nova-compute[74342]:       <target dev="tap841bff3b-23"/>
Oct 16 10:07:58 user nova-compute[74342]:     </interface>
Oct 16 10:07:58 user nova-compute[74342]:     <serial type="pty">
Oct 16 10:07:58 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/console.log" append="off"/>
Oct 16 10:07:58 user nova-compute[74342]:     </serial>
Oct 16 10:07:58 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 10:07:58 user nova-compute[74342]:     <video>
Oct 16 10:07:58 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:07:58 user nova-compute[74342]:     </video>
Oct 16 10:07:58 user nova-compute[74342]:     <rng model="virtio">
Oct 16 10:07:58 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 10:07:58 user nova-compute[74342]:     </rng>
Oct 16 10:07:58 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 10:07:58 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 10:07:58 user nova-compute[74342]:       <stats period="10"/>
Oct 16 10:07:58 user nova-compute[74342]:     </memballoon>
Oct 16 10:07:58 user nova-compute[74342]:   </devices>
Oct 16 10:07:58 user nova-compute[74342]: </domain>
Oct 16 10:07:58 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:07:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1363180860',display_name='tempest-TestStampPattern-server-1363180860',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1363180860',id=41,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqaEvE2WxtZyUpj/QXmrU1PYxONwCsPW4U4I5X6LON7fZWTJ1Ui7jNxiJSotZ6hnR+YMLAgOjTfsC+JoMGOfw8b+qKTBDFop/S0eo6Ga/23kvhrgO0ezrKiqFMkS1cH3w==',key_name='tempest-TestStampPattern-174449930',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f185c7dee6c4e7f8fe0d7bb2e89e854',ramdisk_id='',reservation_id='r-093q486k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-1468188741',owner_user_name='tempest-TestStampPattern-1468188741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:07:57Z,user_data=None,user_id='122de085fe2d46d18ff8fff362bf7cf5',uuid=b547349a-1126-4700-93ca-d39e1da5c5cd,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "841bff3b-23d1-4225-af17-45709c874a35", "address": "fa:16:3e:8f:4b:dc", "network": {"id": "ca9b5a27-87ee-46f0-a771-1ba5925e04de", "bridge": "br-int", "label": "tempest-TestStampPattern-847672181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f185c7dee6c4e7f8fe0d7bb2e89e854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841bff3b-23", "ovs_interfaceid": "841bff3b-23d1-4225-af17-45709c874a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Converting VIF {"id": "841bff3b-23d1-4225-af17-45709c874a35", "address": "fa:16:3e:8f:4b:dc", "network": {"id": "ca9b5a27-87ee-46f0-a771-1ba5925e04de", "bridge": "br-int", "label": "tempest-TestStampPattern-847672181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f185c7dee6c4e7f8fe0d7bb2e89e854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841bff3b-23", "ovs_interfaceid": "841bff3b-23d1-4225-af17-45709c874a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4b:dc,bridge_name='br-int',has_traffic_filtering=True,id=841bff3b-23d1-4225-af17-45709c874a35,network=Network(ca9b5a27-87ee-46f0-a771-1ba5925e04de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841bff3b-23') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG os_vif [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4b:dc,bridge_name='br-int',has_traffic_filtering=True,id=841bff3b-23d1-4225-af17-45709c874a35,network=Network(ca9b5a27-87ee-46f0-a771-1ba5925e04de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841bff3b-23') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fa3480b5-7b31-5964-82a4-cccec018b71a', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap841bff3b-23, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap841bff3b-23, col_values=(('qos', UUID('096517e9-5cd6-4a03-bf2e-cd221be2cc41')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap841bff3b-23, col_values=(('external_ids', {'iface-id': '841bff3b-23d1-4225-af17-45709c874a35', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:4b:dc', 'vm-uuid': 'b547349a-1126-4700-93ca-d39e1da5c5cd'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:58 user nova-compute[74342]: INFO os_vif [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:4b:dc,bridge_name='br-int',has_traffic_filtering=True,id=841bff3b-23d1-4225-af17-45709c874a35,network=Network(ca9b5a27-87ee-46f0-a771-1ba5925e04de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841bff3b-23')
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] No VIF found with MAC fa:16:3e:8f:4b:dc, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.network.neutron [req-961ec31c-c168-4a57-a8f6-d92bdcf024a2 req-a3c554ee-50f3-4471-b6d0-8f91c74b995c service nova] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Updated VIF entry in instance network info cache for port 841bff3b-23d1-4225-af17-45709c874a35. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG nova.network.neutron [req-961ec31c-c168-4a57-a8f6-d92bdcf024a2 req-a3c554ee-50f3-4471-b6d0-8f91c74b995c service nova] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Updating instance_info_cache with network_info: [{"id": "841bff3b-23d1-4225-af17-45709c874a35", "address": "fa:16:3e:8f:4b:dc", "network": {"id": "ca9b5a27-87ee-46f0-a771-1ba5925e04de", "bridge": "br-int", "label": "tempest-TestStampPattern-847672181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f185c7dee6c4e7f8fe0d7bb2e89e854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841bff3b-23", "ovs_interfaceid": "841bff3b-23d1-4225-af17-45709c874a35", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:07:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-961ec31c-c168-4a57-a8f6-d92bdcf024a2 req-a3c554ee-50f3-4471-b6d0-8f91c74b995c service nova] Releasing lock "refresh_cache-b547349a-1126-4700-93ca-d39e1da5c5cd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:07:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:07:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:00 user nova-compute[74342]: DEBUG nova.compute.manager [req-8353da1e-e4ab-4c93-979d-f1bc9fb9544a req-2e801e53-e176-431e-9768-e9f0be529b8f service nova] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Received event network-vif-plugged-841bff3b-23d1-4225-af17-45709c874a35 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:08:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8353da1e-e4ab-4c93-979d-f1bc9fb9544a req-2e801e53-e176-431e-9768-e9f0be529b8f service nova] Acquiring lock "b547349a-1126-4700-93ca-d39e1da5c5cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:08:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8353da1e-e4ab-4c93-979d-f1bc9fb9544a req-2e801e53-e176-431e-9768-e9f0be529b8f service nova] Lock "b547349a-1126-4700-93ca-d39e1da5c5cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.008s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:08:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8353da1e-e4ab-4c93-979d-f1bc9fb9544a req-2e801e53-e176-431e-9768-e9f0be529b8f service nova] Lock "b547349a-1126-4700-93ca-d39e1da5c5cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:08:00 user nova-compute[74342]: DEBUG nova.compute.manager [req-8353da1e-e4ab-4c93-979d-f1bc9fb9544a req-2e801e53-e176-431e-9768-e9f0be529b8f service nova] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] No waiting events found dispatching network-vif-plugged-841bff3b-23d1-4225-af17-45709c874a35 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:08:00 user nova-compute[74342]: WARNING nova.compute.manager [req-8353da1e-e4ab-4c93-979d-f1bc9fb9544a req-2e801e53-e176-431e-9768-e9f0be529b8f service nova] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Received unexpected event network-vif-plugged-841bff3b-23d1-4225-af17-45709c874a35 for instance with vm_state building and task_state spawning.
Oct 16 10:08:00 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:08:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-d1aca420-df44-4899-9710-4d4a8dea6b03 req-5400bc59-d7ae-4f59-9ae0-e1d159f4f2e8 service nova] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Received event network-vif-plugged-841bff3b-23d1-4225-af17-45709c874a35 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:08:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d1aca420-df44-4899-9710-4d4a8dea6b03 req-5400bc59-d7ae-4f59-9ae0-e1d159f4f2e8 service nova] Acquiring lock "b547349a-1126-4700-93ca-d39e1da5c5cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:08:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d1aca420-df44-4899-9710-4d4a8dea6b03 req-5400bc59-d7ae-4f59-9ae0-e1d159f4f2e8 service nova] Lock "b547349a-1126-4700-93ca-d39e1da5c5cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:08:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d1aca420-df44-4899-9710-4d4a8dea6b03 req-5400bc59-d7ae-4f59-9ae0-e1d159f4f2e8 service nova] Lock "b547349a-1126-4700-93ca-d39e1da5c5cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:08:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-d1aca420-df44-4899-9710-4d4a8dea6b03 req-5400bc59-d7ae-4f59-9ae0-e1d159f4f2e8 service nova] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] No waiting events found dispatching network-vif-plugged-841bff3b-23d1-4225-af17-45709c874a35 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:08:02 user nova-compute[74342]: WARNING nova.compute.manager [req-d1aca420-df44-4899-9710-4d4a8dea6b03 req-5400bc59-d7ae-4f59-9ae0-e1d159f4f2e8 service nova] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Received unexpected event network-vif-plugged-841bff3b-23d1-4225-af17-45709c874a35 for instance with vm_state building and task_state spawning.
Oct 16 10:08:02 user nova-compute[74342]: DEBUG nova.compute.manager [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 10:08:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 10:08:02 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Instance spawned successfully.
Oct 16 10:08:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 10:08:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:08:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:08:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:08:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:08:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:08:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:08:02 user nova-compute[74342]: INFO nova.compute.manager [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Took 5.65 seconds to spawn the instance on the hypervisor.
Oct 16 10:08:02 user nova-compute[74342]: DEBUG nova.compute.manager [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:08:02 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:08:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:08:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:08:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:08:02 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:08:02 user nova-compute[74342]: INFO nova.compute.manager [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Took 6.33 seconds to build instance.
Oct 16 10:08:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a38aab3a-7fb2-4e9b-8525-23f3a0be34bd tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "b547349a-1126-4700-93ca-d39e1da5c5cd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.431s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:08:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953f0937-5a7e-4629-99eb-276716802041/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:08:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953f0937-5a7e-4629-99eb-276716802041/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:08:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953f0937-5a7e-4629-99eb-276716802041/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:08:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953f0937-5a7e-4629-99eb-276716802041/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:08:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:08:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json" returned: 0 in 0.197s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:08:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:08:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:08:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:08:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:08:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:08:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:08:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:08:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:08:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:08:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:08:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:08:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:08:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:08:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:08:05 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:08:05 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:08:05 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8441MB free_disk=25.127490997314453GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:08:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:08:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:08:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "e8b580f9-a3cd-418b-8878-d86a6bb0afc5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:08:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "e8b580f9-a3cd-418b-8878-d86a6bb0afc5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:08:05 user nova-compute[74342]: DEBUG nova.compute.manager [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 10:08:05 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 34ef7d18-0724-479a-8448-981b9cf0d6ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:08:05 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7d016ab3-14c4-4c33-bd50-468f71339cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:08:05 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 953f0937-5a7e-4629-99eb-276716802041 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:08:05 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance b547349a-1126-4700-93ca-d39e1da5c5cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:08:05 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance e8b580f9-a3cd-418b-8878-d86a6bb0afc5 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Oct 16 10:08:05 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:08:05 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:08:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:08:05 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:08:05 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:08:05 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:08:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.495s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:08:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.214s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:08:05 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 10:08:05 user nova-compute[74342]: INFO nova.compute.claims [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Claim successful on node user
Oct 16 10:08:06 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:08:06 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:08:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.348s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:08:06 user nova-compute[74342]: DEBUG nova.compute.manager [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 10:08:06 user nova-compute[74342]: DEBUG nova.compute.manager [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 10:08:06 user nova-compute[74342]: DEBUG nova.network.neutron [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 10:08:06 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 10:08:06 user nova-compute[74342]: DEBUG nova.compute.manager [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 10:08:06 user nova-compute[74342]: INFO nova.virt.block_device [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Booting with volume 9bd3971e-40e0-42a8-9105-740cb01b7562 at /dev/vda
Oct 16 10:08:06 user nova-compute[74342]: DEBUG nova.policy [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2cac31e799b743359b93943b68b38acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799c265b3d14465a9ca6bd7d5e8a4488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 10:08:06 user nova-compute[74342]: DEBUG os_brick.utils [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:08:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:08:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:08:06 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea0d3e6f-df40-405a-84f7-15a5bd69f929]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:08:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:08:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:08:06 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d17f5c5-25c6-4f21-bea5-c42e2b25ae1e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:08:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:08:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:08:06 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef11d2b5-72e6-4d0f-8154-d72a311f5847]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:08:06 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48aa752-afa2-4aed-9450-b02ad65a8754]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:08:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:08:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:08:06 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 10:08:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:08:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:08:06 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 10:08:06 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0580a3cd-4878-4306-a0a7-346fa8c4e2a1]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:08:06 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 10:08:06 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 10:08:06 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 10:08:06 user nova-compute[74342]: DEBUG os_brick.utils [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:08:06 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Updating existing volume attachment record: 137aaf91-c7ca-446a-b3be-b0cea976d2f7 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 10:08:07 user nova-compute[74342]: DEBUG nova.network.neutron [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Successfully created port: 9dc948f0-294b-40da-aa4e-402a05611077 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 10:08:08 user nova-compute[74342]: DEBUG nova.network.neutron [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Successfully updated port: 9dc948f0-294b-40da-aa4e-402a05611077 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 10:08:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "refresh_cache-e8b580f9-a3cd-418b-8878-d86a6bb0afc5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:08:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquired lock "refresh_cache-e8b580f9-a3cd-418b-8878-d86a6bb0afc5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:08:08 user nova-compute[74342]: DEBUG nova.network.neutron [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:08:08 user nova-compute[74342]: DEBUG nova.compute.manager [req-1582ffb7-d91b-40f4-a855-18e4eb2ef3b7 req-ab7b9233-6b66-4267-9a43-56b8f1504449 service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Received event network-changed-9dc948f0-294b-40da-aa4e-402a05611077 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:08:08 user nova-compute[74342]: DEBUG nova.compute.manager [req-1582ffb7-d91b-40f4-a855-18e4eb2ef3b7 req-ab7b9233-6b66-4267-9a43-56b8f1504449 service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Refreshing instance network info cache due to event network-changed-9dc948f0-294b-40da-aa4e-402a05611077. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:08:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-1582ffb7-d91b-40f4-a855-18e4eb2ef3b7 req-ab7b9233-6b66-4267-9a43-56b8f1504449 service nova] Acquiring lock "refresh_cache-e8b580f9-a3cd-418b-8878-d86a6bb0afc5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:08:08 user nova-compute[74342]: DEBUG nova.network.neutron [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 10:08:08 user nova-compute[74342]: DEBUG nova.network.neutron [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Updating instance_info_cache with network_info: [{"id": "9dc948f0-294b-40da-aa4e-402a05611077", "address": "fa:16:3e:ed:3d:21", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc948f0-29", "ovs_interfaceid": "9dc948f0-294b-40da-aa4e-402a05611077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:08:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Releasing lock "refresh_cache-e8b580f9-a3cd-418b-8878-d86a6bb0afc5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:08:08 user nova-compute[74342]: DEBUG nova.compute.manager [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Instance network_info: |[{"id": "9dc948f0-294b-40da-aa4e-402a05611077", "address": "fa:16:3e:ed:3d:21", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc948f0-29", "ovs_interfaceid": "9dc948f0-294b-40da-aa4e-402a05611077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 10:08:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-1582ffb7-d91b-40f4-a855-18e4eb2ef3b7 req-ab7b9233-6b66-4267-9a43-56b8f1504449 service nova] Acquired lock "refresh_cache-e8b580f9-a3cd-418b-8878-d86a6bb0afc5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:08:08 user nova-compute[74342]: DEBUG nova.network.neutron [req-1582ffb7-d91b-40f4-a855-18e4eb2ef3b7 req-ab7b9233-6b66-4267-9a43-56b8f1504449 service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Refreshing network info cache for port 9dc948f0-294b-40da-aa4e-402a05611077 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:08:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:08 user nova-compute[74342]: DEBUG nova.network.neutron [req-1582ffb7-d91b-40f4-a855-18e4eb2ef3b7 req-ab7b9233-6b66-4267-9a43-56b8f1504449 service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Updated VIF entry in instance network info cache for port 9dc948f0-294b-40da-aa4e-402a05611077. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:08:08 user nova-compute[74342]: DEBUG nova.network.neutron [req-1582ffb7-d91b-40f4-a855-18e4eb2ef3b7 req-ab7b9233-6b66-4267-9a43-56b8f1504449 service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Updating instance_info_cache with network_info: [{"id": "9dc948f0-294b-40da-aa4e-402a05611077", "address": "fa:16:3e:ed:3d:21", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc948f0-29", "ovs_interfaceid": "9dc948f0-294b-40da-aa4e-402a05611077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:08:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-1582ffb7-d91b-40f4-a855-18e4eb2ef3b7 req-ab7b9233-6b66-4267-9a43-56b8f1504449 service nova] Releasing lock "refresh_cache-e8b580f9-a3cd-418b-8878-d86a6bb0afc5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:08:10 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:08:10 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:08:10 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:08:10 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:08:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-34ef7d18-0724-479a-8448-981b9cf0d6ab" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:08:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-34ef7d18-0724-479a-8448-981b9cf0d6ab" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:08:10 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:08:11 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Updating instance_info_cache with network_info: [{"id": "1495980a-a474-4a07-a8d1-27521ae89be7", "address": "fa:16:3e:0e:3e:44", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1495980a-a4", "ovs_interfaceid": "1495980a-a474-4a07-a8d1-27521ae89be7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:08:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-34ef7d18-0724-479a-8448-981b9cf0d6ab" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:08:11 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:08:11 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:08:11 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:08:11 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:08:13 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:08:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:14 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:08:14 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:08:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG nova.compute.manager [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 10:08:23 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Creating image(s)
Oct 16 10:08:23 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Did not create local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Ensure instance console log exists: /opt/stack/data/nova/instances/e8b580f9-a3cd-418b-8878-d86a6bb0afc5/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Start _get_guest_xml network_info=[{"id": "9dc948f0-294b-40da-aa4e-402a05611077", "address": "fa:16:3e:ed:3d:21", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc948f0-29", "ovs_interfaceid": "9dc948f0-294b-40da-aa4e-402a05611077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '137aaf91-c7ca-446a-b3be-b0cea976d2f7', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuMOrPkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e8b580f9-a3cd-418b-8878-d86a6bb0afc5', 'attached_at': '', 'detached_at': '', 'volume_id': '9bd3971e-40e0-42a8-9105-740cb01b7562', 'serial': '9bd3971e-40e0-42a8-9105-740cb01b7562'}, 'volume_type': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 10:08:23 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:08:23 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:08:23 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuMOrPkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:08:23 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:08:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:08:23 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:08:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:08:23 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a21ce95-87bc-41b3-9bc6-9d3577a9edcf]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 10:08:23 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1c3162-8bdc-497e-ba6f-6c360ce20486]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562] added
Oct 16 10:08:23 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bbd830e-eaf4-4c4d-8512-b07541158e81]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[64795dd6-f778-472c-bd59-734f8cdf6aa8]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tuMOrPkg {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tuMOrPkg" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6255d772-cdc4-4452-9678-e05e0bfbfd68]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tuMOrPkg'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e03ddb-8cc8-4d1d-9f8f-b74647ed62bd]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b1d15e-39ec-4727-a579-98dbf55ac673]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 10:08:23 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 10:08:23 user nova-compute[74342]:  {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:08:23 user nova-compute[74342]: WARNING os_brick.initiator.connectors.iscsi [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 10:08:23 user nova-compute[74342]: 
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e88f3af-70d7-4b71-a8bb-2ebddab2925c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562, portal: 172.16.0.220,3260]
Oct 16 10:08:23 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562, portal: 172.16.0.220,3260] successful.
Oct 16 10:08:23 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[273d3195-93b4-417a-b39a-cf8cb7032793]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d71ca2-a90f-4960-b4c6-88af4e1b2d37]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)
Oct 16 10:08:23 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)
Oct 16 10:08:23 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.254s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b1ce9a-a2fb-4e83-9073-6c45e475e165]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuMOrPkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 10:08:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.293s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:08:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] <== connect_volume: return (1295ms) {'type': 'block', 'scsi_wwn': '23737373762386663', 'path': '/dev/sdb'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:08:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23737373762386663', 'path': '/dev/sdb'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 10:08:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:08:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-476175103',display_name='tempest-TestVolumeBootPattern-server-476175103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-476175103',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6sJnf898pay+PIZ2/zPOefJIOtQi4Xc+rReNrpoZgM8isuwz9hj22LY0/hNzdd67mZVqTOLnmuplNPpzcrNUeli+GTP1gNufDr7TumrMEFsIIMVgfBAzUAuJrkUhM+WA==',key_name='tempest-TestVolumeBootPattern-2085750064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='799c265b3d14465a9ca6bd7d5e8a4488',ramdisk_id='',reservation_id='r-qwp399r3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-158744824',owner_user_name='tempest-TestVolumeBootPattern-158744824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:08:06Z,user_data=None,user_id='2cac31e799b743359b93943b68b38acf',uuid=e8b580f9-a3cd-418b-8878-d86a6bb0afc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9dc948f0-294b-40da-aa4e-402a05611077", "address": "fa:16:3e:ed:3d:21", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc948f0-29", "ovs_interfaceid": "9dc948f0-294b-40da-aa4e-402a05611077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 10:08:24 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converting VIF {"id": "9dc948f0-294b-40da-aa4e-402a05611077", "address": "fa:16:3e:ed:3d:21", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc948f0-29", "ovs_interfaceid": "9dc948f0-294b-40da-aa4e-402a05611077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:08:24 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:3d:21,bridge_name='br-int',has_traffic_filtering=True,id=9dc948f0-294b-40da-aa4e-402a05611077,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dc948f0-29') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:08:24 user nova-compute[74342]: DEBUG nova.objects.instance [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lazy-loading 'pci_devices' on Instance uuid e8b580f9-a3cd-418b-8878-d86a6bb0afc5 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:08:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] End _get_guest_xml xml=<domain type="kvm">
Oct 16 10:08:24 user nova-compute[74342]:   <uuid>e8b580f9-a3cd-418b-8878-d86a6bb0afc5</uuid>
Oct 16 10:08:24 user nova-compute[74342]:   <name>instance-0000002a</name>
Oct 16 10:08:24 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 10:08:24 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 10:08:24 user nova-compute[74342]:   <metadata>
Oct 16 10:08:24 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 10:08:24 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 10:08:24 user nova-compute[74342]:       <nova:name>tempest-TestVolumeBootPattern-server-476175103</nova:name>
Oct 16 10:08:24 user nova-compute[74342]:       <nova:creationTime>2023-10-16 10:08:23</nova:creationTime>
Oct 16 10:08:24 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 10:08:24 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 10:08:24 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 10:08:24 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 10:08:24 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 10:08:24 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 10:08:24 user nova-compute[74342]:       </nova:flavor>
Oct 16 10:08:24 user nova-compute[74342]:       <nova:owner>
Oct 16 10:08:24 user nova-compute[74342]:         <nova:user uuid="2cac31e799b743359b93943b68b38acf">tempest-TestVolumeBootPattern-158744824-project-member</nova:user>
Oct 16 10:08:24 user nova-compute[74342]:         <nova:project uuid="799c265b3d14465a9ca6bd7d5e8a4488">tempest-TestVolumeBootPattern-158744824</nova:project>
Oct 16 10:08:24 user nova-compute[74342]:       </nova:owner>
Oct 16 10:08:24 user nova-compute[74342]:       <nova:ports>
Oct 16 10:08:24 user nova-compute[74342]:         <nova:port uuid="9dc948f0-294b-40da-aa4e-402a05611077">
Oct 16 10:08:24 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 16 10:08:24 user nova-compute[74342]:         </nova:port>
Oct 16 10:08:24 user nova-compute[74342]:       </nova:ports>
Oct 16 10:08:24 user nova-compute[74342]:     </nova:instance>
Oct 16 10:08:24 user nova-compute[74342]:   </metadata>
Oct 16 10:08:24 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 10:08:24 user nova-compute[74342]:     <system>
Oct 16 10:08:24 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 10:08:24 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 10:08:24 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 10:08:24 user nova-compute[74342]:       <entry name="serial">e8b580f9-a3cd-418b-8878-d86a6bb0afc5</entry>
Oct 16 10:08:24 user nova-compute[74342]:       <entry name="uuid">e8b580f9-a3cd-418b-8878-d86a6bb0afc5</entry>
Oct 16 10:08:24 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 10:08:24 user nova-compute[74342]:     </system>
Oct 16 10:08:24 user nova-compute[74342]:   </sysinfo>
Oct 16 10:08:24 user nova-compute[74342]:   <os>
Oct 16 10:08:24 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 10:08:24 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 10:08:24 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 10:08:24 user nova-compute[74342]:   </os>
Oct 16 10:08:24 user nova-compute[74342]:   <features>
Oct 16 10:08:24 user nova-compute[74342]:     <acpi/>
Oct 16 10:08:24 user nova-compute[74342]:     <apic/>
Oct 16 10:08:24 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 10:08:24 user nova-compute[74342]:   </features>
Oct 16 10:08:24 user nova-compute[74342]:   <clock offset="utc">
Oct 16 10:08:24 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 10:08:24 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 10:08:24 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 10:08:24 user nova-compute[74342]:   </clock>
Oct 16 10:08:24 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 10:08:24 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 10:08:24 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 10:08:24 user nova-compute[74342]:   </cpu>
Oct 16 10:08:24 user nova-compute[74342]:   <devices>
Oct 16 10:08:24 user nova-compute[74342]:     <disk type="block" device="disk">
Oct 16 10:08:24 user nova-compute[74342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:08:24 user nova-compute[74342]:       <source dev="/dev/sdb"/>
Oct 16 10:08:24 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 10:08:24 user nova-compute[74342]:       <serial>9bd3971e-40e0-42a8-9105-740cb01b7562</serial>
Oct 16 10:08:24 user nova-compute[74342]:     </disk>
Oct 16 10:08:24 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 10:08:24 user nova-compute[74342]:       <mac address="fa:16:3e:ed:3d:21"/>
Oct 16 10:08:24 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:08:24 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 10:08:24 user nova-compute[74342]:       <target dev="tap9dc948f0-29"/>
Oct 16 10:08:24 user nova-compute[74342]:     </interface>
Oct 16 10:08:24 user nova-compute[74342]:     <serial type="pty">
Oct 16 10:08:24 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/e8b580f9-a3cd-418b-8878-d86a6bb0afc5/console.log" append="off"/>
Oct 16 10:08:24 user nova-compute[74342]:     </serial>
Oct 16 10:08:24 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 10:08:24 user nova-compute[74342]:     <video>
Oct 16 10:08:24 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:08:24 user nova-compute[74342]:     </video>
Oct 16 10:08:24 user nova-compute[74342]:     <rng model="virtio">
Oct 16 10:08:24 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 10:08:24 user nova-compute[74342]:     </rng>
Oct 16 10:08:24 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 10:08:24 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 10:08:24 user nova-compute[74342]:       <stats period="10"/>
Oct 16 10:08:24 user nova-compute[74342]:     </memballoon>
Oct 16 10:08:24 user nova-compute[74342]:   </devices>
Oct 16 10:08:24 user nova-compute[74342]: </domain>
Oct 16 10:08:24 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 10:08:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:08:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-476175103',display_name='tempest-TestVolumeBootPattern-server-476175103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-476175103',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6sJnf898pay+PIZ2/zPOefJIOtQi4Xc+rReNrpoZgM8isuwz9hj22LY0/hNzdd67mZVqTOLnmuplNPpzcrNUeli+GTP1gNufDr7TumrMEFsIIMVgfBAzUAuJrkUhM+WA==',key_name='tempest-TestVolumeBootPattern-2085750064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='799c265b3d14465a9ca6bd7d5e8a4488',ramdisk_id='',reservation_id='r-qwp399r3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-158744824',owner_user_name='tempest-TestVolumeBootPattern-158744824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:08:06Z,user_data=None,user_id='2cac31e799b743359b93943b68b38acf',uuid=e8b580f9-a3cd-418b-8878-d86a6bb0afc5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9dc948f0-294b-40da-aa4e-402a05611077", "address": "fa:16:3e:ed:3d:21", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc948f0-29", "ovs_interfaceid": "9dc948f0-294b-40da-aa4e-402a05611077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 10:08:24 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converting VIF {"id": "9dc948f0-294b-40da-aa4e-402a05611077", "address": "fa:16:3e:ed:3d:21", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc948f0-29", "ovs_interfaceid": "9dc948f0-294b-40da-aa4e-402a05611077", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:08:24 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:3d:21,bridge_name='br-int',has_traffic_filtering=True,id=9dc948f0-294b-40da-aa4e-402a05611077,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dc948f0-29') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:08:24 user nova-compute[74342]: DEBUG os_vif [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:3d:21,bridge_name='br-int',has_traffic_filtering=True,id=9dc948f0-294b-40da-aa4e-402a05611077,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dc948f0-29') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 10:08:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:08:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 10:08:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a8d13c4c-c181-58ca-8fb4-0152f094dda2', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:08:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:08:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9dc948f0-29, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:08:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9dc948f0-29, col_values=(('qos', UUID('9d9c26c0-86c7-41fc-8ef0-1ea9462c6bce')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:08:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9dc948f0-29, col_values=(('external_ids', {'iface-id': '9dc948f0-294b-40da-aa4e-402a05611077', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:3d:21', 'vm-uuid': 'e8b580f9-a3cd-418b-8878-d86a6bb0afc5'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:08:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:08:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:24 user nova-compute[74342]: INFO os_vif [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:3d:21,bridge_name='br-int',has_traffic_filtering=True,id=9dc948f0-294b-40da-aa4e-402a05611077,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dc948f0-29')
Oct 16 10:08:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:08:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] No VIF found with MAC fa:16:3e:ed:3d:21, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:08:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:26 user nova-compute[74342]: DEBUG nova.compute.manager [req-8fdfa938-4b13-4f4a-88fd-a72285905a22 req-43938d90-43b3-4c9e-957e-f4fc33fba856 service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Received event network-vif-plugged-9dc948f0-294b-40da-aa4e-402a05611077 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:08:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8fdfa938-4b13-4f4a-88fd-a72285905a22 req-43938d90-43b3-4c9e-957e-f4fc33fba856 service nova] Acquiring lock "e8b580f9-a3cd-418b-8878-d86a6bb0afc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:08:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8fdfa938-4b13-4f4a-88fd-a72285905a22 req-43938d90-43b3-4c9e-957e-f4fc33fba856 service nova] Lock "e8b580f9-a3cd-418b-8878-d86a6bb0afc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:08:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-8fdfa938-4b13-4f4a-88fd-a72285905a22 req-43938d90-43b3-4c9e-957e-f4fc33fba856 service nova] Lock "e8b580f9-a3cd-418b-8878-d86a6bb0afc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:08:26 user nova-compute[74342]: DEBUG nova.compute.manager [req-8fdfa938-4b13-4f4a-88fd-a72285905a22 req-43938d90-43b3-4c9e-957e-f4fc33fba856 service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] No waiting events found dispatching network-vif-plugged-9dc948f0-294b-40da-aa4e-402a05611077 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:08:26 user nova-compute[74342]: WARNING nova.compute.manager [req-8fdfa938-4b13-4f4a-88fd-a72285905a22 req-43938d90-43b3-4c9e-957e-f4fc33fba856 service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Received unexpected event network-vif-plugged-9dc948f0-294b-40da-aa4e-402a05611077 for instance with vm_state building and task_state spawning.
Oct 16 10:08:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:28 user nova-compute[74342]: DEBUG nova.compute.manager [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 10:08:28 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 10:08:28 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Instance spawned successfully.
Oct 16 10:08:28 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 10:08:28 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:08:28 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:08:28 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:08:28 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:08:28 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:08:28 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:08:28 user nova-compute[74342]: DEBUG nova.compute.manager [req-921feacc-ff73-46fa-a4bb-55555ac8b00a req-1a4456c2-5134-4161-9f96-ca377b073d5d service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Received event network-vif-plugged-9dc948f0-294b-40da-aa4e-402a05611077 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:08:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-921feacc-ff73-46fa-a4bb-55555ac8b00a req-1a4456c2-5134-4161-9f96-ca377b073d5d service nova] Acquiring lock "e8b580f9-a3cd-418b-8878-d86a6bb0afc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:08:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-921feacc-ff73-46fa-a4bb-55555ac8b00a req-1a4456c2-5134-4161-9f96-ca377b073d5d service nova] Lock "e8b580f9-a3cd-418b-8878-d86a6bb0afc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:08:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-921feacc-ff73-46fa-a4bb-55555ac8b00a req-1a4456c2-5134-4161-9f96-ca377b073d5d service nova] Lock "e8b580f9-a3cd-418b-8878-d86a6bb0afc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:08:28 user nova-compute[74342]: DEBUG nova.compute.manager [req-921feacc-ff73-46fa-a4bb-55555ac8b00a req-1a4456c2-5134-4161-9f96-ca377b073d5d service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] No waiting events found dispatching network-vif-plugged-9dc948f0-294b-40da-aa4e-402a05611077 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:08:28 user nova-compute[74342]: WARNING nova.compute.manager [req-921feacc-ff73-46fa-a4bb-55555ac8b00a req-1a4456c2-5134-4161-9f96-ca377b073d5d service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Received unexpected event network-vif-plugged-9dc948f0-294b-40da-aa4e-402a05611077 for instance with vm_state building and task_state spawning.
Oct 16 10:08:28 user nova-compute[74342]: INFO nova.compute.manager [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Took 5.15 seconds to spawn the instance on the hypervisor.
Oct 16 10:08:28 user nova-compute[74342]: DEBUG nova.compute.manager [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:08:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:28 user nova-compute[74342]: INFO nova.compute.manager [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Took 22.88 seconds to build instance.
Oct 16 10:08:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6774a60d-2f9e-477f-b4f9-2b6167d30421 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "e8b580f9-a3cd-418b-8878-d86a6bb0afc5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 23.026s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:08:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:08:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:54 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:55 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:08:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:09:02 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:09:04 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:09:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:09:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:09:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:09:04 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:09:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953f0937-5a7e-4629-99eb-276716802041/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:09:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:09:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953f0937-5a7e-4629-99eb-276716802041/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:09:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953f0937-5a7e-4629-99eb-276716802041/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:09:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/953f0937-5a7e-4629-99eb-276716802041/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:09:04 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:09:05 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:09:05 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:09:05 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:09:05 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 10:09:05 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:09:05 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:09:05 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:09:05 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:09:05 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:09:05 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:09:05 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:09:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:09:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:09:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:09:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:09:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:09:06 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:09:06 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:09:06 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8358MB free_disk=25.08612060546875GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:09:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:09:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:09:06 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 34ef7d18-0724-479a-8448-981b9cf0d6ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:09:06 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7d016ab3-14c4-4c33-bd50-468f71339cd7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:09:06 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 953f0937-5a7e-4629-99eb-276716802041 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:09:06 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance b547349a-1126-4700-93ca-d39e1da5c5cd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:09:06 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance e8b580f9-a3cd-418b-8878-d86a6bb0afc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:09:06 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:09:06 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:09:07 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:09:07 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:09:07 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:09:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.315s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:09:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:09:10 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:09:10 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:09:12 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:09:12 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:09:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-7d016ab3-14c4-4c33-bd50-468f71339cd7" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:09:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-7d016ab3-14c4-4c33-bd50-468f71339cd7" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:09:12 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:09:13 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Updating instance_info_cache with network_info: [{"id": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "address": "fa:16:3e:de:cb:e3", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74fa1b3-86", "ovs_interfaceid": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:09:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-7d016ab3-14c4-4c33-bd50-468f71339cd7" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:09:13 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:09:13 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:09:13 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:09:13 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:09:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:09:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:09:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:09:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:09:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:09:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:09:15 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:09:15 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:09:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:09:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:09:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:09:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:09:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:09:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:09:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:09:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:09:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ed15fe5e-6f6a-407c-bd19-362adc13b1da tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Acquiring lock "953f0937-5a7e-4629-99eb-276716802041" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:09:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ed15fe5e-6f6a-407c-bd19-362adc13b1da tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "953f0937-5a7e-4629-99eb-276716802041" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:09:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ed15fe5e-6f6a-407c-bd19-362adc13b1da tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Acquiring lock "953f0937-5a7e-4629-99eb-276716802041-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:09:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ed15fe5e-6f6a-407c-bd19-362adc13b1da tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "953f0937-5a7e-4629-99eb-276716802041-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:09:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ed15fe5e-6f6a-407c-bd19-362adc13b1da tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "953f0937-5a7e-4629-99eb-276716802041-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:09:30 user nova-compute[74342]: INFO nova.compute.manager [None req-ed15fe5e-6f6a-407c-bd19-362adc13b1da tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Terminating instance
Oct 16 10:09:30 user nova-compute[74342]: DEBUG nova.compute.manager [None req-ed15fe5e-6f6a-407c-bd19-362adc13b1da tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 10:09:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:09:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:09:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:09:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:09:30 user nova-compute[74342]: DEBUG nova.compute.manager [req-282d27b0-b91f-46e6-991a-e74d5908f3e0 req-1fe72de5-99d4-4556-9ad6-e4b5406cb60e service nova] [instance: 953f0937-5a7e-4629-99eb-276716802041] Received event network-vif-unplugged-489066fb-94a0-4965-8fa8-3227a1a233ad {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:09:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-282d27b0-b91f-46e6-991a-e74d5908f3e0 req-1fe72de5-99d4-4556-9ad6-e4b5406cb60e service nova] Acquiring lock "953f0937-5a7e-4629-99eb-276716802041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:09:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-282d27b0-b91f-46e6-991a-e74d5908f3e0 req-1fe72de5-99d4-4556-9ad6-e4b5406cb60e service nova] Lock "953f0937-5a7e-4629-99eb-276716802041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:09:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-282d27b0-b91f-46e6-991a-e74d5908f3e0 req-1fe72de5-99d4-4556-9ad6-e4b5406cb60e service nova] Lock "953f0937-5a7e-4629-99eb-276716802041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:09:30 user nova-compute[74342]: DEBUG nova.compute.manager [req-282d27b0-b91f-46e6-991a-e74d5908f3e0 req-1fe72de5-99d4-4556-9ad6-e4b5406cb60e service nova] [instance: 953f0937-5a7e-4629-99eb-276716802041] No waiting events found dispatching network-vif-unplugged-489066fb-94a0-4965-8fa8-3227a1a233ad {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:09:30 user nova-compute[74342]: DEBUG nova.compute.manager [req-282d27b0-b91f-46e6-991a-e74d5908f3e0 req-1fe72de5-99d4-4556-9ad6-e4b5406cb60e service nova] [instance: 953f0937-5a7e-4629-99eb-276716802041] Received event network-vif-unplugged-489066fb-94a0-4965-8fa8-3227a1a233ad for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 10:09:31 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 953f0937-5a7e-4629-99eb-276716802041] Instance destroyed successfully.
Oct 16 10:09:31 user nova-compute[74342]: DEBUG nova.objects.instance [None req-ed15fe5e-6f6a-407c-bd19-362adc13b1da tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lazy-loading 'resources' on Instance uuid 953f0937-5a7e-4629-99eb-276716802041 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:09:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-ed15fe5e-6f6a-407c-bd19-362adc13b1da tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:07:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-272487994',display_name='tempest-VolumesActionsTest-instance-272487994',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-272487994',id=40,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T10:07:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c3f6c4540e0746f9939a26d4cc4be7ab',ramdisk_id='',reservation_id='r-gg45inph',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-188382855',owner_user_name='tempest-VolumesActionsTest-188382855-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T10:07:46Z,user_data=None,user_id='a9e5d4c21de14697a7fad1c6264869f8',uuid=953f0937-5a7e-4629-99eb-276716802041,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "489066fb-94a0-4965-8fa8-3227a1a233ad", "address": "fa:16:3e:4c:be:77", "network": {"id": "694e4583-ab39-4b9d-b166-c025853d10a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1799473053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f6c4540e0746f9939a26d4cc4be7ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap489066fb-94", "ovs_interfaceid": "489066fb-94a0-4965-8fa8-3227a1a233ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 10:09:31 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-ed15fe5e-6f6a-407c-bd19-362adc13b1da tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Converting VIF {"id": "489066fb-94a0-4965-8fa8-3227a1a233ad", "address": "fa:16:3e:4c:be:77", "network": {"id": "694e4583-ab39-4b9d-b166-c025853d10a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1799473053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f6c4540e0746f9939a26d4cc4be7ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap489066fb-94", "ovs_interfaceid": "489066fb-94a0-4965-8fa8-3227a1a233ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:09:31 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-ed15fe5e-6f6a-407c-bd19-362adc13b1da tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:be:77,bridge_name='br-int',has_traffic_filtering=True,id=489066fb-94a0-4965-8fa8-3227a1a233ad,network=Network(694e4583-ab39-4b9d-b166-c025853d10a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap489066fb-94') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:09:31 user nova-compute[74342]: DEBUG os_vif [None req-ed15fe5e-6f6a-407c-bd19-362adc13b1da tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:be:77,bridge_name='br-int',has_traffic_filtering=True,id=489066fb-94a0-4965-8fa8-3227a1a233ad,network=Network(694e4583-ab39-4b9d-b166-c025853d10a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap489066fb-94') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 10:09:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:09:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap489066fb-94, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:09:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:09:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:09:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:09:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=662fa96a-2dda-4420-bae1-3b3eac10817f) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:09:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:09:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:09:31 user nova-compute[74342]: INFO os_vif [None req-ed15fe5e-6f6a-407c-bd19-362adc13b1da tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:be:77,bridge_name='br-int',has_traffic_filtering=True,id=489066fb-94a0-4965-8fa8-3227a1a233ad,network=Network(694e4583-ab39-4b9d-b166-c025853d10a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap489066fb-94')
Oct 16 10:09:31 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-ed15fe5e-6f6a-407c-bd19-362adc13b1da tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Deleting instance files /opt/stack/data/nova/instances/953f0937-5a7e-4629-99eb-276716802041_del
Oct 16 10:09:31 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-ed15fe5e-6f6a-407c-bd19-362adc13b1da tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Deletion of /opt/stack/data/nova/instances/953f0937-5a7e-4629-99eb-276716802041_del complete
Oct 16 10:09:31 user nova-compute[74342]: INFO nova.compute.manager [None req-ed15fe5e-6f6a-407c-bd19-362adc13b1da tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 953f0937-5a7e-4629-99eb-276716802041] Took 0.97 seconds to destroy the instance on the hypervisor.
Oct 16 10:09:31 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-ed15fe5e-6f6a-407c-bd19-362adc13b1da tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 10:09:31 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: 953f0937-5a7e-4629-99eb-276716802041] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 10:09:31 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 953f0937-5a7e-4629-99eb-276716802041] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 10:09:31 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 953f0937-5a7e-4629-99eb-276716802041] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:09:31 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: 953f0937-5a7e-4629-99eb-276716802041] Took 0.70 seconds to deallocate network for instance.
Oct 16 10:09:31 user nova-compute[74342]: DEBUG nova.compute.manager [req-3034c021-d182-475d-916d-0eb6b1f3d34a req-44699303-ba92-4d6e-8991-847cd0e537f7 service nova] [instance: 953f0937-5a7e-4629-99eb-276716802041] Received event network-vif-deleted-489066fb-94a0-4965-8fa8-3227a1a233ad {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:09:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ed15fe5e-6f6a-407c-bd19-362adc13b1da tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:09:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ed15fe5e-6f6a-407c-bd19-362adc13b1da tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:09:32 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-ed15fe5e-6f6a-407c-bd19-362adc13b1da tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:09:32 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-ed15fe5e-6f6a-407c-bd19-362adc13b1da tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:09:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ed15fe5e-6f6a-407c-bd19-362adc13b1da tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:09:32 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-ed15fe5e-6f6a-407c-bd19-362adc13b1da tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Deleted allocations for instance 953f0937-5a7e-4629-99eb-276716802041
Oct 16 10:09:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-ed15fe5e-6f6a-407c-bd19-362adc13b1da tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "953f0937-5a7e-4629-99eb-276716802041" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.087s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:09:32 user nova-compute[74342]: DEBUG nova.compute.manager [req-e2818ab4-5e14-4a6d-9061-1d7663ad05bf req-40dc3542-17e8-47c3-9ecc-7bb84731df82 service nova] [instance: 953f0937-5a7e-4629-99eb-276716802041] Received event network-vif-plugged-489066fb-94a0-4965-8fa8-3227a1a233ad {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:09:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e2818ab4-5e14-4a6d-9061-1d7663ad05bf req-40dc3542-17e8-47c3-9ecc-7bb84731df82 service nova] Acquiring lock "953f0937-5a7e-4629-99eb-276716802041-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:09:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e2818ab4-5e14-4a6d-9061-1d7663ad05bf req-40dc3542-17e8-47c3-9ecc-7bb84731df82 service nova] Lock "953f0937-5a7e-4629-99eb-276716802041-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:09:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e2818ab4-5e14-4a6d-9061-1d7663ad05bf req-40dc3542-17e8-47c3-9ecc-7bb84731df82 service nova] Lock "953f0937-5a7e-4629-99eb-276716802041-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:09:32 user nova-compute[74342]: DEBUG nova.compute.manager [req-e2818ab4-5e14-4a6d-9061-1d7663ad05bf req-40dc3542-17e8-47c3-9ecc-7bb84731df82 service nova] [instance: 953f0937-5a7e-4629-99eb-276716802041] No waiting events found dispatching network-vif-plugged-489066fb-94a0-4965-8fa8-3227a1a233ad {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:09:32 user nova-compute[74342]: WARNING nova.compute.manager [req-e2818ab4-5e14-4a6d-9061-1d7663ad05bf req-40dc3542-17e8-47c3-9ecc-7bb84731df82 service nova] [instance: 953f0937-5a7e-4629-99eb-276716802041] Received unexpected event network-vif-plugged-489066fb-94a0-4965-8fa8-3227a1a233ad for instance with vm_state deleted and task_state None.
Oct 16 10:09:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:09:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:09:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:09:47 user nova-compute[74342]: DEBUG nova.compute.manager [req-867ceb05-958a-41b1-85be-d2af6d7a35be req-0367931e-d6c2-4da4-b37e-998bbb660b99 service nova] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Received event network-changed-841bff3b-23d1-4225-af17-45709c874a35 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:09:47 user nova-compute[74342]: DEBUG nova.compute.manager [req-867ceb05-958a-41b1-85be-d2af6d7a35be req-0367931e-d6c2-4da4-b37e-998bbb660b99 service nova] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Refreshing instance network info cache due to event network-changed-841bff3b-23d1-4225-af17-45709c874a35. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:09:47 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-867ceb05-958a-41b1-85be-d2af6d7a35be req-0367931e-d6c2-4da4-b37e-998bbb660b99 service nova] Acquiring lock "refresh_cache-b547349a-1126-4700-93ca-d39e1da5c5cd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:09:47 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-867ceb05-958a-41b1-85be-d2af6d7a35be req-0367931e-d6c2-4da4-b37e-998bbb660b99 service nova] Acquired lock "refresh_cache-b547349a-1126-4700-93ca-d39e1da5c5cd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:09:47 user nova-compute[74342]: DEBUG nova.network.neutron [req-867ceb05-958a-41b1-85be-d2af6d7a35be req-0367931e-d6c2-4da4-b37e-998bbb660b99 service nova] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Refreshing network info cache for port 841bff3b-23d1-4225-af17-45709c874a35 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:09:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "b547349a-1126-4700-93ca-d39e1da5c5cd" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:09:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "b547349a-1126-4700-93ca-d39e1da5c5cd" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:09:48 user nova-compute[74342]: DEBUG nova.objects.instance [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lazy-loading 'flavor' on Instance uuid b547349a-1126-4700-93ca-d39e1da5c5cd {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:09:48 user nova-compute[74342]: DEBUG nova.network.neutron [req-867ceb05-958a-41b1-85be-d2af6d7a35be req-0367931e-d6c2-4da4-b37e-998bbb660b99 service nova] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Updated VIF entry in instance network info cache for port 841bff3b-23d1-4225-af17-45709c874a35. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:09:48 user nova-compute[74342]: DEBUG nova.network.neutron [req-867ceb05-958a-41b1-85be-d2af6d7a35be req-0367931e-d6c2-4da4-b37e-998bbb660b99 service nova] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Updating instance_info_cache with network_info: [{"id": "841bff3b-23d1-4225-af17-45709c874a35", "address": "fa:16:3e:8f:4b:dc", "network": {"id": "ca9b5a27-87ee-46f0-a771-1ba5925e04de", "bridge": "br-int", "label": "tempest-TestStampPattern-847672181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f185c7dee6c4e7f8fe0d7bb2e89e854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841bff3b-23", "ovs_interfaceid": "841bff3b-23d1-4225-af17-45709c874a35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:09:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-867ceb05-958a-41b1-85be-d2af6d7a35be req-0367931e-d6c2-4da4-b37e-998bbb660b99 service nova] Releasing lock "refresh_cache-b547349a-1126-4700-93ca-d39e1da5c5cd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:09:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "b547349a-1126-4700-93ca-d39e1da5c5cd" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:09:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:09:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "b547349a-1126-4700-93ca-d39e1da5c5cd" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:09:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "b547349a-1126-4700-93ca-d39e1da5c5cd" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:09:48 user nova-compute[74342]: INFO nova.compute.manager [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Attaching volume 1b013279-5cad-45f6-9990-d1ba46f84b8c to /dev/vdb
Oct 16 10:09:48 user nova-compute[74342]: DEBUG os_brick.utils [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:09:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:09:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:09:48 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfda3203-52ae-4827-926e-cb2e4f2d5a17]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:09:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:09:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:09:48 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e19452c-e5b2-4b2d-b06a-f8080c2df9d1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:09:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:09:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:09:48 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[023aa911-680f-4f21-a5c1-63b49406d915]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:09:48 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5ae801-1cd0-4d3a-85be-57dfb8dca118]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:09:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:09:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:09:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 10:09:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:09:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:09:48 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 10:09:48 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cf85c5f-6382-4b84-8407-97776354505e]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:09:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 10:09:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 10:09:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 10:09:48 user nova-compute[74342]: DEBUG os_brick.utils [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:09:48 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Updating existing volume attachment record: dcdb9fa7-92fe-4667-81a2-b9aa0b7c4ee3 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 10:09:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:09:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:09:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:09:56 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:09:57 user nova-compute[74342]: DEBUG nova.compute.manager [req-2c75591d-6b9d-4de1-8ec4-08a04acf57a7 req-ee801675-9be9-4fbf-8c92-45149f39682e service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Received event network-changed-9dc948f0-294b-40da-aa4e-402a05611077 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:09:57 user nova-compute[74342]: DEBUG nova.compute.manager [req-2c75591d-6b9d-4de1-8ec4-08a04acf57a7 req-ee801675-9be9-4fbf-8c92-45149f39682e service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Refreshing instance network info cache due to event network-changed-9dc948f0-294b-40da-aa4e-402a05611077. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:09:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-2c75591d-6b9d-4de1-8ec4-08a04acf57a7 req-ee801675-9be9-4fbf-8c92-45149f39682e service nova] Acquiring lock "refresh_cache-e8b580f9-a3cd-418b-8878-d86a6bb0afc5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:09:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-2c75591d-6b9d-4de1-8ec4-08a04acf57a7 req-ee801675-9be9-4fbf-8c92-45149f39682e service nova] Acquired lock "refresh_cache-e8b580f9-a3cd-418b-8878-d86a6bb0afc5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:09:57 user nova-compute[74342]: DEBUG nova.network.neutron [req-2c75591d-6b9d-4de1-8ec4-08a04acf57a7 req-ee801675-9be9-4fbf-8c92-45149f39682e service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Refreshing network info cache for port 9dc948f0-294b-40da-aa4e-402a05611077 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:09:57 user nova-compute[74342]: DEBUG nova.network.neutron [req-2c75591d-6b9d-4de1-8ec4-08a04acf57a7 req-ee801675-9be9-4fbf-8c92-45149f39682e service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Updated VIF entry in instance network info cache for port 9dc948f0-294b-40da-aa4e-402a05611077. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:09:57 user nova-compute[74342]: DEBUG nova.network.neutron [req-2c75591d-6b9d-4de1-8ec4-08a04acf57a7 req-ee801675-9be9-4fbf-8c92-45149f39682e service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Updating instance_info_cache with network_info: [{"id": "9dc948f0-294b-40da-aa4e-402a05611077", "address": "fa:16:3e:ed:3d:21", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc948f0-29", "ovs_interfaceid": "9dc948f0-294b-40da-aa4e-402a05611077", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:09:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-2c75591d-6b9d-4de1-8ec4-08a04acf57a7 req-ee801675-9be9-4fbf-8c92-45149f39682e service nova] Releasing lock "refresh_cache-e8b580f9-a3cd-418b-8878-d86a6bb0afc5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:09:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:03 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:10:03 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:10:03 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Cleaning up deleted instances {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 10:10:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:03 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] There are 1 instances to clean {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 10:10:03 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Instance has had 4 of 5 cleanup attempts {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 16 10:10:03 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Deletion of /opt/stack/data/nova/instances/c5e44d3b-ed41-4920-825f-e1d283caecfd_resize failed
Oct 16 10:10:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:06 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:10:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:10:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:10:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:10:06 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:10:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 10:10:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json" returned: 0 in 0.257s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:07 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:08 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:10:08 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:10:08 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8546MB free_disk=25.11104965209961GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:10:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:10:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:10:08 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 34ef7d18-0724-479a-8448-981b9cf0d6ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:10:08 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7d016ab3-14c4-4c33-bd50-468f71339cd7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:10:08 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance b547349a-1126-4700-93ca-d39e1da5c5cd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:10:08 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance e8b580f9-a3cd-418b-8878-d86a6bb0afc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:10:08 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:10:08 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:10:09 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:10:09 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:10:09 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:10:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.301s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:10:10 user nova-compute[74342]: INFO nova.compute.manager [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Rescuing
Oct 16 10:10:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "refresh_cache-34ef7d18-0724-479a-8448-981b9cf0d6ab" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:10:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquired lock "refresh_cache-34ef7d18-0724-479a-8448-981b9cf0d6ab" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:10:10 user nova-compute[74342]: DEBUG nova.network.neutron [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:10:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:11 user nova-compute[74342]: DEBUG nova.network.neutron [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Updating instance_info_cache with network_info: [{"id": "1495980a-a474-4a07-a8d1-27521ae89be7", "address": "fa:16:3e:0e:3e:44", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1495980a-a4", "ovs_interfaceid": "1495980a-a474-4a07-a8d1-27521ae89be7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:10:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Releasing lock "refresh_cache-34ef7d18-0724-479a-8448-981b9cf0d6ab" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:10:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:11 user nova-compute[74342]: DEBUG nova.compute.manager [req-0d446191-c6b5-4ed8-b521-b5cf977728d9 req-f83f5fc6-d259-4b4b-bcb8-5e4848ad7360 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Received event network-vif-unplugged-1495980a-a474-4a07-a8d1-27521ae89be7 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:10:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0d446191-c6b5-4ed8-b521-b5cf977728d9 req-f83f5fc6-d259-4b4b-bcb8-5e4848ad7360 service nova] Acquiring lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:10:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0d446191-c6b5-4ed8-b521-b5cf977728d9 req-f83f5fc6-d259-4b4b-bcb8-5e4848ad7360 service nova] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:10:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0d446191-c6b5-4ed8-b521-b5cf977728d9 req-f83f5fc6-d259-4b4b-bcb8-5e4848ad7360 service nova] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:10:11 user nova-compute[74342]: DEBUG nova.compute.manager [req-0d446191-c6b5-4ed8-b521-b5cf977728d9 req-f83f5fc6-d259-4b4b-bcb8-5e4848ad7360 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] No waiting events found dispatching network-vif-unplugged-1495980a-a474-4a07-a8d1-27521ae89be7 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:10:11 user nova-compute[74342]: WARNING nova.compute.manager [req-0d446191-c6b5-4ed8-b521-b5cf977728d9 req-f83f5fc6-d259-4b4b-bcb8-5e4848ad7360 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Received unexpected event network-vif-unplugged-1495980a-a474-4a07-a8d1-27521ae89be7 for instance with vm_state active and task_state rescuing.
Oct 16 10:10:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:11 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:10:11 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:10:12 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Instance destroyed successfully.
Oct 16 10:10:12 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Attempting rescue
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74342) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Instance directory exists: not creating {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 16 10:10:12 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Creating image(s)
Oct 16 10:10:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "/opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "/opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "/opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.objects.instance [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lazy-loading 'trusted_certs' on Instance uuid 34ef7d18-0724-479a-8448-981b9cf0d6ab {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.199s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk.rescue {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk.rescue" returned: 0 in 0.045s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.objects.instance [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lazy-loading 'migration_context' on Instance uuid 34ef7d18-0724-479a-8448-981b9cf0d6ab {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.objects.base [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Object Instance<34ef7d18-0724-479a-8448-981b9cf0d6ab> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Start _get_guest_xml network_info=[{"id": "1495980a-a474-4a07-a8d1-27521ae89be7", "address": "fa:16:3e:0e:3e:44", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "vif_mac": "fa:16:3e:0e:3e:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1495980a-a4", "ovs_interfaceid": "1495980a-a474-4a07-a8d1-27521ae89be7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.objects.instance [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lazy-loading 'resources' on Instance uuid 34ef7d18-0724-479a-8448-981b9cf0d6ab {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.objects.base [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Object Instance<34ef7d18-0724-479a-8448-981b9cf0d6ab> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.objects.instance [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lazy-loading 'numa_topology' on Instance uuid 34ef7d18-0724-479a-8448-981b9cf0d6ab {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.objects.base [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Object Instance<34ef7d18-0724-479a-8448-981b9cf0d6ab> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:10:12 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:10:12 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.objects.instance [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lazy-loading 'vcpu_model' on Instance uuid 34ef7d18-0724-479a-8448-981b9cf0d6ab {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.objects.base [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Object Instance<34ef7d18-0724-479a-8448-981b9cf0d6ab> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:05:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2002535416',display_name='tempest-ServerRescueNegativeTestJSON-server-2002535416',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2002535416',id=38,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T10:05:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2453f549532c465da8952474a5218357',ramdisk_id='',reservation_id='r-taj2n86i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1027819060',owner_user_name='tempest-ServerRescueNegativeTestJSON-1027819060-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:05:32Z,user_data=None,user_id='2ca9ac24fcad4d9fbf8cb2fd7ec6a3f0',uuid=34ef7d18-0724-479a-8448-981b9cf0d6ab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1495980a-a474-4a07-a8d1-27521ae89be7", "address": "fa:16:3e:0e:3e:44", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "vif_mac": "fa:16:3e:0e:3e:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1495980a-a4", "ovs_interfaceid": "1495980a-a474-4a07-a8d1-27521ae89be7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Converting VIF {"id": "1495980a-a474-4a07-a8d1-27521ae89be7", "address": "fa:16:3e:0e:3e:44", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "vif_mac": "fa:16:3e:0e:3e:44"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1495980a-a4", "ovs_interfaceid": "1495980a-a474-4a07-a8d1-27521ae89be7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:3e:44,bridge_name='br-int',has_traffic_filtering=True,id=1495980a-a474-4a07-a8d1-27521ae89be7,network=Network(c8edc360-319a-4e77-8af6-5b8e7a87ae82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1495980a-a4') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.objects.instance [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lazy-loading 'pci_devices' on Instance uuid 34ef7d18-0724-479a-8448-981b9cf0d6ab {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.objects.base [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Object Instance<34ef7d18-0724-479a-8448-981b9cf0d6ab> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] End _get_guest_xml xml=<domain type="kvm">
Oct 16 10:10:12 user nova-compute[74342]:   <uuid>34ef7d18-0724-479a-8448-981b9cf0d6ab</uuid>
Oct 16 10:10:12 user nova-compute[74342]:   <name>instance-00000026</name>
Oct 16 10:10:12 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 10:10:12 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 10:10:12 user nova-compute[74342]:   <metadata>
Oct 16 10:10:12 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 10:10:12 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 10:10:12 user nova-compute[74342]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2002535416</nova:name>
Oct 16 10:10:12 user nova-compute[74342]:       <nova:creationTime>2023-10-16 10:10:12</nova:creationTime>
Oct 16 10:10:12 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 10:10:12 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 10:10:12 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 10:10:12 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 10:10:12 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 10:10:12 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 10:10:12 user nova-compute[74342]:       </nova:flavor>
Oct 16 10:10:12 user nova-compute[74342]:       <nova:owner>
Oct 16 10:10:12 user nova-compute[74342]:         <nova:user uuid="2ca9ac24fcad4d9fbf8cb2fd7ec6a3f0">tempest-ServerRescueNegativeTestJSON-1027819060-project-member</nova:user>
Oct 16 10:10:12 user nova-compute[74342]:         <nova:project uuid="2453f549532c465da8952474a5218357">tempest-ServerRescueNegativeTestJSON-1027819060</nova:project>
Oct 16 10:10:12 user nova-compute[74342]:       </nova:owner>
Oct 16 10:10:12 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 10:10:12 user nova-compute[74342]:       <nova:ports>
Oct 16 10:10:12 user nova-compute[74342]:         <nova:port uuid="1495980a-a474-4a07-a8d1-27521ae89be7">
Oct 16 10:10:12 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Oct 16 10:10:12 user nova-compute[74342]:         </nova:port>
Oct 16 10:10:12 user nova-compute[74342]:       </nova:ports>
Oct 16 10:10:12 user nova-compute[74342]:     </nova:instance>
Oct 16 10:10:12 user nova-compute[74342]:   </metadata>
Oct 16 10:10:12 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 10:10:12 user nova-compute[74342]:     <system>
Oct 16 10:10:12 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 10:10:12 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 10:10:12 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 10:10:12 user nova-compute[74342]:       <entry name="serial">34ef7d18-0724-479a-8448-981b9cf0d6ab</entry>
Oct 16 10:10:12 user nova-compute[74342]:       <entry name="uuid">34ef7d18-0724-479a-8448-981b9cf0d6ab</entry>
Oct 16 10:10:12 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 10:10:12 user nova-compute[74342]:     </system>
Oct 16 10:10:12 user nova-compute[74342]:   </sysinfo>
Oct 16 10:10:12 user nova-compute[74342]:   <os>
Oct 16 10:10:12 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 10:10:12 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 10:10:12 user nova-compute[74342]:   </os>
Oct 16 10:10:12 user nova-compute[74342]:   <features>
Oct 16 10:10:12 user nova-compute[74342]:     <acpi/>
Oct 16 10:10:12 user nova-compute[74342]:     <apic/>
Oct 16 10:10:12 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 10:10:12 user nova-compute[74342]:   </features>
Oct 16 10:10:12 user nova-compute[74342]:   <clock offset="utc">
Oct 16 10:10:12 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 10:10:12 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 10:10:12 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 10:10:12 user nova-compute[74342]:   </clock>
Oct 16 10:10:12 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 10:10:12 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 10:10:12 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 10:10:12 user nova-compute[74342]:   </cpu>
Oct 16 10:10:12 user nova-compute[74342]:   <devices>
Oct 16 10:10:12 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 10:10:12 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 10:10:12 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk.rescue"/>
Oct 16 10:10:12 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 10:10:12 user nova-compute[74342]:     </disk>
Oct 16 10:10:12 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 10:10:12 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 10:10:12 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk"/>
Oct 16 10:10:12 user nova-compute[74342]:       <target dev="vdb" bus="virtio"/>
Oct 16 10:10:12 user nova-compute[74342]:     </disk>
Oct 16 10:10:12 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 10:10:12 user nova-compute[74342]:       <mac address="fa:16:3e:0e:3e:44"/>
Oct 16 10:10:12 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:10:12 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 10:10:12 user nova-compute[74342]:       <target dev="tap1495980a-a4"/>
Oct 16 10:10:12 user nova-compute[74342]:     </interface>
Oct 16 10:10:12 user nova-compute[74342]:     <serial type="pty">
Oct 16 10:10:12 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/console.log" append="off"/>
Oct 16 10:10:12 user nova-compute[74342]:     </serial>
Oct 16 10:10:12 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 10:10:12 user nova-compute[74342]:     <video>
Oct 16 10:10:12 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:10:12 user nova-compute[74342]:     </video>
Oct 16 10:10:12 user nova-compute[74342]:     <rng model="virtio">
Oct 16 10:10:12 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 10:10:12 user nova-compute[74342]:     </rng>
Oct 16 10:10:12 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 10:10:12 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 10:10:12 user nova-compute[74342]:       <stats period="10"/>
Oct 16 10:10:12 user nova-compute[74342]:     </memballoon>
Oct 16 10:10:12 user nova-compute[74342]:   </devices>
Oct 16 10:10:12 user nova-compute[74342]: </domain>
Oct 16 10:10:12 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 10:10:12 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Instance destroyed successfully.
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:10:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] No VIF found with MAC fa:16:3e:0e:3e:44, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:10:13 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:10:13 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:10:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "ca70fce9-392b-45d8-8fc7-5b37d8feba23" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:10:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "ca70fce9-392b-45d8-8fc7-5b37d8feba23" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:10:13 user nova-compute[74342]: DEBUG nova.compute.manager [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 10:10:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:10:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:10:13 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 10:10:13 user nova-compute[74342]: INFO nova.compute.claims [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Claim successful on node user
Oct 16 10:10:13 user nova-compute[74342]: DEBUG nova.compute.manager [req-43080228-2e82-42a7-abea-4f0950d97508 req-c25a46ed-2211-4091-9bb2-afbc4376d459 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Received event network-vif-plugged-1495980a-a474-4a07-a8d1-27521ae89be7 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:10:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-43080228-2e82-42a7-abea-4f0950d97508 req-c25a46ed-2211-4091-9bb2-afbc4376d459 service nova] Acquiring lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:10:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-43080228-2e82-42a7-abea-4f0950d97508 req-c25a46ed-2211-4091-9bb2-afbc4376d459 service nova] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:10:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-43080228-2e82-42a7-abea-4f0950d97508 req-c25a46ed-2211-4091-9bb2-afbc4376d459 service nova] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:10:13 user nova-compute[74342]: DEBUG nova.compute.manager [req-43080228-2e82-42a7-abea-4f0950d97508 req-c25a46ed-2211-4091-9bb2-afbc4376d459 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] No waiting events found dispatching network-vif-plugged-1495980a-a474-4a07-a8d1-27521ae89be7 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:10:13 user nova-compute[74342]: WARNING nova.compute.manager [req-43080228-2e82-42a7-abea-4f0950d97508 req-c25a46ed-2211-4091-9bb2-afbc4376d459 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Received unexpected event network-vif-plugged-1495980a-a474-4a07-a8d1-27521ae89be7 for instance with vm_state active and task_state rescuing.
Oct 16 10:10:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG nova.compute.manager [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG nova.compute.manager [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG nova.network.neutron [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 10:10:14 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 10:10:14 user nova-compute[74342]: DEBUG nova.compute.manager [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG nova.policy [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2cac31e799b743359b93943b68b38acf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '799c265b3d14465a9ca6bd7d5e8a4488', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 10:10:14 user nova-compute[74342]: INFO nova.virt.block_device [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Booting with volume f05294d8-330b-4b8a-8fcb-a821e561ce9f at /dev/vda
Oct 16 10:10:14 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Rebuilding the list of instances to heal {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Skipping network cache update for instance because it is Building. {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9934}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-34ef7d18-0724-479a-8448-981b9cf0d6ab" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-34ef7d18-0724-479a-8448-981b9cf0d6ab" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lazy-loading 'info_cache' on Instance uuid 34ef7d18-0724-479a-8448-981b9cf0d6ab {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG os_brick.utils [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed198bb0-307b-4e22-ad55-3aae99f16551]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed6f2217-bdbb-4484-9e54-d4c4050bcf71]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5754817e-61a4-4093-98d1-7ce6606dbee2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c64c302-2273-4874-a329-3d27d47a7be6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:10:14 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 10:10:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf01cdbb-36ec-4056-8af6-6e267ddf02f8]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG os_brick.utils [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:10:14 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Updating existing volume attachment record: 8709677d-e400-4793-a6e8-5feaba8ab702 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 10:10:15 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Updating instance_info_cache with network_info: [{"id": "1495980a-a474-4a07-a8d1-27521ae89be7", "address": "fa:16:3e:0e:3e:44", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1495980a-a4", "ovs_interfaceid": "1495980a-a474-4a07-a8d1-27521ae89be7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:10:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-34ef7d18-0724-479a-8448-981b9cf0d6ab" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:10:15 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:10:15 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:10:15 user nova-compute[74342]: DEBUG nova.network.neutron [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Successfully created port: 8b2cad16-9a51-4bb9-9e32-1e309c9c2107 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 10:10:15 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:10:15 user nova-compute[74342]: DEBUG nova.network.neutron [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Successfully updated port: 8b2cad16-9a51-4bb9-9e32-1e309c9c2107 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 10:10:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "refresh_cache-ca70fce9-392b-45d8-8fc7-5b37d8feba23" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:10:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquired lock "refresh_cache-ca70fce9-392b-45d8-8fc7-5b37d8feba23" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:10:15 user nova-compute[74342]: DEBUG nova.network.neutron [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:10:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-d5a22e8b-168f-4d68-8d3c-bc013a8eefed req-ab34146a-cd9a-49c8-af9a-fd604a7b3600 service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Received event network-changed-8b2cad16-9a51-4bb9-9e32-1e309c9c2107 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:10:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-d5a22e8b-168f-4d68-8d3c-bc013a8eefed req-ab34146a-cd9a-49c8-af9a-fd604a7b3600 service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Refreshing instance network info cache due to event network-changed-8b2cad16-9a51-4bb9-9e32-1e309c9c2107. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:10:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d5a22e8b-168f-4d68-8d3c-bc013a8eefed req-ab34146a-cd9a-49c8-af9a-fd604a7b3600 service nova] Acquiring lock "refresh_cache-ca70fce9-392b-45d8-8fc7-5b37d8feba23" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:10:15 user nova-compute[74342]: DEBUG nova.network.neutron [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 10:10:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-02784a7f-a32f-4816-9e8e-fb2c95871d98 req-cbf890ed-8463-4a71-b51c-dcd6b860a1a4 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Received event network-vif-plugged-1495980a-a474-4a07-a8d1-27521ae89be7 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:10:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-02784a7f-a32f-4816-9e8e-fb2c95871d98 req-cbf890ed-8463-4a71-b51c-dcd6b860a1a4 service nova] Acquiring lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:10:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-02784a7f-a32f-4816-9e8e-fb2c95871d98 req-cbf890ed-8463-4a71-b51c-dcd6b860a1a4 service nova] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:10:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-02784a7f-a32f-4816-9e8e-fb2c95871d98 req-cbf890ed-8463-4a71-b51c-dcd6b860a1a4 service nova] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:10:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-02784a7f-a32f-4816-9e8e-fb2c95871d98 req-cbf890ed-8463-4a71-b51c-dcd6b860a1a4 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] No waiting events found dispatching network-vif-plugged-1495980a-a474-4a07-a8d1-27521ae89be7 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:10:15 user nova-compute[74342]: WARNING nova.compute.manager [req-02784a7f-a32f-4816-9e8e-fb2c95871d98 req-cbf890ed-8463-4a71-b51c-dcd6b860a1a4 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Received unexpected event network-vif-plugged-1495980a-a474-4a07-a8d1-27521ae89be7 for instance with vm_state active and task_state rescuing.
Oct 16 10:10:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-02784a7f-a32f-4816-9e8e-fb2c95871d98 req-cbf890ed-8463-4a71-b51c-dcd6b860a1a4 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Received event network-vif-plugged-1495980a-a474-4a07-a8d1-27521ae89be7 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:10:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-02784a7f-a32f-4816-9e8e-fb2c95871d98 req-cbf890ed-8463-4a71-b51c-dcd6b860a1a4 service nova] Acquiring lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:10:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-02784a7f-a32f-4816-9e8e-fb2c95871d98 req-cbf890ed-8463-4a71-b51c-dcd6b860a1a4 service nova] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:10:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-02784a7f-a32f-4816-9e8e-fb2c95871d98 req-cbf890ed-8463-4a71-b51c-dcd6b860a1a4 service nova] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:10:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-02784a7f-a32f-4816-9e8e-fb2c95871d98 req-cbf890ed-8463-4a71-b51c-dcd6b860a1a4 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] No waiting events found dispatching network-vif-plugged-1495980a-a474-4a07-a8d1-27521ae89be7 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:10:15 user nova-compute[74342]: WARNING nova.compute.manager [req-02784a7f-a32f-4816-9e8e-fb2c95871d98 req-cbf890ed-8463-4a71-b51c-dcd6b860a1a4 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Received unexpected event network-vif-plugged-1495980a-a474-4a07-a8d1-27521ae89be7 for instance with vm_state active and task_state rescuing.
Oct 16 10:10:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:16 user nova-compute[74342]: DEBUG nova.compute.manager [None req-e62959ae-9403-4427-abce-62fb0ba4c7f8 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:10:16 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:10:16 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:10:16 user nova-compute[74342]: DEBUG nova.network.neutron [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Updating instance_info_cache with network_info: [{"id": "8b2cad16-9a51-4bb9-9e32-1e309c9c2107", "address": "fa:16:3e:df:52:eb", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2cad16-9a", "ovs_interfaceid": "8b2cad16-9a51-4bb9-9e32-1e309c9c2107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:10:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Releasing lock "refresh_cache-ca70fce9-392b-45d8-8fc7-5b37d8feba23" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:10:16 user nova-compute[74342]: DEBUG nova.compute.manager [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Instance network_info: |[{"id": "8b2cad16-9a51-4bb9-9e32-1e309c9c2107", "address": "fa:16:3e:df:52:eb", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2cad16-9a", "ovs_interfaceid": "8b2cad16-9a51-4bb9-9e32-1e309c9c2107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 10:10:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d5a22e8b-168f-4d68-8d3c-bc013a8eefed req-ab34146a-cd9a-49c8-af9a-fd604a7b3600 service nova] Acquired lock "refresh_cache-ca70fce9-392b-45d8-8fc7-5b37d8feba23" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:10:16 user nova-compute[74342]: DEBUG nova.network.neutron [req-d5a22e8b-168f-4d68-8d3c-bc013a8eefed req-ab34146a-cd9a-49c8-af9a-fd604a7b3600 service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Refreshing network info cache for port 8b2cad16-9a51-4bb9-9e32-1e309c9c2107 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:10:16 user nova-compute[74342]: DEBUG nova.network.neutron [req-d5a22e8b-168f-4d68-8d3c-bc013a8eefed req-ab34146a-cd9a-49c8-af9a-fd604a7b3600 service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Updated VIF entry in instance network info cache for port 8b2cad16-9a51-4bb9-9e32-1e309c9c2107. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:10:16 user nova-compute[74342]: DEBUG nova.network.neutron [req-d5a22e8b-168f-4d68-8d3c-bc013a8eefed req-ab34146a-cd9a-49c8-af9a-fd604a7b3600 service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Updating instance_info_cache with network_info: [{"id": "8b2cad16-9a51-4bb9-9e32-1e309c9c2107", "address": "fa:16:3e:df:52:eb", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2cad16-9a", "ovs_interfaceid": "8b2cad16-9a51-4bb9-9e32-1e309c9c2107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:10:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d5a22e8b-168f-4d68-8d3c-bc013a8eefed req-ab34146a-cd9a-49c8-af9a-fd604a7b3600 service nova] Releasing lock "refresh_cache-ca70fce9-392b-45d8-8fc7-5b37d8feba23" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:10:18 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:10:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:21 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:10:21 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74342) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 10:10:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Acquiring lock "5572a2a6-fc97-4355-bcf0-8ef41d83a0ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:10:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "5572a2a6-fc97-4355-bcf0-8ef41d83a0ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:10:22 user nova-compute[74342]: DEBUG nova.compute.manager [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 10:10:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:10:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:10:22 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 10:10:22 user nova-compute[74342]: INFO nova.compute.claims [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Claim successful on node user
Oct 16 10:10:22 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:10:22 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:10:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.410s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:10:22 user nova-compute[74342]: DEBUG nova.compute.manager [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 10:10:22 user nova-compute[74342]: DEBUG nova.compute.manager [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 10:10:22 user nova-compute[74342]: DEBUG nova.network.neutron [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 10:10:22 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 10:10:22 user nova-compute[74342]: DEBUG nova.compute.manager [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 10:10:22 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 10:10:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gwEHkDQj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:10:22 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:10:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:10:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:10:22 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:10:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:10:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:10:22 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 10:10:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:22 user nova-compute[74342]: DEBUG nova.policy [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a9e5d4c21de14697a7fad1c6264869f8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c3f6c4540e0746f9939a26d4cc4be7ab', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 10:10:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:22 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[07dc905c-6c5b-45e8-9a95-4b1cda55afbd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 10:10:22 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:10:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:22 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec1259b-0b2f-44f8-87f0-5a7409307e03]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c] added
Oct 16 10:10:22 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:10:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:22 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c2e042-5100-4c69-9b78-744fdcfa54c7]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:10:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.056s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd317c2f-dd3e-4dde-9bdc-b936f19c8faa]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gwEHkDQj {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gwEHkDQj" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c37ce672-7e42-4fa3-8318-f0eaf28dbc4a]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gwEHkDQj'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b32271-b5bc-4471-8d09-2e34a9662322]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG nova.compute.manager [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 10:10:23 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Creating image(s)
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Acquiring lock "/opt/stack/data/nova/instances/5572a2a6-fc97-4355-bcf0-8ef41d83a0ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "/opt/stack/data/nova/instances/5572a2a6-fc97-4355-bcf0-8ef41d83a0ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "/opt/stack/data/nova/instances/5572a2a6-fc97-4355-bcf0-8ef41d83a0ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5798ae-0f52-44c1-9e4d-ccbffe7bda4b]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)
Oct 16 10:10:23 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)
Oct 16 10:10:23 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e98f61a-47ce-4a72-8b3d-16a0705e612c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c, portal: 172.16.0.220,3260]
Oct 16 10:10:23 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c, portal: 172.16.0.220,3260] successful.
Oct 16 10:10:23 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb94c2d3-3883-4bec-a2e2-8852f129b071]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[da58ebda-bfaa-4e2a-80c0-ab6ce2072870]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)
Oct 16 10:10:23 user nova-compute[74342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c (non-flash)
Oct 16 10:10:23 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)
Oct 16 10:10:23 user nova-compute[74342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c (non-flash)
Oct 16 10:10:23 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] HCTL ('34', '-', '-', 0) found on session 36 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.201s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[04135862-b1d7-4fd9-87b6-02c74ef857c9]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Searching for a device in session 36 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gwEHkDQj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.190s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/5572a2a6-fc97-4355-bcf0-8ef41d83a0ac/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/5572a2a6-fc97-4355-bcf0-8ef41d83a0ac/disk 1073741824" returned: 0 in 0.059s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG nova.network.neutron [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Successfully created port: 1239b61e-ba03-41df-996e-f21d5e7e4aef {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.180s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5572a2a6-fc97-4355-bcf0-8ef41d83a0ac/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5572a2a6-fc97-4355-bcf0-8ef41d83a0ac/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5572a2a6-fc97-4355-bcf0-8ef41d83a0ac/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Cannot resize image /opt/stack/data/nova/instances/5572a2a6-fc97-4355-bcf0-8ef41d83a0ac/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Ensure instance console log exists: /opt/stack/data/nova/instances/5572a2a6-fc97-4355-bcf0-8ef41d83a0ac/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:10:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.472s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] <== connect_volume: return (1473ms) {'type': 'block', 'scsi_wwn': '26435343636653061', 'path': '/dev/sdc'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26435343636653061', 'path': '/dev/sdc'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.objects.instance [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lazy-loading 'flavor' on Instance uuid b547349a-1126-4700-93ca-d39e1da5c5cd {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 10:10:24 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:10:24 user nova-compute[74342]:   <source dev="/dev/sdc"/>
Oct 16 10:10:24 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:10:24 user nova-compute[74342]:   <serial>1b013279-5cad-45f6-9990-d1ba46f84b8c</serial>
Oct 16 10:10:24 user nova-compute[74342]: </disk>
Oct 16 10:10:24 user nova-compute[74342]:  {{(pid=74342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.network.neutron [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Successfully updated port: 1239b61e-ba03-41df-996e-f21d5e7e4aef {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Acquiring lock "refresh_cache-5572a2a6-fc97-4355-bcf0-8ef41d83a0ac" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Acquired lock "refresh_cache-5572a2a6-fc97-4355-bcf0-8ef41d83a0ac" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.network.neutron [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.network.neutron [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.compute.manager [req-7bfc0770-ce2c-463e-99ca-826f8a61aae6 req-ccaa509d-1825-4f12-b281-2698c412c241 service nova] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Received event network-changed-1239b61e-ba03-41df-996e-f21d5e7e4aef {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.compute.manager [req-7bfc0770-ce2c-463e-99ca-826f8a61aae6 req-ccaa509d-1825-4f12-b281-2698c412c241 service nova] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Refreshing instance network info cache due to event network-changed-1239b61e-ba03-41df-996e-f21d5e7e4aef. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-7bfc0770-ce2c-463e-99ca-826f8a61aae6 req-ccaa509d-1825-4f12-b281-2698c412c241 service nova] Acquiring lock "refresh_cache-5572a2a6-fc97-4355-bcf0-8ef41d83a0ac" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.network.neutron [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Updating instance_info_cache with network_info: [{"id": "1239b61e-ba03-41df-996e-f21d5e7e4aef", "address": "fa:16:3e:a7:49:ad", "network": {"id": "694e4583-ab39-4b9d-b166-c025853d10a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1799473053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f6c4540e0746f9939a26d4cc4be7ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1239b61e-ba", "ovs_interfaceid": "1239b61e-ba03-41df-996e-f21d5e7e4aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Releasing lock "refresh_cache-5572a2a6-fc97-4355-bcf0-8ef41d83a0ac" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.compute.manager [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Instance network_info: |[{"id": "1239b61e-ba03-41df-996e-f21d5e7e4aef", "address": "fa:16:3e:a7:49:ad", "network": {"id": "694e4583-ab39-4b9d-b166-c025853d10a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1799473053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f6c4540e0746f9939a26d4cc4be7ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1239b61e-ba", "ovs_interfaceid": "1239b61e-ba03-41df-996e-f21d5e7e4aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-7bfc0770-ce2c-463e-99ca-826f8a61aae6 req-ccaa509d-1825-4f12-b281-2698c412c241 service nova] Acquired lock "refresh_cache-5572a2a6-fc97-4355-bcf0-8ef41d83a0ac" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.network.neutron [req-7bfc0770-ce2c-463e-99ca-826f8a61aae6 req-ccaa509d-1825-4f12-b281-2698c412c241 service nova] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Refreshing network info cache for port 1239b61e-ba03-41df-996e-f21d5e7e4aef {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Start _get_guest_xml network_info=[{"id": "1239b61e-ba03-41df-996e-f21d5e7e4aef", "address": "fa:16:3e:a7:49:ad", "network": {"id": "694e4583-ab39-4b9d-b166-c025853d10a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1799473053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f6c4540e0746f9939a26d4cc4be7ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1239b61e-ba", "ovs_interfaceid": "1239b61e-ba03-41df-996e-f21d5e7e4aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] No VIF found with MAC fa:16:3e:8f:4b:dc, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:10:24 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:10:24 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:10:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1078724388',display_name='tempest-VolumesActionsTest-instance-1078724388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1078724388',id=44,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3f6c4540e0746f9939a26d4cc4be7ab',ramdisk_id='',reservation_id='r-kkebhydx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-188382855',owner_user_name='tempest-VolumesActionsTest-188382855-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:10:23Z,user_data=None,user_id='a9e5d4c21de14697a7fad1c6264869f8',uuid=5572a2a6-fc97-4355-bcf0-8ef41d83a0ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1239b61e-ba03-41df-996e-f21d5e7e4aef", "address": "fa:16:3e:a7:49:ad", "network": {"id": "694e4583-ab39-4b9d-b166-c025853d10a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1799473053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f6c4540e0746f9939a26d4cc4be7ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1239b61e-ba", "ovs_interfaceid": "1239b61e-ba03-41df-996e-f21d5e7e4aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Converting VIF {"id": "1239b61e-ba03-41df-996e-f21d5e7e4aef", "address": "fa:16:3e:a7:49:ad", "network": {"id": "694e4583-ab39-4b9d-b166-c025853d10a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1799473053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f6c4540e0746f9939a26d4cc4be7ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1239b61e-ba", "ovs_interfaceid": "1239b61e-ba03-41df-996e-f21d5e7e4aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:49:ad,bridge_name='br-int',has_traffic_filtering=True,id=1239b61e-ba03-41df-996e-f21d5e7e4aef,network=Network(694e4583-ab39-4b9d-b166-c025853d10a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1239b61e-ba') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.objects.instance [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lazy-loading 'pci_devices' on Instance uuid 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] End _get_guest_xml xml=<domain type="kvm">
Oct 16 10:10:24 user nova-compute[74342]:   <uuid>5572a2a6-fc97-4355-bcf0-8ef41d83a0ac</uuid>
Oct 16 10:10:24 user nova-compute[74342]:   <name>instance-0000002c</name>
Oct 16 10:10:24 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 10:10:24 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 10:10:24 user nova-compute[74342]:   <metadata>
Oct 16 10:10:24 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 10:10:24 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 10:10:24 user nova-compute[74342]:       <nova:name>tempest-VolumesActionsTest-instance-1078724388</nova:name>
Oct 16 10:10:24 user nova-compute[74342]:       <nova:creationTime>2023-10-16 10:10:24</nova:creationTime>
Oct 16 10:10:24 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 10:10:24 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 10:10:24 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 10:10:24 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 10:10:24 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 10:10:24 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 10:10:24 user nova-compute[74342]:       </nova:flavor>
Oct 16 10:10:24 user nova-compute[74342]:       <nova:owner>
Oct 16 10:10:24 user nova-compute[74342]:         <nova:user uuid="a9e5d4c21de14697a7fad1c6264869f8">tempest-VolumesActionsTest-188382855-project-member</nova:user>
Oct 16 10:10:24 user nova-compute[74342]:         <nova:project uuid="c3f6c4540e0746f9939a26d4cc4be7ab">tempest-VolumesActionsTest-188382855</nova:project>
Oct 16 10:10:24 user nova-compute[74342]:       </nova:owner>
Oct 16 10:10:24 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 10:10:24 user nova-compute[74342]:       <nova:ports>
Oct 16 10:10:24 user nova-compute[74342]:         <nova:port uuid="1239b61e-ba03-41df-996e-f21d5e7e4aef">
Oct 16 10:10:24 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Oct 16 10:10:24 user nova-compute[74342]:         </nova:port>
Oct 16 10:10:24 user nova-compute[74342]:       </nova:ports>
Oct 16 10:10:24 user nova-compute[74342]:     </nova:instance>
Oct 16 10:10:24 user nova-compute[74342]:   </metadata>
Oct 16 10:10:24 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 10:10:24 user nova-compute[74342]:     <system>
Oct 16 10:10:24 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 10:10:24 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 10:10:24 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 10:10:24 user nova-compute[74342]:       <entry name="serial">5572a2a6-fc97-4355-bcf0-8ef41d83a0ac</entry>
Oct 16 10:10:24 user nova-compute[74342]:       <entry name="uuid">5572a2a6-fc97-4355-bcf0-8ef41d83a0ac</entry>
Oct 16 10:10:24 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 10:10:24 user nova-compute[74342]:     </system>
Oct 16 10:10:24 user nova-compute[74342]:   </sysinfo>
Oct 16 10:10:24 user nova-compute[74342]:   <os>
Oct 16 10:10:24 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 10:10:24 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 10:10:24 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 10:10:24 user nova-compute[74342]:   </os>
Oct 16 10:10:24 user nova-compute[74342]:   <features>
Oct 16 10:10:24 user nova-compute[74342]:     <acpi/>
Oct 16 10:10:24 user nova-compute[74342]:     <apic/>
Oct 16 10:10:24 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 10:10:24 user nova-compute[74342]:   </features>
Oct 16 10:10:24 user nova-compute[74342]:   <clock offset="utc">
Oct 16 10:10:24 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 10:10:24 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 10:10:24 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 10:10:24 user nova-compute[74342]:   </clock>
Oct 16 10:10:24 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 10:10:24 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 10:10:24 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 10:10:24 user nova-compute[74342]:   </cpu>
Oct 16 10:10:24 user nova-compute[74342]:   <devices>
Oct 16 10:10:24 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 10:10:24 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 10:10:24 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/5572a2a6-fc97-4355-bcf0-8ef41d83a0ac/disk"/>
Oct 16 10:10:24 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 10:10:24 user nova-compute[74342]:     </disk>
Oct 16 10:10:24 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 10:10:24 user nova-compute[74342]:       <mac address="fa:16:3e:a7:49:ad"/>
Oct 16 10:10:24 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:10:24 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 10:10:24 user nova-compute[74342]:       <target dev="tap1239b61e-ba"/>
Oct 16 10:10:24 user nova-compute[74342]:     </interface>
Oct 16 10:10:24 user nova-compute[74342]:     <serial type="pty">
Oct 16 10:10:24 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/5572a2a6-fc97-4355-bcf0-8ef41d83a0ac/console.log" append="off"/>
Oct 16 10:10:24 user nova-compute[74342]:     </serial>
Oct 16 10:10:24 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 10:10:24 user nova-compute[74342]:     <video>
Oct 16 10:10:24 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:10:24 user nova-compute[74342]:     </video>
Oct 16 10:10:24 user nova-compute[74342]:     <rng model="virtio">
Oct 16 10:10:24 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 10:10:24 user nova-compute[74342]:     </rng>
Oct 16 10:10:24 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 10:10:24 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 10:10:24 user nova-compute[74342]:       <stats period="10"/>
Oct 16 10:10:24 user nova-compute[74342]:     </memballoon>
Oct 16 10:10:24 user nova-compute[74342]:   </devices>
Oct 16 10:10:24 user nova-compute[74342]: </domain>
Oct 16 10:10:24 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:10:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1078724388',display_name='tempest-VolumesActionsTest-instance-1078724388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1078724388',id=44,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c3f6c4540e0746f9939a26d4cc4be7ab',ramdisk_id='',reservation_id='r-kkebhydx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-188382855',owner_user_name='tempest-VolumesActionsTest-188382855-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:10:23Z,user_data=None,user_id='a9e5d4c21de14697a7fad1c6264869f8',uuid=5572a2a6-fc97-4355-bcf0-8ef41d83a0ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1239b61e-ba03-41df-996e-f21d5e7e4aef", "address": "fa:16:3e:a7:49:ad", "network": {"id": "694e4583-ab39-4b9d-b166-c025853d10a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1799473053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f6c4540e0746f9939a26d4cc4be7ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1239b61e-ba", "ovs_interfaceid": "1239b61e-ba03-41df-996e-f21d5e7e4aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Converting VIF {"id": "1239b61e-ba03-41df-996e-f21d5e7e4aef", "address": "fa:16:3e:a7:49:ad", "network": {"id": "694e4583-ab39-4b9d-b166-c025853d10a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1799473053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f6c4540e0746f9939a26d4cc4be7ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1239b61e-ba", "ovs_interfaceid": "1239b61e-ba03-41df-996e-f21d5e7e4aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:49:ad,bridge_name='br-int',has_traffic_filtering=True,id=1239b61e-ba03-41df-996e-f21d5e7e4aef,network=Network(694e4583-ab39-4b9d-b166-c025853d10a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1239b61e-ba') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG os_vif [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:49:ad,bridge_name='br-int',has_traffic_filtering=True,id=1239b61e-ba03-41df-996e-f21d5e7e4aef,network=Network(694e4583-ab39-4b9d-b166-c025853d10a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1239b61e-ba') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '340c2927-4f99-5272-8ef3-68cc74e50a13', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1239b61e-ba, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1239b61e-ba, col_values=(('qos', UUID('c3a47d95-ec1f-45b0-b008-cd7e1838d014')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1239b61e-ba, col_values=(('external_ids', {'iface-id': '1239b61e-ba03-41df-996e-f21d5e7e4aef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:49:ad', 'vm-uuid': '5572a2a6-fc97-4355-bcf0-8ef41d83a0ac'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:10:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:10:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:25 user nova-compute[74342]: INFO os_vif [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:49:ad,bridge_name='br-int',has_traffic_filtering=True,id=1239b61e-ba03-41df-996e-f21d5e7e4aef,network=Network(694e4583-ab39-4b9d-b166-c025853d10a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1239b61e-ba')
Oct 16 10:10:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c5530475-eba6-4e8c-997f-6fdcf5aa5228 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "b547349a-1126-4700-93ca-d39e1da5c5cd" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 36.568s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:10:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:10:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] No VIF found with MAC fa:16:3e:a7:49:ad, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:10:25 user nova-compute[74342]: DEBUG nova.network.neutron [req-7bfc0770-ce2c-463e-99ca-826f8a61aae6 req-ccaa509d-1825-4f12-b281-2698c412c241 service nova] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Updated VIF entry in instance network info cache for port 1239b61e-ba03-41df-996e-f21d5e7e4aef. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:10:25 user nova-compute[74342]: DEBUG nova.network.neutron [req-7bfc0770-ce2c-463e-99ca-826f8a61aae6 req-ccaa509d-1825-4f12-b281-2698c412c241 service nova] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Updating instance_info_cache with network_info: [{"id": "1239b61e-ba03-41df-996e-f21d5e7e4aef", "address": "fa:16:3e:a7:49:ad", "network": {"id": "694e4583-ab39-4b9d-b166-c025853d10a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1799473053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f6c4540e0746f9939a26d4cc4be7ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1239b61e-ba", "ovs_interfaceid": "1239b61e-ba03-41df-996e-f21d5e7e4aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:10:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-7bfc0770-ce2c-463e-99ca-826f8a61aae6 req-ccaa509d-1825-4f12-b281-2698c412c241 service nova] Releasing lock "refresh_cache-5572a2a6-fc97-4355-bcf0-8ef41d83a0ac" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:10:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:26 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:10:26 user nova-compute[74342]: DEBUG nova.compute.manager [req-f74db72f-177c-4584-9072-fa3cdd8fb35e req-caae688a-bfc7-4b0e-b7d9-53f9846704e2 service nova] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Received event network-vif-plugged-1239b61e-ba03-41df-996e-f21d5e7e4aef {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:10:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f74db72f-177c-4584-9072-fa3cdd8fb35e req-caae688a-bfc7-4b0e-b7d9-53f9846704e2 service nova] Acquiring lock "5572a2a6-fc97-4355-bcf0-8ef41d83a0ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:10:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f74db72f-177c-4584-9072-fa3cdd8fb35e req-caae688a-bfc7-4b0e-b7d9-53f9846704e2 service nova] Lock "5572a2a6-fc97-4355-bcf0-8ef41d83a0ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:10:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f74db72f-177c-4584-9072-fa3cdd8fb35e req-caae688a-bfc7-4b0e-b7d9-53f9846704e2 service nova] Lock "5572a2a6-fc97-4355-bcf0-8ef41d83a0ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:10:26 user nova-compute[74342]: DEBUG nova.compute.manager [req-f74db72f-177c-4584-9072-fa3cdd8fb35e req-caae688a-bfc7-4b0e-b7d9-53f9846704e2 service nova] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] No waiting events found dispatching network-vif-plugged-1239b61e-ba03-41df-996e-f21d5e7e4aef {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:10:26 user nova-compute[74342]: WARNING nova.compute.manager [req-f74db72f-177c-4584-9072-fa3cdd8fb35e req-caae688a-bfc7-4b0e-b7d9-53f9846704e2 service nova] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Received unexpected event network-vif-plugged-1239b61e-ba03-41df-996e-f21d5e7e4aef for instance with vm_state building and task_state spawning.
Oct 16 10:10:26 user nova-compute[74342]: WARNING nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] While synchronizing instance power states, found 6 instances in the database and 5 instances on the hypervisor.
Oct 16 10:10:26 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Triggering sync for uuid 34ef7d18-0724-479a-8448-981b9cf0d6ab {{(pid=74342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 10:10:26 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Triggering sync for uuid 7d016ab3-14c4-4c33-bd50-468f71339cd7 {{(pid=74342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 10:10:26 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Triggering sync for uuid b547349a-1126-4700-93ca-d39e1da5c5cd {{(pid=74342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 10:10:26 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Triggering sync for uuid e8b580f9-a3cd-418b-8878-d86a6bb0afc5 {{(pid=74342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 10:10:27 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Triggering sync for uuid ca70fce9-392b-45d8-8fc7-5b37d8feba23 {{(pid=74342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 10:10:27 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Triggering sync for uuid 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac {{(pid=74342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 10:10:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "34ef7d18-0724-479a-8448-981b9cf0d6ab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:10:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:10:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "7d016ab3-14c4-4c33-bd50-468f71339cd7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:10:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "7d016ab3-14c4-4c33-bd50-468f71339cd7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:10:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "b547349a-1126-4700-93ca-d39e1da5c5cd" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:10:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "b547349a-1126-4700-93ca-d39e1da5c5cd" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:10:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "e8b580f9-a3cd-418b-8878-d86a6bb0afc5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:10:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "e8b580f9-a3cd-418b-8878-d86a6bb0afc5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:10:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "ca70fce9-392b-45d8-8fc7-5b37d8feba23" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:10:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "5572a2a6-fc97-4355-bcf0-8ef41d83a0ac" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:10:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "7d016ab3-14c4-4c33-bd50-468f71339cd7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.055s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:10:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:10:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "b547349a-1126-4700-93ca-d39e1da5c5cd" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.071s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:10:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "e8b580f9-a3cd-418b-8878-d86a6bb0afc5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:10:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "b547349a-1126-4700-93ca-d39e1da5c5cd" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:10:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "b547349a-1126-4700-93ca-d39e1da5c5cd" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:10:27 user nova-compute[74342]: INFO nova.compute.manager [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Detaching volume 1b013279-5cad-45f6-9990-d1ba46f84b8c
Oct 16 10:10:27 user nova-compute[74342]: INFO nova.virt.block_device [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Attempting to driver detach volume 1b013279-5cad-45f6-9990-d1ba46f84b8c from mountpoint /dev/vdb
Oct 16 10:10:27 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Attempting to detach device vdb from instance b547349a-1126-4700-93ca-d39e1da5c5cd from the persistent domain config. {{(pid=74342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 10:10:27 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 10:10:27 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:10:27 user nova-compute[74342]:   <source dev="/dev/sdc"/>
Oct 16 10:10:27 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:10:27 user nova-compute[74342]:   <serial>1b013279-5cad-45f6-9990-d1ba46f84b8c</serial>
Oct 16 10:10:27 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 10:10:27 user nova-compute[74342]: </disk>
Oct 16 10:10:27 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 10:10:27 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Successfully detached device vdb from instance b547349a-1126-4700-93ca-d39e1da5c5cd from the persistent domain config.
Oct 16 10:10:27 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b547349a-1126-4700-93ca-d39e1da5c5cd from the live domain config. {{(pid=74342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 10:10:27 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 10:10:27 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:10:27 user nova-compute[74342]:   <source dev="/dev/sdc"/>
Oct 16 10:10:27 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:10:27 user nova-compute[74342]:   <serial>1b013279-5cad-45f6-9990-d1ba46f84b8c</serial>
Oct 16 10:10:27 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 10:10:27 user nova-compute[74342]: </disk>
Oct 16 10:10:27 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 10:10:28 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b547349a-1126-4700-93ca-d39e1da5c5cd {{(pid=74342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 10:10:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:28 user nova-compute[74342]: DEBUG nova.compute.manager [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 10:10:28 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 10:10:28 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Instance spawned successfully.
Oct 16 10:10:28 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 10:10:28 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:10:28 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:10:28 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:10:28 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:10:28 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:10:28 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:10:28 user nova-compute[74342]: DEBUG nova.compute.manager [req-26fe103e-26fc-41c9-ba84-ac1135361b72 req-3b950351-80ef-43c0-a8c1-8d43f15a00eb service nova] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Received event network-vif-plugged-1239b61e-ba03-41df-996e-f21d5e7e4aef {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:10:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-26fe103e-26fc-41c9-ba84-ac1135361b72 req-3b950351-80ef-43c0-a8c1-8d43f15a00eb service nova] Acquiring lock "5572a2a6-fc97-4355-bcf0-8ef41d83a0ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:10:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-26fe103e-26fc-41c9-ba84-ac1135361b72 req-3b950351-80ef-43c0-a8c1-8d43f15a00eb service nova] Lock "5572a2a6-fc97-4355-bcf0-8ef41d83a0ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:10:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-26fe103e-26fc-41c9-ba84-ac1135361b72 req-3b950351-80ef-43c0-a8c1-8d43f15a00eb service nova] Lock "5572a2a6-fc97-4355-bcf0-8ef41d83a0ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:10:28 user nova-compute[74342]: DEBUG nova.compute.manager [req-26fe103e-26fc-41c9-ba84-ac1135361b72 req-3b950351-80ef-43c0-a8c1-8d43f15a00eb service nova] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] No waiting events found dispatching network-vif-plugged-1239b61e-ba03-41df-996e-f21d5e7e4aef {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:10:28 user nova-compute[74342]: WARNING nova.compute.manager [req-26fe103e-26fc-41c9-ba84-ac1135361b72 req-3b950351-80ef-43c0-a8c1-8d43f15a00eb service nova] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Received unexpected event network-vif-plugged-1239b61e-ba03-41df-996e-f21d5e7e4aef for instance with vm_state building and task_state spawning.
Oct 16 10:10:29 user nova-compute[74342]: INFO nova.compute.manager [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Took 5.92 seconds to spawn the instance on the hypervisor.
Oct 16 10:10:29 user nova-compute[74342]: DEBUG nova.compute.manager [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:10:29 user nova-compute[74342]: INFO nova.compute.manager [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Took 6.86 seconds to build instance.
Oct 16 10:10:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-93bd1f62-44b6-4c60-9f21-fd21ed5cc690 tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "5572a2a6-fc97-4355-bcf0-8ef41d83a0ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.979s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:10:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "5572a2a6-fc97-4355-bcf0-8ef41d83a0ac" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.118s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:10:29 user nova-compute[74342]: INFO nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] During sync_power_state the instance has a pending task (spawning). Skip.
Oct 16 10:10:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "5572a2a6-fc97-4355-bcf0-8ef41d83a0ac" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:10:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG nova.compute.manager [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 10:10:32 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Creating image(s)
Oct 16 10:10:32 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Did not create local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Ensure instance console log exists: /opt/stack/data/nova/instances/ca70fce9-392b-45d8-8fc7-5b37d8feba23/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Start _get_guest_xml network_info=[{"id": "8b2cad16-9a51-4bb9-9e32-1e309c9c2107", "address": "fa:16:3e:df:52:eb", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2cad16-9a", "ovs_interfaceid": "8b2cad16-9a51-4bb9-9e32-1e309c9c2107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vda', 'device_type': 'disk', 'boot_index': 0, 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '8709677d-e400-4793-a6e8-5feaba8ab702', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zUetEGgV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ca70fce9-392b-45d8-8fc7-5b37d8feba23', 'attached_at': '', 'detached_at': '', 'volume_id': 'f05294d8-330b-4b8a-8fcb-a821e561ce9f', 'serial': 'f05294d8-330b-4b8a-8fcb-a821e561ce9f'}, 'volume_type': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 10:10:32 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:10:32 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:10:32 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zUetEGgV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:10:32 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:10:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:10:32 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:10:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:10:32 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 10:10:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6e3d96d-20a7-484d-8784-dbb128ceab42]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 10:10:32 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c8aa420-7fee-4d40-be8c-945169329922]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f] added
Oct 16 10:10:32 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[983a0e96-9be6-4663-b1df-57bbef56b2b8]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b6378e-8473-48ba-828a-2f7ba636d526]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zUetEGgV {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zUetEGgV" returned: 0 in 0.028s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e677db33-99c1-4ef4-941d-e092065375c4]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zUetEGgV'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c349e8-82bc-453d-8029-6b5899258c8b]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2e5717f-ee2f-4e45-babd-394dbdbfd158]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)
Oct 16 10:10:32 user nova-compute[74342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c (non-flash)
Oct 16 10:10:32 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)
Oct 16 10:10:32 user nova-compute[74342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c (non-flash)
Oct 16 10:10:32 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:10:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:33 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dc03be-1281-4ed1-8ca9-d96b2732bfb7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f, portal: 172.16.0.220,3260]
Oct 16 10:10:33 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f, portal: 172.16.0.220,3260] successful.
Oct 16 10:10:33 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:10:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:33 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88d291f-9bae-4d81-a3cb-b0ae013b9aae]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:10:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:33 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ab48956-b182-4b02-b18e-82603934f072]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)
Oct 16 10:10:33 user nova-compute[74342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c (non-flash)
Oct 16 10:10:33 user nova-compute[74342]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f (non-flash)
Oct 16 10:10:33 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:10:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)
Oct 16 10:10:33 user nova-compute[74342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c (non-flash)
Oct 16 10:10:33 user nova-compute[74342]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f (non-flash)
Oct 16 10:10:33 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:10:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:10:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 10:10:33 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] HCTL ('35', '-', '-', 0) found on session 37 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 10:10:33 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 10:10:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:33 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b05a60-d9cc-4a65-b77c-f0e90e23f2fe]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:33 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Searching for a device in session 37 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 10:10:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zUetEGgV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 10:10:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:10:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] <== connect_volume: return (1330ms) {'type': 'block', 'scsi_wwn': '26665343662393163', 'path': '/dev/sdd'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:10:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26665343662393163', 'path': '/dev/sdd'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 10:10:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:10:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1246688382',display_name='tempest-TestVolumeBootPattern-server-1246688382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1246688382',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6sJnf898pay+PIZ2/zPOefJIOtQi4Xc+rReNrpoZgM8isuwz9hj22LY0/hNzdd67mZVqTOLnmuplNPpzcrNUeli+GTP1gNufDr7TumrMEFsIIMVgfBAzUAuJrkUhM+WA==',key_name='tempest-TestVolumeBootPattern-2085750064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='799c265b3d14465a9ca6bd7d5e8a4488',ramdisk_id='',reservation_id='r-wwikoqgu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-158744824',owner_user_name='tempest-TestVolumeBootPattern-158744824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:10:14Z,user_data=None,user_id='2cac31e799b743359b93943b68b38acf',uuid=ca70fce9-392b-45d8-8fc7-5b37d8feba23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b2cad16-9a51-4bb9-9e32-1e309c9c2107", "address": "fa:16:3e:df:52:eb", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2cad16-9a", "ovs_interfaceid": "8b2cad16-9a51-4bb9-9e32-1e309c9c2107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 10:10:34 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converting VIF {"id": "8b2cad16-9a51-4bb9-9e32-1e309c9c2107", "address": "fa:16:3e:df:52:eb", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2cad16-9a", "ovs_interfaceid": "8b2cad16-9a51-4bb9-9e32-1e309c9c2107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:10:34 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:52:eb,bridge_name='br-int',has_traffic_filtering=True,id=8b2cad16-9a51-4bb9-9e32-1e309c9c2107,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b2cad16-9a') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:10:34 user nova-compute[74342]: DEBUG nova.objects.instance [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lazy-loading 'pci_devices' on Instance uuid ca70fce9-392b-45d8-8fc7-5b37d8feba23 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:10:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] End _get_guest_xml xml=<domain type="kvm">
Oct 16 10:10:34 user nova-compute[74342]:   <uuid>ca70fce9-392b-45d8-8fc7-5b37d8feba23</uuid>
Oct 16 10:10:34 user nova-compute[74342]:   <name>instance-0000002b</name>
Oct 16 10:10:34 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 10:10:34 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 10:10:34 user nova-compute[74342]:   <metadata>
Oct 16 10:10:34 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 10:10:34 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 10:10:34 user nova-compute[74342]:       <nova:name>tempest-TestVolumeBootPattern-server-1246688382</nova:name>
Oct 16 10:10:34 user nova-compute[74342]:       <nova:creationTime>2023-10-16 10:10:32</nova:creationTime>
Oct 16 10:10:34 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 10:10:34 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 10:10:34 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 10:10:34 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 10:10:34 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 10:10:34 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 10:10:34 user nova-compute[74342]:       </nova:flavor>
Oct 16 10:10:34 user nova-compute[74342]:       <nova:owner>
Oct 16 10:10:34 user nova-compute[74342]:         <nova:user uuid="2cac31e799b743359b93943b68b38acf">tempest-TestVolumeBootPattern-158744824-project-member</nova:user>
Oct 16 10:10:34 user nova-compute[74342]:         <nova:project uuid="799c265b3d14465a9ca6bd7d5e8a4488">tempest-TestVolumeBootPattern-158744824</nova:project>
Oct 16 10:10:34 user nova-compute[74342]:       </nova:owner>
Oct 16 10:10:34 user nova-compute[74342]:       <nova:ports>
Oct 16 10:10:34 user nova-compute[74342]:         <nova:port uuid="8b2cad16-9a51-4bb9-9e32-1e309c9c2107">
Oct 16 10:10:34 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Oct 16 10:10:34 user nova-compute[74342]:         </nova:port>
Oct 16 10:10:34 user nova-compute[74342]:       </nova:ports>
Oct 16 10:10:34 user nova-compute[74342]:     </nova:instance>
Oct 16 10:10:34 user nova-compute[74342]:   </metadata>
Oct 16 10:10:34 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 10:10:34 user nova-compute[74342]:     <system>
Oct 16 10:10:34 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 10:10:34 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 10:10:34 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 10:10:34 user nova-compute[74342]:       <entry name="serial">ca70fce9-392b-45d8-8fc7-5b37d8feba23</entry>
Oct 16 10:10:34 user nova-compute[74342]:       <entry name="uuid">ca70fce9-392b-45d8-8fc7-5b37d8feba23</entry>
Oct 16 10:10:34 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 10:10:34 user nova-compute[74342]:     </system>
Oct 16 10:10:34 user nova-compute[74342]:   </sysinfo>
Oct 16 10:10:34 user nova-compute[74342]:   <os>
Oct 16 10:10:34 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 10:10:34 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 10:10:34 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 10:10:34 user nova-compute[74342]:   </os>
Oct 16 10:10:34 user nova-compute[74342]:   <features>
Oct 16 10:10:34 user nova-compute[74342]:     <acpi/>
Oct 16 10:10:34 user nova-compute[74342]:     <apic/>
Oct 16 10:10:34 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 10:10:34 user nova-compute[74342]:   </features>
Oct 16 10:10:34 user nova-compute[74342]:   <clock offset="utc">
Oct 16 10:10:34 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 10:10:34 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 10:10:34 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 10:10:34 user nova-compute[74342]:   </clock>
Oct 16 10:10:34 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 10:10:34 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 10:10:34 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 10:10:34 user nova-compute[74342]:   </cpu>
Oct 16 10:10:34 user nova-compute[74342]:   <devices>
Oct 16 10:10:34 user nova-compute[74342]:     <disk type="block" device="disk">
Oct 16 10:10:34 user nova-compute[74342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:10:34 user nova-compute[74342]:       <source dev="/dev/sdd"/>
Oct 16 10:10:34 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 10:10:34 user nova-compute[74342]:       <serial>f05294d8-330b-4b8a-8fcb-a821e561ce9f</serial>
Oct 16 10:10:34 user nova-compute[74342]:     </disk>
Oct 16 10:10:34 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 10:10:34 user nova-compute[74342]:       <mac address="fa:16:3e:df:52:eb"/>
Oct 16 10:10:34 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:10:34 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 10:10:34 user nova-compute[74342]:       <target dev="tap8b2cad16-9a"/>
Oct 16 10:10:34 user nova-compute[74342]:     </interface>
Oct 16 10:10:34 user nova-compute[74342]:     <serial type="pty">
Oct 16 10:10:34 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/ca70fce9-392b-45d8-8fc7-5b37d8feba23/console.log" append="off"/>
Oct 16 10:10:34 user nova-compute[74342]:     </serial>
Oct 16 10:10:34 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 10:10:34 user nova-compute[74342]:     <video>
Oct 16 10:10:34 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:10:34 user nova-compute[74342]:     </video>
Oct 16 10:10:34 user nova-compute[74342]:     <rng model="virtio">
Oct 16 10:10:34 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 10:10:34 user nova-compute[74342]:     </rng>
Oct 16 10:10:34 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 10:10:34 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 10:10:34 user nova-compute[74342]:       <stats period="10"/>
Oct 16 10:10:34 user nova-compute[74342]:     </memballoon>
Oct 16 10:10:34 user nova-compute[74342]:   </devices>
Oct 16 10:10:34 user nova-compute[74342]: </domain>
Oct 16 10:10:34 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 10:10:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:10:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1246688382',display_name='tempest-TestVolumeBootPattern-server-1246688382',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1246688382',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6sJnf898pay+PIZ2/zPOefJIOtQi4Xc+rReNrpoZgM8isuwz9hj22LY0/hNzdd67mZVqTOLnmuplNPpzcrNUeli+GTP1gNufDr7TumrMEFsIIMVgfBAzUAuJrkUhM+WA==',key_name='tempest-TestVolumeBootPattern-2085750064',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='799c265b3d14465a9ca6bd7d5e8a4488',ramdisk_id='',reservation_id='r-wwikoqgu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-158744824',owner_user_name='tempest-TestVolumeBootPattern-158744824-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:10:14Z,user_data=None,user_id='2cac31e799b743359b93943b68b38acf',uuid=ca70fce9-392b-45d8-8fc7-5b37d8feba23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8b2cad16-9a51-4bb9-9e32-1e309c9c2107", "address": "fa:16:3e:df:52:eb", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2cad16-9a", "ovs_interfaceid": "8b2cad16-9a51-4bb9-9e32-1e309c9c2107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 10:10:34 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converting VIF {"id": "8b2cad16-9a51-4bb9-9e32-1e309c9c2107", "address": "fa:16:3e:df:52:eb", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2cad16-9a", "ovs_interfaceid": "8b2cad16-9a51-4bb9-9e32-1e309c9c2107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:10:34 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:52:eb,bridge_name='br-int',has_traffic_filtering=True,id=8b2cad16-9a51-4bb9-9e32-1e309c9c2107,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b2cad16-9a') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:10:34 user nova-compute[74342]: DEBUG os_vif [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:52:eb,bridge_name='br-int',has_traffic_filtering=True,id=8b2cad16-9a51-4bb9-9e32-1e309c9c2107,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b2cad16-9a') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 10:10:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:10:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 10:10:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd13a6cd5-ee03-50e7-8555-58472d01ad64', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:10:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:10:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8b2cad16-9a, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:10:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8b2cad16-9a, col_values=(('qos', UUID('30b71651-6e68-4e61-80e3-6a9f961315a7')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:10:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8b2cad16-9a, col_values=(('external_ids', {'iface-id': '8b2cad16-9a51-4bb9-9e32-1e309c9c2107', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:52:eb', 'vm-uuid': 'ca70fce9-392b-45d8-8fc7-5b37d8feba23'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:10:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:10:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:34 user nova-compute[74342]: INFO os_vif [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:52:eb,bridge_name='br-int',has_traffic_filtering=True,id=8b2cad16-9a51-4bb9-9e32-1e309c9c2107,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b2cad16-9a')
Oct 16 10:10:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:10:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] No VIF found with MAC fa:16:3e:df:52:eb, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:10:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:36 user nova-compute[74342]: DEBUG nova.compute.manager [req-01c5840c-2222-44cc-b0d4-8c3791ca10bd req-898e460f-48d0-4bb2-91bb-83e8ceda8da7 service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Received event network-vif-plugged-8b2cad16-9a51-4bb9-9e32-1e309c9c2107 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:10:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-01c5840c-2222-44cc-b0d4-8c3791ca10bd req-898e460f-48d0-4bb2-91bb-83e8ceda8da7 service nova] Acquiring lock "ca70fce9-392b-45d8-8fc7-5b37d8feba23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:10:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-01c5840c-2222-44cc-b0d4-8c3791ca10bd req-898e460f-48d0-4bb2-91bb-83e8ceda8da7 service nova] Lock "ca70fce9-392b-45d8-8fc7-5b37d8feba23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:10:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-01c5840c-2222-44cc-b0d4-8c3791ca10bd req-898e460f-48d0-4bb2-91bb-83e8ceda8da7 service nova] Lock "ca70fce9-392b-45d8-8fc7-5b37d8feba23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:10:36 user nova-compute[74342]: DEBUG nova.compute.manager [req-01c5840c-2222-44cc-b0d4-8c3791ca10bd req-898e460f-48d0-4bb2-91bb-83e8ceda8da7 service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] No waiting events found dispatching network-vif-plugged-8b2cad16-9a51-4bb9-9e32-1e309c9c2107 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:10:36 user nova-compute[74342]: WARNING nova.compute.manager [req-01c5840c-2222-44cc-b0d4-8c3791ca10bd req-898e460f-48d0-4bb2-91bb-83e8ceda8da7 service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Received unexpected event network-vif-plugged-8b2cad16-9a51-4bb9-9e32-1e309c9c2107 for instance with vm_state building and task_state spawning.
Oct 16 10:10:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:38 user nova-compute[74342]: DEBUG nova.compute.manager [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 10:10:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 10:10:38 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Instance spawned successfully.
Oct 16 10:10:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 10:10:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:10:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:10:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:10:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:10:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:10:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:10:38 user nova-compute[74342]: DEBUG nova.compute.manager [req-84448946-d333-400d-a06d-c025e47bdbcd req-bf566bef-096a-435a-9881-1ab4032fdad3 service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Received event network-vif-plugged-8b2cad16-9a51-4bb9-9e32-1e309c9c2107 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:10:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-84448946-d333-400d-a06d-c025e47bdbcd req-bf566bef-096a-435a-9881-1ab4032fdad3 service nova] Acquiring lock "ca70fce9-392b-45d8-8fc7-5b37d8feba23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:10:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-84448946-d333-400d-a06d-c025e47bdbcd req-bf566bef-096a-435a-9881-1ab4032fdad3 service nova] Lock "ca70fce9-392b-45d8-8fc7-5b37d8feba23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:10:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-84448946-d333-400d-a06d-c025e47bdbcd req-bf566bef-096a-435a-9881-1ab4032fdad3 service nova] Lock "ca70fce9-392b-45d8-8fc7-5b37d8feba23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:10:38 user nova-compute[74342]: DEBUG nova.compute.manager [req-84448946-d333-400d-a06d-c025e47bdbcd req-bf566bef-096a-435a-9881-1ab4032fdad3 service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] No waiting events found dispatching network-vif-plugged-8b2cad16-9a51-4bb9-9e32-1e309c9c2107 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:10:38 user nova-compute[74342]: WARNING nova.compute.manager [req-84448946-d333-400d-a06d-c025e47bdbcd req-bf566bef-096a-435a-9881-1ab4032fdad3 service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Received unexpected event network-vif-plugged-8b2cad16-9a51-4bb9-9e32-1e309c9c2107 for instance with vm_state building and task_state spawning.
Oct 16 10:10:38 user nova-compute[74342]: INFO nova.compute.manager [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Took 5.43 seconds to spawn the instance on the hypervisor.
Oct 16 10:10:38 user nova-compute[74342]: DEBUG nova.compute.manager [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:10:38 user nova-compute[74342]: INFO nova.compute.manager [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Took 24.45 seconds to build instance.
Oct 16 10:10:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-952f9ff1-908a-4585-8a22-79404baaa21d tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "ca70fce9-392b-45d8-8fc7-5b37d8feba23" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 24.553s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:10:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "ca70fce9-392b-45d8-8fc7-5b37d8feba23" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 11.229s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:10:38 user nova-compute[74342]: INFO nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Oct 16 10:10:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "ca70fce9-392b-45d8-8fc7-5b37d8feba23" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:10:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:48 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b547349a-1126-4700-93ca-d39e1da5c5cd is timed out.
Oct 16 10:10:48 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Successfully detached device vdb from instance b547349a-1126-4700-93ca-d39e1da5c5cd from the live domain config.
Oct 16 10:10:48 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gwEHkDQj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:10:48 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:10:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[74292bd5-afcb-467c-a2d6-a591e83db925]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 10:10:48 user nova-compute[74342]: No targets found.
Oct 16 10:10:48 user nova-compute[74342]: iSNS:
Oct 16 10:10:48 user nova-compute[74342]: No targets found.
Oct 16 10:10:48 user nova-compute[74342]: STATIC:
Oct 16 10:10:48 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f
Oct 16 10:10:48 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:10:48 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:10:48 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c
Oct 16 10:10:48 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:10:48 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:10:48 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562
Oct 16 10:10:48 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:10:48 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:10:48 user nova-compute[74342]: FIRMWARE:
Oct 16 10:10:48 user nova-compute[74342]: No targets found.
Oct 16 10:10:48 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 10:10:48 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 10:10:48 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f64d2d6-31e3-45c9-8484-290c22e67c05]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3477c012-7041-4c41-be0e-5097b114189e]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)
Oct 16 10:10:48 user nova-compute[74342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c (non-flash)
Oct 16 10:10:48 user nova-compute[74342]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f (non-flash)
Oct 16 10:10:48 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)
Oct 16 10:10:48 user nova-compute[74342]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c (non-flash)
Oct 16 10:10:48 user nova-compute[74342]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f (non-flash)
Oct 16 10:10:48 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b6039a3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c'): ({'sdc'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Removing single pathed devices sdc {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c298f1-e0ab-4413-80c2-31036bc0906a]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa7e73c-d080-4dcf-b318-9c652e2921bc]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Flushing IO for device /dev/sdc {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[286b154e-3e80-4d84-bd0a-7a7d10994028]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df802f3-8f01-42cf-a456-4617990750f3]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] SCSI volumes sdc have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a55ec9-80bc-44cf-a698-f7706c51a991]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc1b96d-d0b1-42c4-9bb6-aea07b7aeedc]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c, portal: 172.16.0.220,3260]
Oct 16 10:10:48 user nova-compute[74342]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c, portal: 172.16.0.220,3260] successful.
Oct 16 10:10:48 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:1b013279-5cad-45f6-9990-d1ba46f84b8c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db5d959-b9fb-48b3-a793-b077fec8fed8]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] <== disconnect_volume: return (330ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 10:10:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:49 user nova-compute[74342]: DEBUG nova.objects.instance [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lazy-loading 'flavor' on Instance uuid b547349a-1126-4700-93ca-d39e1da5c5cd {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:10:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a9163090-708d-48f2-98af-36e1f618eb84 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "b547349a-1126-4700-93ca-d39e1da5c5cd" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.953s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:10:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:54 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:10:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:11:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:11:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:11:05 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:11:08 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:11:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:11:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:11:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:11:08 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:11:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:11:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:11:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:11:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:11:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:11:08 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 10:11:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5572a2a6-fc97-4355-bcf0-8ef41d83a0ac/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:11:09 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5572a2a6-fc97-4355-bcf0-8ef41d83a0ac/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:11:09 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5572a2a6-fc97-4355-bcf0-8ef41d83a0ac/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:11:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:11:09 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5572a2a6-fc97-4355-bcf0-8ef41d83a0ac/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:11:09 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 10:11:09 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:11:09 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:11:09 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:11:09 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:11:09 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:11:09 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:11:09 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:11:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:11:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:11:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:11:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:11:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:11:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:11:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:11:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:11:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:11:11 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:11:11 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:11:11 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8180MB free_disk=25.061756134033203GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:11:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:11:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:11:11 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 34ef7d18-0724-479a-8448-981b9cf0d6ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:11:11 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7d016ab3-14c4-4c33-bd50-468f71339cd7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:11:11 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance b547349a-1126-4700-93ca-d39e1da5c5cd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:11:11 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance e8b580f9-a3cd-418b-8878-d86a6bb0afc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:11:11 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance ca70fce9-392b-45d8-8fc7-5b37d8feba23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:11:11 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:11:11 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:11:11 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:11:11 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Refreshing inventories for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 10:11:11 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Updating ProviderTree inventory for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 10:11:11 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Updating inventory in ProviderTree for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 10:11:11 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Refreshing aggregate associations for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca, aggregates: None {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 10:11:11 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Refreshing trait associations for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 10:11:11 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:11:11 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:11:11 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:11:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.651s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:11:13 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:11:13 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:11:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:11:14 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:11:14 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:11:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-7d016ab3-14c4-4c33-bd50-468f71339cd7" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:11:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-7d016ab3-14c4-4c33-bd50-468f71339cd7" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:11:14 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:11:14 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Updating instance_info_cache with network_info: [{"id": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "address": "fa:16:3e:de:cb:e3", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74fa1b3-86", "ovs_interfaceid": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:11:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-7d016ab3-14c4-4c33-bd50-468f71339cd7" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:11:14 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:11:14 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:11:15 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:11:17 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:11:17 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:11:17 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:11:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:11:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:11:28 user nova-compute[74342]: DEBUG nova.compute.manager [None req-feb891bc-f95a-43fd-8465-45b33fd77af1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:11:28 user nova-compute[74342]: INFO nova.compute.manager [None req-feb891bc-f95a-43fd-8465-45b33fd77af1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] instance snapshotting
Oct 16 10:11:28 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-feb891bc-f95a-43fd-8465-45b33fd77af1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Beginning live snapshot process
Oct 16 10:11:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-feb891bc-f95a-43fd-8465-45b33fd77af1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json -f qcow2 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:11:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-feb891bc-f95a-43fd-8465-45b33fd77af1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:11:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-feb891bc-f95a-43fd-8465-45b33fd77af1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json -f qcow2 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:11:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-feb891bc-f95a-43fd-8465-45b33fd77af1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json -f qcow2" returned: 0 in 0.198s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:11:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-feb891bc-f95a-43fd-8465-45b33fd77af1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:11:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-feb891bc-f95a-43fd-8465-45b33fd77af1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.175s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:11:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-feb891bc-f95a-43fd-8465-45b33fd77af1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpi7be6i2s/3a77eadf671b4133914e5110707a22e3.delta 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:11:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-feb891bc-f95a-43fd-8465-45b33fd77af1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpi7be6i2s/3a77eadf671b4133914e5110707a22e3.delta 1073741824" returned: 0 in 0.046s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:11:28 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-feb891bc-f95a-43fd-8465-45b33fd77af1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Quiescing instance not available: QEMU guest agent is not enabled.
Oct 16 10:11:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:11:29 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-feb891bc-f95a-43fd-8465-45b33fd77af1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=74342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 10:11:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-feb891bc-f95a-43fd-8465-45b33fd77af1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=74342) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Oct 16 10:11:30 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-feb891bc-f95a-43fd-8465-45b33fd77af1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Skipping quiescing instance: QEMU guest agent is not enabled.
Oct 16 10:11:30 user nova-compute[74342]: DEBUG nova.privsep.utils [None req-feb891bc-f95a-43fd-8465-45b33fd77af1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 10:11:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-feb891bc-f95a-43fd-8465-45b33fd77af1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpi7be6i2s/3a77eadf671b4133914e5110707a22e3.delta /opt/stack/data/nova/instances/snapshots/tmpi7be6i2s/3a77eadf671b4133914e5110707a22e3 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:11:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-feb891bc-f95a-43fd-8465-45b33fd77af1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpi7be6i2s/3a77eadf671b4133914e5110707a22e3.delta /opt/stack/data/nova/instances/snapshots/tmpi7be6i2s/3a77eadf671b4133914e5110707a22e3" returned: 0 in 0.408s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:11:30 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-feb891bc-f95a-43fd-8465-45b33fd77af1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Snapshot extracted, beginning image upload
Oct 16 10:11:33 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-feb891bc-f95a-43fd-8465-45b33fd77af1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Snapshot image upload complete
Oct 16 10:11:33 user nova-compute[74342]: INFO nova.compute.manager [None req-feb891bc-f95a-43fd-8465-45b33fd77af1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Took 5.24 seconds to snapshot the instance on the hypervisor.
Oct 16 10:11:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:11:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "03f1f3a1-a62a-4f58-aa70-50b42bf35110" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:11:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "03f1f3a1-a62a-4f58-aa70-50b42bf35110" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:11:35 user nova-compute[74342]: DEBUG nova.compute.manager [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 10:11:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:11:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:11:35 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 10:11:35 user nova-compute[74342]: INFO nova.compute.claims [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Claim successful on node user
Oct 16 10:11:36 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:11:36 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:11:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:11:36 user nova-compute[74342]: DEBUG nova.compute.manager [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 10:11:36 user nova-compute[74342]: DEBUG nova.compute.manager [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 10:11:36 user nova-compute[74342]: DEBUG nova.network.neutron [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 10:11:36 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 10:11:36 user nova-compute[74342]: DEBUG nova.compute.manager [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 10:11:36 user nova-compute[74342]: DEBUG nova.policy [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '122de085fe2d46d18ff8fff362bf7cf5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5f185c7dee6c4e7f8fe0d7bb2e89e854', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 10:11:36 user nova-compute[74342]: DEBUG nova.compute.manager [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 10:11:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 10:11:36 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Creating image(s)
Oct 16 10:11:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "/opt/stack/data/nova/instances/03f1f3a1-a62a-4f58-aa70-50b42bf35110/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:11:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "/opt/stack/data/nova/instances/03f1f3a1-a62a-4f58-aa70-50b42bf35110/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:11:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "/opt/stack/data/nova/instances/03f1f3a1-a62a-4f58-aa70-50b42bf35110/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:11:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "054d9bb67d2a0fdc1e425ba0b5b6c0648a104971" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:11:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "054d9bb67d2a0fdc1e425ba0b5b6c0648a104971" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:11:37 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/054d9bb67d2a0fdc1e425ba0b5b6c0648a104971.part --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:11:37 user nova-compute[74342]: DEBUG nova.network.neutron [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Successfully created port: 98f36e3c-3285-441a-9258-053b29ffa846 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 10:11:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:11:37 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/054d9bb67d2a0fdc1e425ba0b5b6c0648a104971.part --force-share --output=json" returned: 0 in 0.173s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:11:37 user nova-compute[74342]: DEBUG nova.virt.images [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] 3cb0d9b0-8f78-4756-b63c-b2e7817d4d5d was qcow2, converting to raw {{(pid=74342) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 10:11:37 user nova-compute[74342]: DEBUG nova.privsep.utils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 10:11:37 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/054d9bb67d2a0fdc1e425ba0b5b6c0648a104971.part /opt/stack/data/nova/instances/_base/054d9bb67d2a0fdc1e425ba0b5b6c0648a104971.converted {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/054d9bb67d2a0fdc1e425ba0b5b6c0648a104971.part /opt/stack/data/nova/instances/_base/054d9bb67d2a0fdc1e425ba0b5b6c0648a104971.converted" returned: 0 in 0.416s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/054d9bb67d2a0fdc1e425ba0b5b6c0648a104971.converted --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG nova.network.neutron [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Successfully updated port: 98f36e3c-3285-441a-9258-053b29ffa846 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "refresh_cache-03f1f3a1-a62a-4f58-aa70-50b42bf35110" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquired lock "refresh_cache-03f1f3a1-a62a-4f58-aa70-50b42bf35110" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG nova.network.neutron [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG nova.compute.manager [req-5d8e6492-41ae-4200-81f0-aa4239c0b6a1 req-7ddff899-166f-4e03-a19e-ac553a89da77 service nova] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Received event network-changed-98f36e3c-3285-441a-9258-053b29ffa846 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG nova.compute.manager [req-5d8e6492-41ae-4200-81f0-aa4239c0b6a1 req-7ddff899-166f-4e03-a19e-ac553a89da77 service nova] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Refreshing instance network info cache due to event network-changed-98f36e3c-3285-441a-9258-053b29ffa846. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5d8e6492-41ae-4200-81f0-aa4239c0b6a1 req-7ddff899-166f-4e03-a19e-ac553a89da77 service nova] Acquiring lock "refresh_cache-03f1f3a1-a62a-4f58-aa70-50b42bf35110" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/054d9bb67d2a0fdc1e425ba0b5b6c0648a104971.converted --force-share --output=json" returned: 0 in 0.219s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "054d9bb67d2a0fdc1e425ba0b5b6c0648a104971" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.870s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/054d9bb67d2a0fdc1e425ba0b5b6c0648a104971 --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG nova.network.neutron [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/054d9bb67d2a0fdc1e425ba0b5b6c0648a104971 --force-share --output=json" returned: 0 in 0.203s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "054d9bb67d2a0fdc1e425ba0b5b6c0648a104971" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "054d9bb67d2a0fdc1e425ba0b5b6c0648a104971" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/054d9bb67d2a0fdc1e425ba0b5b6c0648a104971 --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG nova.network.neutron [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Updating instance_info_cache with network_info: [{"id": "98f36e3c-3285-441a-9258-053b29ffa846", "address": "fa:16:3e:f7:c8:3a", "network": {"id": "ca9b5a27-87ee-46f0-a771-1ba5925e04de", "bridge": "br-int", "label": "tempest-TestStampPattern-847672181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f185c7dee6c4e7f8fe0d7bb2e89e854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f36e3c-32", "ovs_interfaceid": "98f36e3c-3285-441a-9258-053b29ffa846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Releasing lock "refresh_cache-03f1f3a1-a62a-4f58-aa70-50b42bf35110" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG nova.compute.manager [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Instance network_info: |[{"id": "98f36e3c-3285-441a-9258-053b29ffa846", "address": "fa:16:3e:f7:c8:3a", "network": {"id": "ca9b5a27-87ee-46f0-a771-1ba5925e04de", "bridge": "br-int", "label": "tempest-TestStampPattern-847672181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f185c7dee6c4e7f8fe0d7bb2e89e854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f36e3c-32", "ovs_interfaceid": "98f36e3c-3285-441a-9258-053b29ffa846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5d8e6492-41ae-4200-81f0-aa4239c0b6a1 req-7ddff899-166f-4e03-a19e-ac553a89da77 service nova] Acquired lock "refresh_cache-03f1f3a1-a62a-4f58-aa70-50b42bf35110" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG nova.network.neutron [req-5d8e6492-41ae-4200-81f0-aa4239c0b6a1 req-7ddff899-166f-4e03-a19e-ac553a89da77 service nova] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Refreshing network info cache for port 98f36e3c-3285-441a-9258-053b29ffa846 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/054d9bb67d2a0fdc1e425ba0b5b6c0648a104971 --force-share --output=json" returned: 0 in 0.180s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/054d9bb67d2a0fdc1e425ba0b5b6c0648a104971,backing_fmt=raw /opt/stack/data/nova/instances/03f1f3a1-a62a-4f58-aa70-50b42bf35110/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/054d9bb67d2a0fdc1e425ba0b5b6c0648a104971,backing_fmt=raw /opt/stack/data/nova/instances/03f1f3a1-a62a-4f58-aa70-50b42bf35110/disk 1073741824" returned: 0 in 0.052s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "054d9bb67d2a0fdc1e425ba0b5b6c0648a104971" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/054d9bb67d2a0fdc1e425ba0b5b6c0648a104971 --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/054d9bb67d2a0fdc1e425ba0b5b6c0648a104971 --force-share --output=json" returned: 0 in 0.188s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Ensure instance console log exists: /opt/stack/data/nova/instances/03f1f3a1-a62a-4f58-aa70-50b42bf35110/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:11:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Start _get_guest_xml network_info=[{"id": "98f36e3c-3285-441a-9258-053b29ffa846", "address": "fa:16:3e:f7:c8:3a", "network": {"id": "ca9b5a27-87ee-46f0-a771-1ba5925e04de", "bridge": "br-int", "label": "tempest-TestStampPattern-847672181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f185c7dee6c4e7f8fe0d7bb2e89e854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f36e3c-32", "ovs_interfaceid": "98f36e3c-3285-441a-9258-053b29ffa846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='cf7728a0b1e5474422e46c5a3e7ab84e',container_format='bare',created_at=2023-10-16T10:11:28Z,direct_url=<?>,disk_format='qcow2',id=3cb0d9b0-8f78-4756-b63c-b2e7817d4d5d,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-142395312',owner='5f185c7dee6c4e7f8fe0d7bb2e89e854',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-16T10:11:33Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '3cb0d9b0-8f78-4756-b63c-b2e7817d4d5d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 10:11:39 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:11:39 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:11:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='cf7728a0b1e5474422e46c5a3e7ab84e',container_format='bare',created_at=2023-10-16T10:11:28Z,direct_url=<?>,disk_format='qcow2',id=3cb0d9b0-8f78-4756-b63c-b2e7817d4d5d,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-142395312',owner='5f185c7dee6c4e7f8fe0d7bb2e89e854',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-10-16T10:11:33Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:11:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1555382164',display_name='tempest-TestStampPattern-server-1555382164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1555382164',id=45,image_ref='3cb0d9b0-8f78-4756-b63c-b2e7817d4d5d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqaEvE2WxtZyUpj/QXmrU1PYxONwCsPW4U4I5X6LON7fZWTJ1Ui7jNxiJSotZ6hnR+YMLAgOjTfsC+JoMGOfw8b+qKTBDFop/S0eo6Ga/23kvhrgO0ezrKiqFMkS1cH3w==',key_name='tempest-TestStampPattern-174449930',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f185c7dee6c4e7f8fe0d7bb2e89e854',ramdisk_id='',reservation_id='r-mzxm26fy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b547349a-1126-4700-93ca-d39e1da5c5cd',image_min_disk='1',image_min_ram='0',image_owner_id='5f185c7dee6c4e7f8fe0d7bb2e89e854',image_owner_project_name='tempest-TestStampPattern-1468188741',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1468188741-project-member',image_user_id='122de085fe2d46d18ff8fff362bf7cf5',network_allocated='True',owner_project_name='tempest-TestStampPattern-1468188741',owner_user_name='tempest-TestStampPattern-1468188741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:11:36Z,user_data=None,user_id='122de085fe2d46d18ff8fff362bf7cf5',uuid=03f1f3a1-a62a-4f58-aa70-50b42bf35110,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98f36e3c-3285-441a-9258-053b29ffa846", "address": "fa:16:3e:f7:c8:3a", "network": {"id": "ca9b5a27-87ee-46f0-a771-1ba5925e04de", "bridge": "br-int", "label": "tempest-TestStampPattern-847672181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f185c7dee6c4e7f8fe0d7bb2e89e854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f36e3c-32", "ovs_interfaceid": "98f36e3c-3285-441a-9258-053b29ffa846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Converting VIF {"id": "98f36e3c-3285-441a-9258-053b29ffa846", "address": "fa:16:3e:f7:c8:3a", "network": {"id": "ca9b5a27-87ee-46f0-a771-1ba5925e04de", "bridge": "br-int", "label": "tempest-TestStampPattern-847672181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f185c7dee6c4e7f8fe0d7bb2e89e854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f36e3c-32", "ovs_interfaceid": "98f36e3c-3285-441a-9258-053b29ffa846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:c8:3a,bridge_name='br-int',has_traffic_filtering=True,id=98f36e3c-3285-441a-9258-053b29ffa846,network=Network(ca9b5a27-87ee-46f0-a771-1ba5925e04de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98f36e3c-32') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG nova.objects.instance [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lazy-loading 'pci_devices' on Instance uuid 03f1f3a1-a62a-4f58-aa70-50b42bf35110 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] End _get_guest_xml xml=<domain type="kvm">
Oct 16 10:11:39 user nova-compute[74342]:   <uuid>03f1f3a1-a62a-4f58-aa70-50b42bf35110</uuid>
Oct 16 10:11:39 user nova-compute[74342]:   <name>instance-0000002d</name>
Oct 16 10:11:39 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 10:11:39 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 10:11:39 user nova-compute[74342]:   <metadata>
Oct 16 10:11:39 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 10:11:39 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 10:11:39 user nova-compute[74342]:       <nova:name>tempest-TestStampPattern-server-1555382164</nova:name>
Oct 16 10:11:39 user nova-compute[74342]:       <nova:creationTime>2023-10-16 10:11:39</nova:creationTime>
Oct 16 10:11:39 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 10:11:39 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 10:11:39 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 10:11:39 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 10:11:39 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 10:11:39 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 10:11:39 user nova-compute[74342]:       </nova:flavor>
Oct 16 10:11:39 user nova-compute[74342]:       <nova:owner>
Oct 16 10:11:39 user nova-compute[74342]:         <nova:user uuid="122de085fe2d46d18ff8fff362bf7cf5">tempest-TestStampPattern-1468188741-project-member</nova:user>
Oct 16 10:11:39 user nova-compute[74342]:         <nova:project uuid="5f185c7dee6c4e7f8fe0d7bb2e89e854">tempest-TestStampPattern-1468188741</nova:project>
Oct 16 10:11:39 user nova-compute[74342]:       </nova:owner>
Oct 16 10:11:39 user nova-compute[74342]:       <nova:root type="image" uuid="3cb0d9b0-8f78-4756-b63c-b2e7817d4d5d"/>
Oct 16 10:11:39 user nova-compute[74342]:       <nova:ports>
Oct 16 10:11:39 user nova-compute[74342]:         <nova:port uuid="98f36e3c-3285-441a-9258-053b29ffa846">
Oct 16 10:11:39 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 16 10:11:39 user nova-compute[74342]:         </nova:port>
Oct 16 10:11:39 user nova-compute[74342]:       </nova:ports>
Oct 16 10:11:39 user nova-compute[74342]:     </nova:instance>
Oct 16 10:11:39 user nova-compute[74342]:   </metadata>
Oct 16 10:11:39 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 10:11:39 user nova-compute[74342]:     <system>
Oct 16 10:11:39 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 10:11:39 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 10:11:39 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 10:11:39 user nova-compute[74342]:       <entry name="serial">03f1f3a1-a62a-4f58-aa70-50b42bf35110</entry>
Oct 16 10:11:39 user nova-compute[74342]:       <entry name="uuid">03f1f3a1-a62a-4f58-aa70-50b42bf35110</entry>
Oct 16 10:11:39 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 10:11:39 user nova-compute[74342]:     </system>
Oct 16 10:11:39 user nova-compute[74342]:   </sysinfo>
Oct 16 10:11:39 user nova-compute[74342]:   <os>
Oct 16 10:11:39 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 10:11:39 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 10:11:39 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 10:11:39 user nova-compute[74342]:   </os>
Oct 16 10:11:39 user nova-compute[74342]:   <features>
Oct 16 10:11:39 user nova-compute[74342]:     <acpi/>
Oct 16 10:11:39 user nova-compute[74342]:     <apic/>
Oct 16 10:11:39 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 10:11:39 user nova-compute[74342]:   </features>
Oct 16 10:11:39 user nova-compute[74342]:   <clock offset="utc">
Oct 16 10:11:39 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 10:11:39 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 10:11:39 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 10:11:39 user nova-compute[74342]:   </clock>
Oct 16 10:11:39 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 10:11:39 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 10:11:39 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 10:11:39 user nova-compute[74342]:   </cpu>
Oct 16 10:11:39 user nova-compute[74342]:   <devices>
Oct 16 10:11:39 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 10:11:39 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 10:11:39 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/03f1f3a1-a62a-4f58-aa70-50b42bf35110/disk"/>
Oct 16 10:11:39 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 10:11:39 user nova-compute[74342]:     </disk>
Oct 16 10:11:39 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 10:11:39 user nova-compute[74342]:       <mac address="fa:16:3e:f7:c8:3a"/>
Oct 16 10:11:39 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:11:39 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 10:11:39 user nova-compute[74342]:       <target dev="tap98f36e3c-32"/>
Oct 16 10:11:39 user nova-compute[74342]:     </interface>
Oct 16 10:11:39 user nova-compute[74342]:     <serial type="pty">
Oct 16 10:11:39 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/03f1f3a1-a62a-4f58-aa70-50b42bf35110/console.log" append="off"/>
Oct 16 10:11:39 user nova-compute[74342]:     </serial>
Oct 16 10:11:39 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 10:11:39 user nova-compute[74342]:     <video>
Oct 16 10:11:39 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:11:39 user nova-compute[74342]:     </video>
Oct 16 10:11:39 user nova-compute[74342]:     <rng model="virtio">
Oct 16 10:11:39 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 10:11:39 user nova-compute[74342]:     </rng>
Oct 16 10:11:39 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 10:11:39 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 10:11:39 user nova-compute[74342]:       <stats period="10"/>
Oct 16 10:11:39 user nova-compute[74342]:     </memballoon>
Oct 16 10:11:39 user nova-compute[74342]:   </devices>
Oct 16 10:11:39 user nova-compute[74342]: </domain>
Oct 16 10:11:39 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:11:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1555382164',display_name='tempest-TestStampPattern-server-1555382164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1555382164',id=45,image_ref='3cb0d9b0-8f78-4756-b63c-b2e7817d4d5d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqaEvE2WxtZyUpj/QXmrU1PYxONwCsPW4U4I5X6LON7fZWTJ1Ui7jNxiJSotZ6hnR+YMLAgOjTfsC+JoMGOfw8b+qKTBDFop/S0eo6Ga/23kvhrgO0ezrKiqFMkS1cH3w==',key_name='tempest-TestStampPattern-174449930',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='5f185c7dee6c4e7f8fe0d7bb2e89e854',ramdisk_id='',reservation_id='r-mzxm26fy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b547349a-1126-4700-93ca-d39e1da5c5cd',image_min_disk='1',image_min_ram='0',image_owner_id='5f185c7dee6c4e7f8fe0d7bb2e89e854',image_owner_project_name='tempest-TestStampPattern-1468188741',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1468188741-project-member',image_user_id='122de085fe2d46d18ff8fff362bf7cf5',network_allocated='True',owner_project_name='tempest-TestStampPattern-1468188741',owner_user_name='tempest-TestStampPattern-1468188741-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:11:36Z,user_data=None,user_id='122de085fe2d46d18ff8fff362bf7cf5',uuid=03f1f3a1-a62a-4f58-aa70-50b42bf35110,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "98f36e3c-3285-441a-9258-053b29ffa846", "address": "fa:16:3e:f7:c8:3a", "network": {"id": "ca9b5a27-87ee-46f0-a771-1ba5925e04de", "bridge": "br-int", "label": "tempest-TestStampPattern-847672181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f185c7dee6c4e7f8fe0d7bb2e89e854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f36e3c-32", "ovs_interfaceid": "98f36e3c-3285-441a-9258-053b29ffa846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Converting VIF {"id": "98f36e3c-3285-441a-9258-053b29ffa846", "address": "fa:16:3e:f7:c8:3a", "network": {"id": "ca9b5a27-87ee-46f0-a771-1ba5925e04de", "bridge": "br-int", "label": "tempest-TestStampPattern-847672181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f185c7dee6c4e7f8fe0d7bb2e89e854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f36e3c-32", "ovs_interfaceid": "98f36e3c-3285-441a-9258-053b29ffa846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:c8:3a,bridge_name='br-int',has_traffic_filtering=True,id=98f36e3c-3285-441a-9258-053b29ffa846,network=Network(ca9b5a27-87ee-46f0-a771-1ba5925e04de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98f36e3c-32') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG os_vif [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:c8:3a,bridge_name='br-int',has_traffic_filtering=True,id=98f36e3c-3285-441a-9258-053b29ffa846,network=Network(ca9b5a27-87ee-46f0-a771-1ba5925e04de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98f36e3c-32') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7cd98d3f-339a-5df2-b008-671eb8da1abc', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap98f36e3c-32, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap98f36e3c-32, col_values=(('qos', UUID('76b135d0-f84c-46e5-b007-082adca95314')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap98f36e3c-32, col_values=(('external_ids', {'iface-id': '98f36e3c-3285-441a-9258-053b29ffa846', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:c8:3a', 'vm-uuid': '03f1f3a1-a62a-4f58-aa70-50b42bf35110'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:11:39 user nova-compute[74342]: INFO os_vif [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:c8:3a,bridge_name='br-int',has_traffic_filtering=True,id=98f36e3c-3285-441a-9258-053b29ffa846,network=Network(ca9b5a27-87ee-46f0-a771-1ba5925e04de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98f36e3c-32')
Oct 16 10:11:39 user nova-compute[74342]: DEBUG nova.network.neutron [req-5d8e6492-41ae-4200-81f0-aa4239c0b6a1 req-7ddff899-166f-4e03-a19e-ac553a89da77 service nova] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Updated VIF entry in instance network info cache for port 98f36e3c-3285-441a-9258-053b29ffa846. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG nova.network.neutron [req-5d8e6492-41ae-4200-81f0-aa4239c0b6a1 req-7ddff899-166f-4e03-a19e-ac553a89da77 service nova] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Updating instance_info_cache with network_info: [{"id": "98f36e3c-3285-441a-9258-053b29ffa846", "address": "fa:16:3e:f7:c8:3a", "network": {"id": "ca9b5a27-87ee-46f0-a771-1ba5925e04de", "bridge": "br-int", "label": "tempest-TestStampPattern-847672181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f185c7dee6c4e7f8fe0d7bb2e89e854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f36e3c-32", "ovs_interfaceid": "98f36e3c-3285-441a-9258-053b29ffa846", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-5d8e6492-41ae-4200-81f0-aa4239c0b6a1 req-7ddff899-166f-4e03-a19e-ac553a89da77 service nova] Releasing lock "refresh_cache-03f1f3a1-a62a-4f58-aa70-50b42bf35110" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:11:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] No VIF found with MAC fa:16:3e:f7:c8:3a, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:11:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:11:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:11:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:11:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:11:40 user nova-compute[74342]: DEBUG nova.compute.manager [req-eaf5530b-d4e5-40d9-8dc5-1413772cb652 req-df10e576-9420-45f4-9f64-afa0d20c067f service nova] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Received event network-vif-plugged-98f36e3c-3285-441a-9258-053b29ffa846 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:11:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-eaf5530b-d4e5-40d9-8dc5-1413772cb652 req-df10e576-9420-45f4-9f64-afa0d20c067f service nova] Acquiring lock "03f1f3a1-a62a-4f58-aa70-50b42bf35110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:11:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-eaf5530b-d4e5-40d9-8dc5-1413772cb652 req-df10e576-9420-45f4-9f64-afa0d20c067f service nova] Lock "03f1f3a1-a62a-4f58-aa70-50b42bf35110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:11:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-eaf5530b-d4e5-40d9-8dc5-1413772cb652 req-df10e576-9420-45f4-9f64-afa0d20c067f service nova] Lock "03f1f3a1-a62a-4f58-aa70-50b42bf35110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:11:40 user nova-compute[74342]: DEBUG nova.compute.manager [req-eaf5530b-d4e5-40d9-8dc5-1413772cb652 req-df10e576-9420-45f4-9f64-afa0d20c067f service nova] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] No waiting events found dispatching network-vif-plugged-98f36e3c-3285-441a-9258-053b29ffa846 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:11:40 user nova-compute[74342]: WARNING nova.compute.manager [req-eaf5530b-d4e5-40d9-8dc5-1413772cb652 req-df10e576-9420-45f4-9f64-afa0d20c067f service nova] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Received unexpected event network-vif-plugged-98f36e3c-3285-441a-9258-053b29ffa846 for instance with vm_state building and task_state spawning.
Oct 16 10:11:42 user nova-compute[74342]: DEBUG nova.compute.manager [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 10:11:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 10:11:42 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Instance spawned successfully.
Oct 16 10:11:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 10:11:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:11:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:11:42 user nova-compute[74342]: INFO nova.compute.manager [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Took 6.38 seconds to spawn the instance on the hypervisor.
Oct 16 10:11:42 user nova-compute[74342]: DEBUG nova.compute.manager [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:11:42 user nova-compute[74342]: INFO nova.compute.manager [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Took 7.11 seconds to build instance.
Oct 16 10:11:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-359e8b2d-8842-4487-8649-11e5d6f70fb3 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "03f1f3a1-a62a-4f58-aa70-50b42bf35110" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.219s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:11:42 user nova-compute[74342]: DEBUG nova.compute.manager [req-2ddd6534-96e5-4479-9b4c-0674a1b4dc02 req-f769b18e-365f-47cb-87f1-3eb8f4c9289c service nova] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Received event network-vif-plugged-98f36e3c-3285-441a-9258-053b29ffa846 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:11:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-2ddd6534-96e5-4479-9b4c-0674a1b4dc02 req-f769b18e-365f-47cb-87f1-3eb8f4c9289c service nova] Acquiring lock "03f1f3a1-a62a-4f58-aa70-50b42bf35110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:11:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-2ddd6534-96e5-4479-9b4c-0674a1b4dc02 req-f769b18e-365f-47cb-87f1-3eb8f4c9289c service nova] Lock "03f1f3a1-a62a-4f58-aa70-50b42bf35110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:11:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-2ddd6534-96e5-4479-9b4c-0674a1b4dc02 req-f769b18e-365f-47cb-87f1-3eb8f4c9289c service nova] Lock "03f1f3a1-a62a-4f58-aa70-50b42bf35110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:11:42 user nova-compute[74342]: DEBUG nova.compute.manager [req-2ddd6534-96e5-4479-9b4c-0674a1b4dc02 req-f769b18e-365f-47cb-87f1-3eb8f4c9289c service nova] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] No waiting events found dispatching network-vif-plugged-98f36e3c-3285-441a-9258-053b29ffa846 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:11:42 user nova-compute[74342]: WARNING nova.compute.manager [req-2ddd6534-96e5-4479-9b4c-0674a1b4dc02 req-f769b18e-365f-47cb-87f1-3eb8f4c9289c service nova] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Received unexpected event network-vif-plugged-98f36e3c-3285-441a-9258-053b29ffa846 for instance with vm_state active and task_state None.
Oct 16 10:11:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:11:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:11:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:11:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:11:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:11:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:11:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:11:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:11:54 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:11:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:11:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:02 user nova-compute[74342]: INFO nova.compute.manager [None req-d73aa2dd-c134-4b6a-b5d7-efc83eb7d045 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Unrescuing
Oct 16 10:12:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d73aa2dd-c134-4b6a-b5d7-efc83eb7d045 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "refresh_cache-34ef7d18-0724-479a-8448-981b9cf0d6ab" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:12:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d73aa2dd-c134-4b6a-b5d7-efc83eb7d045 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquired lock "refresh_cache-34ef7d18-0724-479a-8448-981b9cf0d6ab" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:12:02 user nova-compute[74342]: DEBUG nova.network.neutron [None req-d73aa2dd-c134-4b6a-b5d7-efc83eb7d045 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:12:02 user nova-compute[74342]: DEBUG nova.network.neutron [None req-d73aa2dd-c134-4b6a-b5d7-efc83eb7d045 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Updating instance_info_cache with network_info: [{"id": "1495980a-a474-4a07-a8d1-27521ae89be7", "address": "fa:16:3e:0e:3e:44", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1495980a-a4", "ovs_interfaceid": "1495980a-a474-4a07-a8d1-27521ae89be7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:12:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d73aa2dd-c134-4b6a-b5d7-efc83eb7d045 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Releasing lock "refresh_cache-34ef7d18-0724-479a-8448-981b9cf0d6ab" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:12:02 user nova-compute[74342]: DEBUG nova.objects.instance [None req-d73aa2dd-c134-4b6a-b5d7-efc83eb7d045 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lazy-loading 'flavor' on Instance uuid 34ef7d18-0724-479a-8448-981b9cf0d6ab {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:12:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:03 user nova-compute[74342]: DEBUG nova.compute.manager [req-0a8748f6-5833-4909-9321-af9022acd491 req-fb31b29a-c626-43ea-a111-38c0561295f5 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Received event network-vif-unplugged-1495980a-a474-4a07-a8d1-27521ae89be7 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:12:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0a8748f6-5833-4909-9321-af9022acd491 req-fb31b29a-c626-43ea-a111-38c0561295f5 service nova] Acquiring lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:12:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0a8748f6-5833-4909-9321-af9022acd491 req-fb31b29a-c626-43ea-a111-38c0561295f5 service nova] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:12:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0a8748f6-5833-4909-9321-af9022acd491 req-fb31b29a-c626-43ea-a111-38c0561295f5 service nova] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:12:03 user nova-compute[74342]: DEBUG nova.compute.manager [req-0a8748f6-5833-4909-9321-af9022acd491 req-fb31b29a-c626-43ea-a111-38c0561295f5 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] No waiting events found dispatching network-vif-unplugged-1495980a-a474-4a07-a8d1-27521ae89be7 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:12:03 user nova-compute[74342]: WARNING nova.compute.manager [req-0a8748f6-5833-4909-9321-af9022acd491 req-fb31b29a-c626-43ea-a111-38c0561295f5 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Received unexpected event network-vif-unplugged-1495980a-a474-4a07-a8d1-27521ae89be7 for instance with vm_state rescued and task_state unrescuing.
Oct 16 10:12:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:03 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Instance destroyed successfully.
Oct 16 10:12:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:05 user nova-compute[74342]: DEBUG nova.compute.manager [req-7648df6f-335c-4739-a61e-d0f26d96735e req-4156fb73-81c5-449b-af4f-0ce56f46b792 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Received event network-vif-plugged-1495980a-a474-4a07-a8d1-27521ae89be7 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:12:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-7648df6f-335c-4739-a61e-d0f26d96735e req-4156fb73-81c5-449b-af4f-0ce56f46b792 service nova] Acquiring lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:12:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-7648df6f-335c-4739-a61e-d0f26d96735e req-4156fb73-81c5-449b-af4f-0ce56f46b792 service nova] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:12:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-7648df6f-335c-4739-a61e-d0f26d96735e req-4156fb73-81c5-449b-af4f-0ce56f46b792 service nova] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:12:05 user nova-compute[74342]: DEBUG nova.compute.manager [req-7648df6f-335c-4739-a61e-d0f26d96735e req-4156fb73-81c5-449b-af4f-0ce56f46b792 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] No waiting events found dispatching network-vif-plugged-1495980a-a474-4a07-a8d1-27521ae89be7 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:12:05 user nova-compute[74342]: WARNING nova.compute.manager [req-7648df6f-335c-4739-a61e-d0f26d96735e req-4156fb73-81c5-449b-af4f-0ce56f46b792 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Received unexpected event network-vif-plugged-1495980a-a474-4a07-a8d1-27521ae89be7 for instance with vm_state rescued and task_state unrescuing.
Oct 16 10:12:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG nova.compute.manager [req-0509bb2a-66d1-4cfd-b722-b207e5829283 req-c83d1b8b-87ad-4583-aab3-62224a74e13e service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Received event network-vif-plugged-1495980a-a474-4a07-a8d1-27521ae89be7 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0509bb2a-66d1-4cfd-b722-b207e5829283 req-c83d1b8b-87ad-4583-aab3-62224a74e13e service nova] Acquiring lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0509bb2a-66d1-4cfd-b722-b207e5829283 req-c83d1b8b-87ad-4583-aab3-62224a74e13e service nova] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0509bb2a-66d1-4cfd-b722-b207e5829283 req-c83d1b8b-87ad-4583-aab3-62224a74e13e service nova] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG nova.compute.manager [req-0509bb2a-66d1-4cfd-b722-b207e5829283 req-c83d1b8b-87ad-4583-aab3-62224a74e13e service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] No waiting events found dispatching network-vif-plugged-1495980a-a474-4a07-a8d1-27521ae89be7 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:12:07 user nova-compute[74342]: WARNING nova.compute.manager [req-0509bb2a-66d1-4cfd-b722-b207e5829283 req-c83d1b8b-87ad-4583-aab3-62224a74e13e service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Received unexpected event network-vif-plugged-1495980a-a474-4a07-a8d1-27521ae89be7 for instance with vm_state rescued and task_state unrescuing.
Oct 16 10:12:07 user nova-compute[74342]: DEBUG nova.compute.manager [req-0509bb2a-66d1-4cfd-b722-b207e5829283 req-c83d1b8b-87ad-4583-aab3-62224a74e13e service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Received event network-vif-plugged-1495980a-a474-4a07-a8d1-27521ae89be7 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0509bb2a-66d1-4cfd-b722-b207e5829283 req-c83d1b8b-87ad-4583-aab3-62224a74e13e service nova] Acquiring lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0509bb2a-66d1-4cfd-b722-b207e5829283 req-c83d1b8b-87ad-4583-aab3-62224a74e13e service nova] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0509bb2a-66d1-4cfd-b722-b207e5829283 req-c83d1b8b-87ad-4583-aab3-62224a74e13e service nova] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG nova.compute.manager [req-0509bb2a-66d1-4cfd-b722-b207e5829283 req-c83d1b8b-87ad-4583-aab3-62224a74e13e service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] No waiting events found dispatching network-vif-plugged-1495980a-a474-4a07-a8d1-27521ae89be7 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:12:07 user nova-compute[74342]: WARNING nova.compute.manager [req-0509bb2a-66d1-4cfd-b722-b207e5829283 req-c83d1b8b-87ad-4583-aab3-62224a74e13e service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Received unexpected event network-vif-plugged-1495980a-a474-4a07-a8d1-27521ae89be7 for instance with vm_state rescued and task_state unrescuing.
Oct 16 10:12:07 user nova-compute[74342]: DEBUG nova.compute.manager [req-0509bb2a-66d1-4cfd-b722-b207e5829283 req-c83d1b8b-87ad-4583-aab3-62224a74e13e service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Received event network-changed-8b2cad16-9a51-4bb9-9e32-1e309c9c2107 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG nova.compute.manager [req-0509bb2a-66d1-4cfd-b722-b207e5829283 req-c83d1b8b-87ad-4583-aab3-62224a74e13e service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Refreshing instance network info cache due to event network-changed-8b2cad16-9a51-4bb9-9e32-1e309c9c2107. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0509bb2a-66d1-4cfd-b722-b207e5829283 req-c83d1b8b-87ad-4583-aab3-62224a74e13e service nova] Acquiring lock "refresh_cache-ca70fce9-392b-45d8-8fc7-5b37d8feba23" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0509bb2a-66d1-4cfd-b722-b207e5829283 req-c83d1b8b-87ad-4583-aab3-62224a74e13e service nova] Acquired lock "refresh_cache-ca70fce9-392b-45d8-8fc7-5b37d8feba23" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG nova.network.neutron [req-0509bb2a-66d1-4cfd-b722-b207e5829283 req-c83d1b8b-87ad-4583-aab3-62224a74e13e service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Refreshing network info cache for port 8b2cad16-9a51-4bb9-9e32-1e309c9c2107 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "ca70fce9-392b-45d8-8fc7-5b37d8feba23" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "ca70fce9-392b-45d8-8fc7-5b37d8feba23" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "ca70fce9-392b-45d8-8fc7-5b37d8feba23-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "ca70fce9-392b-45d8-8fc7-5b37d8feba23-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "ca70fce9-392b-45d8-8fc7-5b37d8feba23-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:12:07 user nova-compute[74342]: INFO nova.compute.manager [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Terminating instance
Oct 16 10:12:07 user nova-compute[74342]: DEBUG nova.compute.manager [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG nova.compute.manager [None req-d73aa2dd-c134-4b6a-b5d7-efc83eb7d045 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG nova.network.neutron [req-0509bb2a-66d1-4cfd-b722-b207e5829283 req-c83d1b8b-87ad-4583-aab3-62224a74e13e service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Updated VIF entry in instance network info cache for port 8b2cad16-9a51-4bb9-9e32-1e309c9c2107. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG nova.network.neutron [req-0509bb2a-66d1-4cfd-b722-b207e5829283 req-c83d1b8b-87ad-4583-aab3-62224a74e13e service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Updating instance_info_cache with network_info: [{"id": "8b2cad16-9a51-4bb9-9e32-1e309c9c2107", "address": "fa:16:3e:df:52:eb", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2cad16-9a", "ovs_interfaceid": "8b2cad16-9a51-4bb9-9e32-1e309c9c2107", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0509bb2a-66d1-4cfd-b722-b207e5829283 req-c83d1b8b-87ad-4583-aab3-62224a74e13e service nova] Releasing lock "refresh_cache-ca70fce9-392b-45d8-8fc7-5b37d8feba23" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG nova.compute.manager [req-0509bb2a-66d1-4cfd-b722-b207e5829283 req-c83d1b8b-87ad-4583-aab3-62224a74e13e service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Received event network-changed-8b2cad16-9a51-4bb9-9e32-1e309c9c2107 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG nova.compute.manager [req-0509bb2a-66d1-4cfd-b722-b207e5829283 req-c83d1b8b-87ad-4583-aab3-62224a74e13e service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Refreshing instance network info cache due to event network-changed-8b2cad16-9a51-4bb9-9e32-1e309c9c2107. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0509bb2a-66d1-4cfd-b722-b207e5829283 req-c83d1b8b-87ad-4583-aab3-62224a74e13e service nova] Acquiring lock "refresh_cache-ca70fce9-392b-45d8-8fc7-5b37d8feba23" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0509bb2a-66d1-4cfd-b722-b207e5829283 req-c83d1b8b-87ad-4583-aab3-62224a74e13e service nova] Acquired lock "refresh_cache-ca70fce9-392b-45d8-8fc7-5b37d8feba23" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:12:07 user nova-compute[74342]: DEBUG nova.network.neutron [req-0509bb2a-66d1-4cfd-b722-b207e5829283 req-c83d1b8b-87ad-4583-aab3-62224a74e13e service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Refreshing network info cache for port 8b2cad16-9a51-4bb9-9e32-1e309c9c2107 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:12:08 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Instance destroyed successfully.
Oct 16 10:12:08 user nova-compute[74342]: DEBUG nova.objects.instance [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lazy-loading 'resources' on Instance uuid ca70fce9-392b-45d8-8fc7-5b37d8feba23 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:10:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1246688382',display_name='tempest-TestVolumeBootPattern-server-1246688382',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1246688382',id=43,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6sJnf898pay+PIZ2/zPOefJIOtQi4Xc+rReNrpoZgM8isuwz9hj22LY0/hNzdd67mZVqTOLnmuplNPpzcrNUeli+GTP1gNufDr7TumrMEFsIIMVgfBAzUAuJrkUhM+WA==',key_name='tempest-TestVolumeBootPattern-2085750064',keypairs=<?>,launch_index=0,launched_at=2023-10-16T10:10:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='799c265b3d14465a9ca6bd7d5e8a4488',ramdisk_id='',reservation_id='r-wwikoqgu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-158744824',owner_user_name='tempest-TestVolumeBootPattern-158744824-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T10:10:38Z,user_data=None,user_id='2cac31e799b743359b93943b68b38acf',uuid=ca70fce9-392b-45d8-8fc7-5b37d8feba23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8b2cad16-9a51-4bb9-9e32-1e309c9c2107", "address": "fa:16:3e:df:52:eb", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2cad16-9a", "ovs_interfaceid": "8b2cad16-9a51-4bb9-9e32-1e309c9c2107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converting VIF {"id": "8b2cad16-9a51-4bb9-9e32-1e309c9c2107", "address": "fa:16:3e:df:52:eb", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2cad16-9a", "ovs_interfaceid": "8b2cad16-9a51-4bb9-9e32-1e309c9c2107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:52:eb,bridge_name='br-int',has_traffic_filtering=True,id=8b2cad16-9a51-4bb9-9e32-1e309c9c2107,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b2cad16-9a') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG os_vif [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:52:eb,bridge_name='br-int',has_traffic_filtering=True,id=8b2cad16-9a51-4bb9-9e32-1e309c9c2107,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b2cad16-9a') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8b2cad16-9a, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=30b71651-6e68-4e61-80e3-6a9f961315a7) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:12:08 user nova-compute[74342]: INFO os_vif [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:52:eb,bridge_name='br-int',has_traffic_filtering=True,id=8b2cad16-9a51-4bb9-9e32-1e309c9c2107,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8b2cad16-9a')
Oct 16 10:12:08 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zUetEGgV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:12:08 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:12:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bacabc-e900-4844-8e4a-f1f568aecf9c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 10:12:08 user nova-compute[74342]: No targets found.
Oct 16 10:12:08 user nova-compute[74342]: iSNS:
Oct 16 10:12:08 user nova-compute[74342]: No targets found.
Oct 16 10:12:08 user nova-compute[74342]: STATIC:
Oct 16 10:12:08 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f
Oct 16 10:12:08 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:12:08 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:12:08 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562
Oct 16 10:12:08 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:12:08 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:12:08 user nova-compute[74342]: FIRMWARE:
Oct 16 10:12:08 user nova-compute[74342]: No targets found.
Oct 16 10:12:08 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 10:12:08 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 10:12:08 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[92f7f7b3-cd76-4481-a8af-1e7ca35ab56f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG nova.network.neutron [req-0509bb2a-66d1-4cfd-b722-b207e5829283 req-c83d1b8b-87ad-4583-aab3-62224a74e13e service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Updated VIF entry in instance network info cache for port 8b2cad16-9a51-4bb9-9e32-1e309c9c2107. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG nova.network.neutron [req-0509bb2a-66d1-4cfd-b722-b207e5829283 req-c83d1b8b-87ad-4583-aab3-62224a74e13e service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Updating instance_info_cache with network_info: [{"id": "8b2cad16-9a51-4bb9-9e32-1e309c9c2107", "address": "fa:16:3e:df:52:eb", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8b2cad16-9a", "ovs_interfaceid": "8b2cad16-9a51-4bb9-9e32-1e309c9c2107", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[37edc4b6-05e4-4190-863e-3abfb7139243]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)
Oct 16 10:12:08 user nova-compute[74342]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f (non-flash)
Oct 16 10:12:08 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)
Oct 16 10:12:08 user nova-compute[74342]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f (non-flash)
Oct 16 10:12:08 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b801970a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f'): ({'sdd'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Removing single pathed devices sdd {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0509bb2a-66d1-4cfd-b722-b207e5829283 req-c83d1b8b-87ad-4583-aab3-62224a74e13e service nova] Releasing lock "refresh_cache-ca70fce9-392b-45d8-8fc7-5b37d8feba23" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9db19a4-1156-44b8-b351-d89257db7688]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[91aaaf1e-abd8-403b-bd34-370443294d59]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Flushing IO for device /dev/sdd {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3b1af01-de97-478c-9841-38ef56d68774]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.046s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[70890b59-1551-4778-ae13-acefc3c77a44]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] SCSI volumes sdd have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO8b1cb0eb-fe46b91cff3f89d4', '/dev/disk/by-id/scsi-26665343662393163', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_8b1cb0eb') {{(pid=85400) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceae57dd-4cc7-48a7-b44e-08a249f3c756]: (4, None) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaefc8dd-e9af-4794-8b97-6db3c585516b]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[424517b8-85dd-4a36-a2ee-cc8ab4ca5f84]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f, portal: 172.16.0.220,3260]
Oct 16 10:12:08 user nova-compute[74342]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f, portal: 172.16.0.220,3260] successful.
Oct 16 10:12:08 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f05294d8-330b-4b8a-8fcb-a821e561ce9f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[56b4d741-d39f-40cf-a7d7-8034b530165c]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] <== disconnect_volume: return (319ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 10:12:08 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Deleting instance files /opt/stack/data/nova/instances/ca70fce9-392b-45d8-8fc7-5b37d8feba23_del
Oct 16 10:12:08 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Deletion of /opt/stack/data/nova/instances/ca70fce9-392b-45d8-8fc7-5b37d8feba23_del complete
Oct 16 10:12:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:08 user nova-compute[74342]: INFO nova.compute.manager [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Took 1.22 seconds to destroy the instance on the hypervisor.
Oct 16 10:12:08 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 10:12:08 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 10:12:09 user nova-compute[74342]: DEBUG nova.compute.manager [req-adfca4be-fbe0-4a90-bbd6-c876436ee9f3 req-39bb8342-a5b4-470b-bd01-8ba238a3b1a9 service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Received event network-vif-unplugged-8b2cad16-9a51-4bb9-9e32-1e309c9c2107 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:12:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-adfca4be-fbe0-4a90-bbd6-c876436ee9f3 req-39bb8342-a5b4-470b-bd01-8ba238a3b1a9 service nova] Acquiring lock "ca70fce9-392b-45d8-8fc7-5b37d8feba23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:12:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-adfca4be-fbe0-4a90-bbd6-c876436ee9f3 req-39bb8342-a5b4-470b-bd01-8ba238a3b1a9 service nova] Lock "ca70fce9-392b-45d8-8fc7-5b37d8feba23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:12:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-adfca4be-fbe0-4a90-bbd6-c876436ee9f3 req-39bb8342-a5b4-470b-bd01-8ba238a3b1a9 service nova] Lock "ca70fce9-392b-45d8-8fc7-5b37d8feba23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:12:09 user nova-compute[74342]: DEBUG nova.compute.manager [req-adfca4be-fbe0-4a90-bbd6-c876436ee9f3 req-39bb8342-a5b4-470b-bd01-8ba238a3b1a9 service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] No waiting events found dispatching network-vif-unplugged-8b2cad16-9a51-4bb9-9e32-1e309c9c2107 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:12:09 user nova-compute[74342]: DEBUG nova.compute.manager [req-adfca4be-fbe0-4a90-bbd6-c876436ee9f3 req-39bb8342-a5b4-470b-bd01-8ba238a3b1a9 service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Received event network-vif-unplugged-8b2cad16-9a51-4bb9-9e32-1e309c9c2107 for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 10:12:09 user nova-compute[74342]: DEBUG nova.compute.manager [req-adfca4be-fbe0-4a90-bbd6-c876436ee9f3 req-39bb8342-a5b4-470b-bd01-8ba238a3b1a9 service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Received event network-vif-plugged-8b2cad16-9a51-4bb9-9e32-1e309c9c2107 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:12:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-adfca4be-fbe0-4a90-bbd6-c876436ee9f3 req-39bb8342-a5b4-470b-bd01-8ba238a3b1a9 service nova] Acquiring lock "ca70fce9-392b-45d8-8fc7-5b37d8feba23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:12:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-adfca4be-fbe0-4a90-bbd6-c876436ee9f3 req-39bb8342-a5b4-470b-bd01-8ba238a3b1a9 service nova] Lock "ca70fce9-392b-45d8-8fc7-5b37d8feba23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:12:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-adfca4be-fbe0-4a90-bbd6-c876436ee9f3 req-39bb8342-a5b4-470b-bd01-8ba238a3b1a9 service nova] Lock "ca70fce9-392b-45d8-8fc7-5b37d8feba23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:12:09 user nova-compute[74342]: DEBUG nova.compute.manager [req-adfca4be-fbe0-4a90-bbd6-c876436ee9f3 req-39bb8342-a5b4-470b-bd01-8ba238a3b1a9 service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] No waiting events found dispatching network-vif-plugged-8b2cad16-9a51-4bb9-9e32-1e309c9c2107 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:12:09 user nova-compute[74342]: WARNING nova.compute.manager [req-adfca4be-fbe0-4a90-bbd6-c876436ee9f3 req-39bb8342-a5b4-470b-bd01-8ba238a3b1a9 service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Received unexpected event network-vif-plugged-8b2cad16-9a51-4bb9-9e32-1e309c9c2107 for instance with vm_state active and task_state deleting.
Oct 16 10:12:09 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:12:09 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Took 0.79 seconds to deallocate network for instance.
Oct 16 10:12:09 user nova-compute[74342]: DEBUG nova.compute.manager [req-5314ca73-8551-4182-8302-65280a291f2e req-2c3f421c-4e05-41e0-ad70-4127866b575e service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Received event network-vif-deleted-8b2cad16-9a51-4bb9-9e32-1e309c9c2107 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:12:09 user nova-compute[74342]: INFO nova.compute.manager [req-5314ca73-8551-4182-8302-65280a291f2e req-2c3f421c-4e05-41e0-ad70-4127866b575e service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Neutron deleted interface 8b2cad16-9a51-4bb9-9e32-1e309c9c2107; detaching it from the instance and deleting it from the info cache
Oct 16 10:12:09 user nova-compute[74342]: DEBUG nova.network.neutron [req-5314ca73-8551-4182-8302-65280a291f2e req-2c3f421c-4e05-41e0-ad70-4127866b575e service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:12:09 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:12:09 user nova-compute[74342]: DEBUG nova.compute.manager [req-5314ca73-8551-4182-8302-65280a291f2e req-2c3f421c-4e05-41e0-ad70-4127866b575e service nova] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Detach interface failed, port_id=8b2cad16-9a51-4bb9-9e32-1e309c9c2107, reason: Instance ca70fce9-392b-45d8-8fc7-5b37d8feba23 could not be found. {{(pid=74342) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 10:12:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:12:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:12:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:12:09 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:12:09 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f1f3a1-a62a-4f58-aa70-50b42bf35110/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:12:09 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f1f3a1-a62a-4f58-aa70-50b42bf35110/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:12:09 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f1f3a1-a62a-4f58-aa70-50b42bf35110/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:12:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f1f3a1-a62a-4f58-aa70-50b42bf35110/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:12:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:12:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:12:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:12:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:12:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 10:12:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5572a2a6-fc97-4355-bcf0-8ef41d83a0ac/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:12:10 user nova-compute[74342]: INFO nova.compute.manager [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: ca70fce9-392b-45d8-8fc7-5b37d8feba23] Took 1.14 seconds to detach 1 volumes for instance.
Oct 16 10:12:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:12:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:12:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5572a2a6-fc97-4355-bcf0-8ef41d83a0ac/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:12:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5572a2a6-fc97-4355-bcf0-8ef41d83a0ac/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:12:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5572a2a6-fc97-4355-bcf0-8ef41d83a0ac/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:12:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:12:10 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:12:10 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:12:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:12:11 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Deleted allocations for instance ca70fce9-392b-45d8-8fc7-5b37d8feba23
Oct 16 10:12:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:12:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:12:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8cce7b17-19c2-4a75-93dc-6d7e72e8802e tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "ca70fce9-392b-45d8-8fc7-5b37d8feba23" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.777s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:12:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:12:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:12:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:12:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:12:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:12:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:12:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:12:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:12:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:12:12 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:12:12 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:12:12 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8308MB free_disk=24.905982971191406GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:12:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:12:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:12:12 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 34ef7d18-0724-479a-8448-981b9cf0d6ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:12:12 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7d016ab3-14c4-4c33-bd50-468f71339cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:12:12 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance b547349a-1126-4700-93ca-d39e1da5c5cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:12:12 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance e8b580f9-a3cd-418b-8878-d86a6bb0afc5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:12:12 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:12:12 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 03f1f3a1-a62a-4f58-aa70-50b42bf35110 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:12:12 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:12:12 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:12:12 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:12:12 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:12:12 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:12:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.410s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:12:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6e8f9647-e926-4829-87a0-b32a1034452b tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Acquiring lock "5572a2a6-fc97-4355-bcf0-8ef41d83a0ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:12:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6e8f9647-e926-4829-87a0-b32a1034452b tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "5572a2a6-fc97-4355-bcf0-8ef41d83a0ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:12:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6e8f9647-e926-4829-87a0-b32a1034452b tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Acquiring lock "5572a2a6-fc97-4355-bcf0-8ef41d83a0ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:12:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6e8f9647-e926-4829-87a0-b32a1034452b tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "5572a2a6-fc97-4355-bcf0-8ef41d83a0ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:12:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6e8f9647-e926-4829-87a0-b32a1034452b tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "5572a2a6-fc97-4355-bcf0-8ef41d83a0ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:12:13 user nova-compute[74342]: INFO nova.compute.manager [None req-6e8f9647-e926-4829-87a0-b32a1034452b tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Terminating instance
Oct 16 10:12:13 user nova-compute[74342]: DEBUG nova.compute.manager [None req-6e8f9647-e926-4829-87a0-b32a1034452b tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 10:12:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:13 user nova-compute[74342]: DEBUG nova.compute.manager [req-cbf0a17c-d88f-4bc8-8481-bdea0e0fed58 req-4aca2629-2738-4097-935f-dd510bd90138 service nova] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Received event network-vif-unplugged-1239b61e-ba03-41df-996e-f21d5e7e4aef {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:12:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-cbf0a17c-d88f-4bc8-8481-bdea0e0fed58 req-4aca2629-2738-4097-935f-dd510bd90138 service nova] Acquiring lock "5572a2a6-fc97-4355-bcf0-8ef41d83a0ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:12:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-cbf0a17c-d88f-4bc8-8481-bdea0e0fed58 req-4aca2629-2738-4097-935f-dd510bd90138 service nova] Lock "5572a2a6-fc97-4355-bcf0-8ef41d83a0ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:12:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-cbf0a17c-d88f-4bc8-8481-bdea0e0fed58 req-4aca2629-2738-4097-935f-dd510bd90138 service nova] Lock "5572a2a6-fc97-4355-bcf0-8ef41d83a0ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:12:13 user nova-compute[74342]: DEBUG nova.compute.manager [req-cbf0a17c-d88f-4bc8-8481-bdea0e0fed58 req-4aca2629-2738-4097-935f-dd510bd90138 service nova] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] No waiting events found dispatching network-vif-unplugged-1239b61e-ba03-41df-996e-f21d5e7e4aef {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:12:13 user nova-compute[74342]: DEBUG nova.compute.manager [req-cbf0a17c-d88f-4bc8-8481-bdea0e0fed58 req-4aca2629-2738-4097-935f-dd510bd90138 service nova] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Received event network-vif-unplugged-1239b61e-ba03-41df-996e-f21d5e7e4aef for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 10:12:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:13 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Instance destroyed successfully.
Oct 16 10:12:13 user nova-compute[74342]: DEBUG nova.objects.instance [None req-6e8f9647-e926-4829-87a0-b32a1034452b tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lazy-loading 'resources' on Instance uuid 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:12:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-6e8f9647-e926-4829-87a0-b32a1034452b tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:10:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1078724388',display_name='tempest-VolumesActionsTest-instance-1078724388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1078724388',id=44,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T10:10:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c3f6c4540e0746f9939a26d4cc4be7ab',ramdisk_id='',reservation_id='r-kkebhydx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-188382855',owner_user_name='tempest-VolumesActionsTest-188382855-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T10:10:29Z,user_data=None,user_id='a9e5d4c21de14697a7fad1c6264869f8',uuid=5572a2a6-fc97-4355-bcf0-8ef41d83a0ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1239b61e-ba03-41df-996e-f21d5e7e4aef", "address": "fa:16:3e:a7:49:ad", "network": {"id": "694e4583-ab39-4b9d-b166-c025853d10a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1799473053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f6c4540e0746f9939a26d4cc4be7ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1239b61e-ba", "ovs_interfaceid": "1239b61e-ba03-41df-996e-f21d5e7e4aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 10:12:13 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-6e8f9647-e926-4829-87a0-b32a1034452b tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Converting VIF {"id": "1239b61e-ba03-41df-996e-f21d5e7e4aef", "address": "fa:16:3e:a7:49:ad", "network": {"id": "694e4583-ab39-4b9d-b166-c025853d10a2", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1799473053-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c3f6c4540e0746f9939a26d4cc4be7ab", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1239b61e-ba", "ovs_interfaceid": "1239b61e-ba03-41df-996e-f21d5e7e4aef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:12:13 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-6e8f9647-e926-4829-87a0-b32a1034452b tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:49:ad,bridge_name='br-int',has_traffic_filtering=True,id=1239b61e-ba03-41df-996e-f21d5e7e4aef,network=Network(694e4583-ab39-4b9d-b166-c025853d10a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1239b61e-ba') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:12:13 user nova-compute[74342]: DEBUG os_vif [None req-6e8f9647-e926-4829-87a0-b32a1034452b tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:49:ad,bridge_name='br-int',has_traffic_filtering=True,id=1239b61e-ba03-41df-996e-f21d5e7e4aef,network=Network(694e4583-ab39-4b9d-b166-c025853d10a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1239b61e-ba') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 10:12:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1239b61e-ba, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:12:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:12:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c3a47d95-ec1f-45b0-b008-cd7e1838d014) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:12:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:12:13 user nova-compute[74342]: INFO os_vif [None req-6e8f9647-e926-4829-87a0-b32a1034452b tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:49:ad,bridge_name='br-int',has_traffic_filtering=True,id=1239b61e-ba03-41df-996e-f21d5e7e4aef,network=Network(694e4583-ab39-4b9d-b166-c025853d10a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1239b61e-ba')
Oct 16 10:12:13 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-6e8f9647-e926-4829-87a0-b32a1034452b tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Deleting instance files /opt/stack/data/nova/instances/5572a2a6-fc97-4355-bcf0-8ef41d83a0ac_del
Oct 16 10:12:13 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-6e8f9647-e926-4829-87a0-b32a1034452b tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Deletion of /opt/stack/data/nova/instances/5572a2a6-fc97-4355-bcf0-8ef41d83a0ac_del complete
Oct 16 10:12:13 user nova-compute[74342]: INFO nova.compute.manager [None req-6e8f9647-e926-4829-87a0-b32a1034452b tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 16 10:12:13 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-6e8f9647-e926-4829-87a0-b32a1034452b tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 10:12:13 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 10:12:13 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 10:12:13 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:12:13 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:12:14 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:12:14 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Took 0.42 seconds to deallocate network for instance.
Oct 16 10:12:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6e8f9647-e926-4829-87a0-b32a1034452b tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:12:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6e8f9647-e926-4829-87a0-b32a1034452b tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:12:14 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:12:14 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:12:14 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:12:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-b547349a-1126-4700-93ca-d39e1da5c5cd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:12:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-b547349a-1126-4700-93ca-d39e1da5c5cd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:12:14 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:12:14 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-6e8f9647-e926-4829-87a0-b32a1034452b tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:12:14 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-6e8f9647-e926-4829-87a0-b32a1034452b tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:12:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6e8f9647-e926-4829-87a0-b32a1034452b tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:12:14 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-6e8f9647-e926-4829-87a0-b32a1034452b tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Deleted allocations for instance 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac
Oct 16 10:12:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6e8f9647-e926-4829-87a0-b32a1034452b tempest-VolumesActionsTest-188382855 tempest-VolumesActionsTest-188382855-project-member] Lock "5572a2a6-fc97-4355-bcf0-8ef41d83a0ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.802s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:12:15 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Updating instance_info_cache with network_info: [{"id": "841bff3b-23d1-4225-af17-45709c874a35", "address": "fa:16:3e:8f:4b:dc", "network": {"id": "ca9b5a27-87ee-46f0-a771-1ba5925e04de", "bridge": "br-int", "label": "tempest-TestStampPattern-847672181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f185c7dee6c4e7f8fe0d7bb2e89e854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841bff3b-23", "ovs_interfaceid": "841bff3b-23d1-4225-af17-45709c874a35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:12:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-b547349a-1126-4700-93ca-d39e1da5c5cd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:12:15 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:12:15 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:12:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-f1612fd0-c901-4242-93ff-f923372a7cbe req-7a0e2609-86b5-466a-9375-1fdb6b0308c0 service nova] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Received event network-vif-plugged-1239b61e-ba03-41df-996e-f21d5e7e4aef {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:12:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f1612fd0-c901-4242-93ff-f923372a7cbe req-7a0e2609-86b5-466a-9375-1fdb6b0308c0 service nova] Acquiring lock "5572a2a6-fc97-4355-bcf0-8ef41d83a0ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:12:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f1612fd0-c901-4242-93ff-f923372a7cbe req-7a0e2609-86b5-466a-9375-1fdb6b0308c0 service nova] Lock "5572a2a6-fc97-4355-bcf0-8ef41d83a0ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:12:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f1612fd0-c901-4242-93ff-f923372a7cbe req-7a0e2609-86b5-466a-9375-1fdb6b0308c0 service nova] Lock "5572a2a6-fc97-4355-bcf0-8ef41d83a0ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:12:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-f1612fd0-c901-4242-93ff-f923372a7cbe req-7a0e2609-86b5-466a-9375-1fdb6b0308c0 service nova] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] No waiting events found dispatching network-vif-plugged-1239b61e-ba03-41df-996e-f21d5e7e4aef {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:12:15 user nova-compute[74342]: WARNING nova.compute.manager [req-f1612fd0-c901-4242-93ff-f923372a7cbe req-7a0e2609-86b5-466a-9375-1fdb6b0308c0 service nova] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Received unexpected event network-vif-plugged-1239b61e-ba03-41df-996e-f21d5e7e4aef for instance with vm_state deleted and task_state None.
Oct 16 10:12:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-f1612fd0-c901-4242-93ff-f923372a7cbe req-7a0e2609-86b5-466a-9375-1fdb6b0308c0 service nova] [instance: 5572a2a6-fc97-4355-bcf0-8ef41d83a0ac] Received event network-vif-deleted-1239b61e-ba03-41df-996e-f21d5e7e4aef {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:12:16 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:12:17 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:12:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:19 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:12:19 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:12:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:12:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:12:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:08 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:13:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:13:10 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:13:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:13:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:13:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:13:10 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:13:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f1f3a1-a62a-4f58-aa70-50b42bf35110/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f1f3a1-a62a-4f58-aa70-50b42bf35110/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f1f3a1-a62a-4f58-aa70-50b42bf35110/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f1f3a1-a62a-4f58-aa70-50b42bf35110/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:11 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 10:13:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json" returned: 0 in 0.234s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json" returned: 0 in 0.215s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:13 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:13:13 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:13:13 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8447MB free_disk=24.931575775146484GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:13:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:13:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:13:13 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 34ef7d18-0724-479a-8448-981b9cf0d6ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:13:13 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7d016ab3-14c4-4c33-bd50-468f71339cd7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:13:13 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance b547349a-1126-4700-93ca-d39e1da5c5cd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:13:13 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance e8b580f9-a3cd-418b-8878-d86a6bb0afc5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:13:13 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 03f1f3a1-a62a-4f58-aa70-50b42bf35110 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:13:13 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:13:13 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:13:13 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:13:13 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:13:13 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:13:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.380s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:13:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:15 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:13:15 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:13:15 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:13:15 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:13:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-e8b580f9-a3cd-418b-8878-d86a6bb0afc5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:13:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-e8b580f9-a3cd-418b-8878-d86a6bb0afc5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:13:15 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:13:15 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Updating instance_info_cache with network_info: [{"id": "9dc948f0-294b-40da-aa4e-402a05611077", "address": "fa:16:3e:ed:3d:21", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc948f0-29", "ovs_interfaceid": "9dc948f0-294b-40da-aa4e-402a05611077", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:13:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-e8b580f9-a3cd-418b-8878-d86a6bb0afc5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:13:15 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:13:16 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:13:16 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:13:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:17 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:13:17 user nova-compute[74342]: DEBUG nova.compute.manager [req-0f760a5d-9e2e-4f5c-a43b-d1dc256d275f req-8c06a759-2e8b-4339-8bcc-2ab4ef909e44 service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Received event network-changed-9dc948f0-294b-40da-aa4e-402a05611077 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:13:17 user nova-compute[74342]: DEBUG nova.compute.manager [req-0f760a5d-9e2e-4f5c-a43b-d1dc256d275f req-8c06a759-2e8b-4339-8bcc-2ab4ef909e44 service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Refreshing instance network info cache due to event network-changed-9dc948f0-294b-40da-aa4e-402a05611077. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:13:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0f760a5d-9e2e-4f5c-a43b-d1dc256d275f req-8c06a759-2e8b-4339-8bcc-2ab4ef909e44 service nova] Acquiring lock "refresh_cache-e8b580f9-a3cd-418b-8878-d86a6bb0afc5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:13:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0f760a5d-9e2e-4f5c-a43b-d1dc256d275f req-8c06a759-2e8b-4339-8bcc-2ab4ef909e44 service nova] Acquired lock "refresh_cache-e8b580f9-a3cd-418b-8878-d86a6bb0afc5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:13:17 user nova-compute[74342]: DEBUG nova.network.neutron [req-0f760a5d-9e2e-4f5c-a43b-d1dc256d275f req-8c06a759-2e8b-4339-8bcc-2ab4ef909e44 service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Refreshing network info cache for port 9dc948f0-294b-40da-aa4e-402a05611077 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:13:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "e8b580f9-a3cd-418b-8878-d86a6bb0afc5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:13:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "e8b580f9-a3cd-418b-8878-d86a6bb0afc5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:13:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "e8b580f9-a3cd-418b-8878-d86a6bb0afc5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:13:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "e8b580f9-a3cd-418b-8878-d86a6bb0afc5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:13:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "e8b580f9-a3cd-418b-8878-d86a6bb0afc5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:13:17 user nova-compute[74342]: INFO nova.compute.manager [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Terminating instance
Oct 16 10:13:17 user nova-compute[74342]: DEBUG nova.compute.manager [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 10:13:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG nova.network.neutron [req-0f760a5d-9e2e-4f5c-a43b-d1dc256d275f req-8c06a759-2e8b-4339-8bcc-2ab4ef909e44 service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Updated VIF entry in instance network info cache for port 9dc948f0-294b-40da-aa4e-402a05611077. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG nova.network.neutron [req-0f760a5d-9e2e-4f5c-a43b-d1dc256d275f req-8c06a759-2e8b-4339-8bcc-2ab4ef909e44 service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Updating instance_info_cache with network_info: [{"id": "9dc948f0-294b-40da-aa4e-402a05611077", "address": "fa:16:3e:ed:3d:21", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc948f0-29", "ovs_interfaceid": "9dc948f0-294b-40da-aa4e-402a05611077", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0f760a5d-9e2e-4f5c-a43b-d1dc256d275f req-8c06a759-2e8b-4339-8bcc-2ab4ef909e44 service nova] Releasing lock "refresh_cache-e8b580f9-a3cd-418b-8878-d86a6bb0afc5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:13:18 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Instance destroyed successfully.
Oct 16 10:13:18 user nova-compute[74342]: DEBUG nova.objects.instance [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lazy-loading 'resources' on Instance uuid e8b580f9-a3cd-418b-8878-d86a6bb0afc5 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:08:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-476175103',display_name='tempest-TestVolumeBootPattern-server-476175103',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-476175103',id=42,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6sJnf898pay+PIZ2/zPOefJIOtQi4Xc+rReNrpoZgM8isuwz9hj22LY0/hNzdd67mZVqTOLnmuplNPpzcrNUeli+GTP1gNufDr7TumrMEFsIIMVgfBAzUAuJrkUhM+WA==',key_name='tempest-TestVolumeBootPattern-2085750064',keypairs=<?>,launch_index=0,launched_at=2023-10-16T10:08:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='799c265b3d14465a9ca6bd7d5e8a4488',ramdisk_id='',reservation_id='r-qwp399r3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-158744824',owner_user_name='tempest-TestVolumeBootPattern-158744824-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T10:08:28Z,user_data=None,user_id='2cac31e799b743359b93943b68b38acf',uuid=e8b580f9-a3cd-418b-8878-d86a6bb0afc5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9dc948f0-294b-40da-aa4e-402a05611077", "address": "fa:16:3e:ed:3d:21", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc948f0-29", "ovs_interfaceid": "9dc948f0-294b-40da-aa4e-402a05611077", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converting VIF {"id": "9dc948f0-294b-40da-aa4e-402a05611077", "address": "fa:16:3e:ed:3d:21", "network": {"id": "ce543008-d70a-4b89-85c8-9fb101bb93c4", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1145573018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.35", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "799c265b3d14465a9ca6bd7d5e8a4488", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9dc948f0-29", "ovs_interfaceid": "9dc948f0-294b-40da-aa4e-402a05611077", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:3d:21,bridge_name='br-int',has_traffic_filtering=True,id=9dc948f0-294b-40da-aa4e-402a05611077,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dc948f0-29') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG os_vif [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:3d:21,bridge_name='br-int',has_traffic_filtering=True,id=9dc948f0-294b-40da-aa4e-402a05611077,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dc948f0-29') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9dc948f0-29, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d9c26c0-86c7-41fc-8ef0-1ea9462c6bce) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:18 user nova-compute[74342]: INFO os_vif [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:3d:21,bridge_name='br-int',has_traffic_filtering=True,id=9dc948f0-294b-40da-aa4e-402a05611077,network=Network(ce543008-d70a-4b89-85c8-9fb101bb93c4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9dc948f0-29')
Oct 16 10:13:18 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tuMOrPkg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:13:18 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:13:18 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[362eedff-0e82-43be-8deb-0f5087caa344]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 10:13:18 user nova-compute[74342]: No targets found.
Oct 16 10:13:18 user nova-compute[74342]: iSNS:
Oct 16 10:13:18 user nova-compute[74342]: No targets found.
Oct 16 10:13:18 user nova-compute[74342]: STATIC:
Oct 16 10:13:18 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562
Oct 16 10:13:18 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:13:18 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:13:18 user nova-compute[74342]: FIRMWARE:
Oct 16 10:13:18 user nova-compute[74342]: No targets found.
Oct 16 10:13:18 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 10:13:18 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 10:13:18 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c80c98-e4b3-4178-b526-6d357a511d63]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f7f0745-f441-4919-a89a-2660c51e5510]: (4, ('tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)
Oct 16 10:13:18 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsi session list stdout=tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 (non-flash)
Oct 16 10:13:18 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b60268a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562'): ({'sdb'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Removing single pathed devices sdb {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1f8a4a0-9500-418c-bbcd-50e99ca3e1b1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1edd2559-ca6c-4357-a4ca-57569e466df9]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Flushing IO for device /dev/sdb {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b80901a3-7158-4634-b765-d1b26e1e33cb]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[16028265-6692-4993-9755-f81d3efd8d14]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_83631593', '/dev/disk/by-id/scsi-23737373762386663', '/dev/disk/by-id/scsi-1SCST_BIO83631593-7777b8fc7a35614f') {{(pid=85400) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee965157-ea81-4e5a-b025-09d8d1739de6]: (4, None) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f219069-41c1-467b-ade9-861a5421edcc]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[785f0de4-0f7c-4060-83a1-fdf64177a22a]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562, portal: 172.16.0.220,3260]
Oct 16 10:13:18 user nova-compute[74342]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562, portal: 172.16.0.220,3260] successful.
Oct 16 10:13:18 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9bd3971e-40e0-42a8-9105-740cb01b7562 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e2881b-74d5-43f0-a0d7-af3f39e0a7d6]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.300s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] <== disconnect_volume: return (302ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 10:13:18 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Deleting instance files /opt/stack/data/nova/instances/e8b580f9-a3cd-418b-8878-d86a6bb0afc5_del
Oct 16 10:13:18 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Deletion of /opt/stack/data/nova/instances/e8b580f9-a3cd-418b-8878-d86a6bb0afc5_del complete
Oct 16 10:13:18 user nova-compute[74342]: INFO nova.compute.manager [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Took 1.20 seconds to destroy the instance on the hypervisor.
Oct 16 10:13:18 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 10:13:18 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 10:13:19 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:13:19 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Took 0.42 seconds to deallocate network for instance.
Oct 16 10:13:19 user nova-compute[74342]: DEBUG nova.compute.manager [req-30f562ae-1a13-4772-8943-2299174de7a7 req-f7bd6dd3-478a-46be-b17c-23b754721b08 service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Received event network-vif-deleted-9dc948f0-294b-40da-aa4e-402a05611077 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:13:19 user nova-compute[74342]: INFO nova.compute.manager [req-30f562ae-1a13-4772-8943-2299174de7a7 req-f7bd6dd3-478a-46be-b17c-23b754721b08 service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Neutron deleted interface 9dc948f0-294b-40da-aa4e-402a05611077; detaching it from the instance and deleting it from the info cache
Oct 16 10:13:19 user nova-compute[74342]: DEBUG nova.network.neutron [req-30f562ae-1a13-4772-8943-2299174de7a7 req-f7bd6dd3-478a-46be-b17c-23b754721b08 service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:13:19 user nova-compute[74342]: DEBUG nova.compute.manager [req-30f562ae-1a13-4772-8943-2299174de7a7 req-f7bd6dd3-478a-46be-b17c-23b754721b08 service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Detach interface failed, port_id=9dc948f0-294b-40da-aa4e-402a05611077, reason: Instance e8b580f9-a3cd-418b-8878-d86a6bb0afc5 could not be found. {{(pid=74342) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 10:13:19 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:13:19 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:13:19 user nova-compute[74342]: DEBUG nova.compute.manager [req-86653eb7-9536-4514-8d99-f87ca5518fa4 req-f6741ae8-1d78-4682-8e76-f4cc1d209906 service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Received event network-vif-unplugged-9dc948f0-294b-40da-aa4e-402a05611077 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:13:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-86653eb7-9536-4514-8d99-f87ca5518fa4 req-f6741ae8-1d78-4682-8e76-f4cc1d209906 service nova] Acquiring lock "e8b580f9-a3cd-418b-8878-d86a6bb0afc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:13:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-86653eb7-9536-4514-8d99-f87ca5518fa4 req-f6741ae8-1d78-4682-8e76-f4cc1d209906 service nova] Lock "e8b580f9-a3cd-418b-8878-d86a6bb0afc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:13:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-86653eb7-9536-4514-8d99-f87ca5518fa4 req-f6741ae8-1d78-4682-8e76-f4cc1d209906 service nova] Lock "e8b580f9-a3cd-418b-8878-d86a6bb0afc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:13:19 user nova-compute[74342]: DEBUG nova.compute.manager [req-86653eb7-9536-4514-8d99-f87ca5518fa4 req-f6741ae8-1d78-4682-8e76-f4cc1d209906 service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] No waiting events found dispatching network-vif-unplugged-9dc948f0-294b-40da-aa4e-402a05611077 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:13:19 user nova-compute[74342]: DEBUG nova.compute.manager [req-86653eb7-9536-4514-8d99-f87ca5518fa4 req-f6741ae8-1d78-4682-8e76-f4cc1d209906 service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Received event network-vif-unplugged-9dc948f0-294b-40da-aa4e-402a05611077 for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 10:13:19 user nova-compute[74342]: DEBUG nova.compute.manager [req-86653eb7-9536-4514-8d99-f87ca5518fa4 req-f6741ae8-1d78-4682-8e76-f4cc1d209906 service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Received event network-vif-plugged-9dc948f0-294b-40da-aa4e-402a05611077 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:13:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-86653eb7-9536-4514-8d99-f87ca5518fa4 req-f6741ae8-1d78-4682-8e76-f4cc1d209906 service nova] Acquiring lock "e8b580f9-a3cd-418b-8878-d86a6bb0afc5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:13:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-86653eb7-9536-4514-8d99-f87ca5518fa4 req-f6741ae8-1d78-4682-8e76-f4cc1d209906 service nova] Lock "e8b580f9-a3cd-418b-8878-d86a6bb0afc5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:13:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-86653eb7-9536-4514-8d99-f87ca5518fa4 req-f6741ae8-1d78-4682-8e76-f4cc1d209906 service nova] Lock "e8b580f9-a3cd-418b-8878-d86a6bb0afc5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:13:19 user nova-compute[74342]: DEBUG nova.compute.manager [req-86653eb7-9536-4514-8d99-f87ca5518fa4 req-f6741ae8-1d78-4682-8e76-f4cc1d209906 service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] No waiting events found dispatching network-vif-plugged-9dc948f0-294b-40da-aa4e-402a05611077 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:13:19 user nova-compute[74342]: WARNING nova.compute.manager [req-86653eb7-9536-4514-8d99-f87ca5518fa4 req-f6741ae8-1d78-4682-8e76-f4cc1d209906 service nova] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Received unexpected event network-vif-plugged-9dc948f0-294b-40da-aa4e-402a05611077 for instance with vm_state active and task_state deleting.
Oct 16 10:13:20 user nova-compute[74342]: INFO nova.compute.manager [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] [instance: e8b580f9-a3cd-418b-8878-d86a6bb0afc5] Took 0.85 seconds to detach 1 volumes for instance.
Oct 16 10:13:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:13:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:13:20 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:13:20 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:13:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.216s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:13:20 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Deleted allocations for instance e8b580f9-a3cd-418b-8878-d86a6bb0afc5
Oct 16 10:13:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-d47c7a9f-65d6-408b-9f23-672e7684ae02 tempest-TestVolumeBootPattern-158744824 tempest-TestVolumeBootPattern-158744824-project-member] Lock "e8b580f9-a3cd-418b-8878-d86a6bb0afc5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.915s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:13:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:27 user nova-compute[74342]: DEBUG nova.compute.manager [req-21cd8c8e-a6f6-449e-ac32-583b862491f7 req-a29b7767-61e5-4e81-81b9-d7c18760faf8 service nova] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Received event network-changed-98f36e3c-3285-441a-9258-053b29ffa846 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:13:27 user nova-compute[74342]: DEBUG nova.compute.manager [req-21cd8c8e-a6f6-449e-ac32-583b862491f7 req-a29b7767-61e5-4e81-81b9-d7c18760faf8 service nova] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Refreshing instance network info cache due to event network-changed-98f36e3c-3285-441a-9258-053b29ffa846. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:13:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-21cd8c8e-a6f6-449e-ac32-583b862491f7 req-a29b7767-61e5-4e81-81b9-d7c18760faf8 service nova] Acquiring lock "refresh_cache-03f1f3a1-a62a-4f58-aa70-50b42bf35110" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:13:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-21cd8c8e-a6f6-449e-ac32-583b862491f7 req-a29b7767-61e5-4e81-81b9-d7c18760faf8 service nova] Acquired lock "refresh_cache-03f1f3a1-a62a-4f58-aa70-50b42bf35110" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:13:27 user nova-compute[74342]: DEBUG nova.network.neutron [req-21cd8c8e-a6f6-449e-ac32-583b862491f7 req-a29b7767-61e5-4e81-81b9-d7c18760faf8 service nova] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Refreshing network info cache for port 98f36e3c-3285-441a-9258-053b29ffa846 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG nova.network.neutron [req-21cd8c8e-a6f6-449e-ac32-583b862491f7 req-a29b7767-61e5-4e81-81b9-d7c18760faf8 service nova] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Updated VIF entry in instance network info cache for port 98f36e3c-3285-441a-9258-053b29ffa846. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG nova.network.neutron [req-21cd8c8e-a6f6-449e-ac32-583b862491f7 req-a29b7767-61e5-4e81-81b9-d7c18760faf8 service nova] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Updating instance_info_cache with network_info: [{"id": "98f36e3c-3285-441a-9258-053b29ffa846", "address": "fa:16:3e:f7:c8:3a", "network": {"id": "ca9b5a27-87ee-46f0-a771-1ba5925e04de", "bridge": "br-int", "label": "tempest-TestStampPattern-847672181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f185c7dee6c4e7f8fe0d7bb2e89e854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f36e3c-32", "ovs_interfaceid": "98f36e3c-3285-441a-9258-053b29ffa846", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "03f1f3a1-a62a-4f58-aa70-50b42bf35110" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "03f1f3a1-a62a-4f58-aa70-50b42bf35110" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-21cd8c8e-a6f6-449e-ac32-583b862491f7 req-a29b7767-61e5-4e81-81b9-d7c18760faf8 service nova] Releasing lock "refresh_cache-03f1f3a1-a62a-4f58-aa70-50b42bf35110" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG nova.objects.instance [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lazy-loading 'flavor' on Instance uuid 03f1f3a1-a62a-4f58-aa70-50b42bf35110 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "03f1f3a1-a62a-4f58-aa70-50b42bf35110" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "03f1f3a1-a62a-4f58-aa70-50b42bf35110" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "03f1f3a1-a62a-4f58-aa70-50b42bf35110" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:13:28 user nova-compute[74342]: INFO nova.compute.manager [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Attaching volume e8e01136-af47-41c0-8cf3-3b2b68aa0429 to /dev/vdb
Oct 16 10:13:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG os_brick.utils [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1ceff4-3891-404b-af22-eec39b28f88d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5677a0ec-a9fe-4fdb-b13f-fc17c4971ee3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b876e3-5648-4fc6-bdd7-7c3b3cab382d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f3a3b8-96ce-47c6-855e-f0ae15b7709e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:13:28 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 10:13:28 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4faf8f21-7c0a-41ae-989e-1625cc8193d4]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG os_brick.utils [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:13:28 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Updating existing volume attachment record: c8e4a6fa-fb6a-4cea-85dc-30d7f9d3be56 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 10:13:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HKhNqkEB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:13:45 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:13:45 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:13:45 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:13:45 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:13:45 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429 -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[69811c26-093a-45a8-a30e-5721e5c8c81a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 10:13:45 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429 -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b874bc86-9c30-4799-8ef3-61c486d751db]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429] added
Oct 16 10:13:45 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1ae200-1059-450e-a296-23ed45eda10c]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce056e2-2e80-46ee-8e46-25b1d8141507]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HKhNqkEB {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HKhNqkEB" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fe068d-b4e3-4418-ab3b-d757d293dc5d]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HKhNqkEB'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0593c0b1-9e52-45ec-85ea-ea6c55259e75]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[76bc692b-969e-470b-ad21-bc95c99ad984]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 10:13:45 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 10:13:45 user nova-compute[74342]:  {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:13:45 user nova-compute[74342]: WARNING os_brick.initiator.connectors.iscsi [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 10:13:45 user nova-compute[74342]: 
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429 -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c466508-6fb2-4160-8adc-9329a503edfe]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429, portal: 172.16.0.220,3260]
Oct 16 10:13:45 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429, portal: 172.16.0.220,3260] successful.
Oct 16 10:13:45 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[081c201f-94ae-4677-8e61-45c8feaa2119]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[982f7eb5-94af-4caf-ba60-a825fd2a12fc]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429 (non-flash)
Oct 16 10:13:45 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429 (non-flash)
Oct 16 10:13:45 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c879b4b-013f-4787-8807-787395a7592d]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 10:13:45 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HKhNqkEB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 10:13:46 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.288s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:13:46 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23037373261323263', 'path': '/dev/sdb'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:13:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037373261323263', 'path': '/dev/sdb'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 10:13:46 user nova-compute[74342]: DEBUG nova.objects.instance [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lazy-loading 'flavor' on Instance uuid 03f1f3a1-a62a-4f58-aa70-50b42bf35110 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:13:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 10:13:46 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:13:46 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 10:13:46 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:13:46 user nova-compute[74342]:   <serial>e8e01136-af47-41c0-8cf3-3b2b68aa0429</serial>
Oct 16 10:13:46 user nova-compute[74342]: </disk>
Oct 16 10:13:46 user nova-compute[74342]:  {{(pid=74342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 10:13:47 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:13:47 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:13:47 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] No VIF found with MAC fa:16:3e:f7:c8:3a, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:13:47 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5feb6a6e-007b-4832-9e85-272fcfda8be1 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "03f1f3a1-a62a-4f58-aa70-50b42bf35110" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 19.015s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:13:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "03f1f3a1-a62a-4f58-aa70-50b42bf35110" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:13:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "03f1f3a1-a62a-4f58-aa70-50b42bf35110" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:13:49 user nova-compute[74342]: INFO nova.compute.manager [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Detaching volume e8e01136-af47-41c0-8cf3-3b2b68aa0429
Oct 16 10:13:49 user nova-compute[74342]: INFO nova.virt.block_device [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Attempting to driver detach volume e8e01136-af47-41c0-8cf3-3b2b68aa0429 from mountpoint /dev/vdb
Oct 16 10:13:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Attempting to detach device vdb from instance 03f1f3a1-a62a-4f58-aa70-50b42bf35110 from the persistent domain config. {{(pid=74342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 10:13:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 10:13:49 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:13:49 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 10:13:49 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:13:49 user nova-compute[74342]:   <serial>e8e01136-af47-41c0-8cf3-3b2b68aa0429</serial>
Oct 16 10:13:49 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 10:13:49 user nova-compute[74342]: </disk>
Oct 16 10:13:49 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 10:13:49 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Successfully detached device vdb from instance 03f1f3a1-a62a-4f58-aa70-50b42bf35110 from the persistent domain config.
Oct 16 10:13:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 03f1f3a1-a62a-4f58-aa70-50b42bf35110 from the live domain config. {{(pid=74342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 10:13:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 10:13:49 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:13:49 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 10:13:49 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:13:49 user nova-compute[74342]:   <serial>e8e01136-af47-41c0-8cf3-3b2b68aa0429</serial>
Oct 16 10:13:49 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 10:13:49 user nova-compute[74342]: </disk>
Oct 16 10:13:49 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 10:13:50 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 03f1f3a1-a62a-4f58-aa70-50b42bf35110 {{(pid=74342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 10:13:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:13:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:14:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:14:00 user nova-compute[74342]: DEBUG nova.compute.manager [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 10:14:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:14:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:14:00 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 10:14:00 user nova-compute[74342]: INFO nova.compute.claims [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Claim successful on node user
Oct 16 10:14:01 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:14:01 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:14:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.365s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:14:01 user nova-compute[74342]: DEBUG nova.compute.manager [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 10:14:01 user nova-compute[74342]: DEBUG nova.compute.manager [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 10:14:01 user nova-compute[74342]: DEBUG nova.network.neutron [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 10:14:01 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 10:14:01 user nova-compute[74342]: DEBUG nova.compute.manager [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 10:14:01 user nova-compute[74342]: DEBUG nova.policy [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2ca9ac24fcad4d9fbf8cb2fd7ec6a3f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2453f549532c465da8952474a5218357', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 10:14:01 user nova-compute[74342]: DEBUG nova.compute.manager [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 10:14:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 10:14:01 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Creating image(s)
Oct 16 10:14:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "/opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:14:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "/opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:14:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "/opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:14:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:14:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.226s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:14:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:14:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:14:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:14:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.197s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:14:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:14:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk 1073741824" returned: 0 in 0.075s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:14:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:14:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:14:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.223s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:14:02 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 10:14:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:14:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:14:02 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Cannot resize image /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 10:14:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 10:14:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Ensure instance console log exists: /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 10:14:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:14:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:14:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:14:02 user nova-compute[74342]: DEBUG nova.network.neutron [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Successfully created port: 0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 10:14:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:03 user nova-compute[74342]: DEBUG nova.network.neutron [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Successfully updated port: 0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 10:14:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "refresh_cache-fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:14:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquired lock "refresh_cache-fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:14:03 user nova-compute[74342]: DEBUG nova.network.neutron [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:14:03 user nova-compute[74342]: DEBUG nova.compute.manager [req-1a486b56-92bc-43ee-9077-a157b32430da req-9ef08dc5-76d4-44b3-a887-a0614b8497ca service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received event network-changed-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:14:03 user nova-compute[74342]: DEBUG nova.compute.manager [req-1a486b56-92bc-43ee-9077-a157b32430da req-9ef08dc5-76d4-44b3-a887-a0614b8497ca service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Refreshing instance network info cache due to event network-changed-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:14:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-1a486b56-92bc-43ee-9077-a157b32430da req-9ef08dc5-76d4-44b3-a887-a0614b8497ca service nova] Acquiring lock "refresh_cache-fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:14:03 user nova-compute[74342]: DEBUG nova.network.neutron [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.network.neutron [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Updating instance_info_cache with network_info: [{"id": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "address": "fa:16:3e:48:08:65", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aba45fe-36", "ovs_interfaceid": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Releasing lock "refresh_cache-fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.compute.manager [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Instance network_info: |[{"id": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "address": "fa:16:3e:48:08:65", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aba45fe-36", "ovs_interfaceid": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-1a486b56-92bc-43ee-9077-a157b32430da req-9ef08dc5-76d4-44b3-a887-a0614b8497ca service nova] Acquired lock "refresh_cache-fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.network.neutron [req-1a486b56-92bc-43ee-9077-a157b32430da req-9ef08dc5-76d4-44b3-a887-a0614b8497ca service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Refreshing network info cache for port 0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Start _get_guest_xml network_info=[{"id": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "address": "fa:16:3e:48:08:65", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aba45fe-36", "ovs_interfaceid": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 10:14:04 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:14:04 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-106833737',display_name='tempest-ServerRescueNegativeTestJSON-server-106833737',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-106833737',id=46,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHwkB8B6xn1DLu5yc81DqKdns/QpqRd7Maa0OvHjHefs7SZk/XPhJ/VHDNwT5fWZndqBU/wq/L/2jGTcPWdzvUbeOGibIDnqir40C/LOzf0p8Lmes8291YTIWvjKyGHeg==',key_name='tempest-keypair-409457646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2453f549532c465da8952474a5218357',ramdisk_id='',reservation_id='r-zlhwfjx4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1027819060',owner_user_name='tempest-ServerRescueNegativeTestJSON-1027819060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:14:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ca9ac24fcad4d9fbf8cb2fd7ec6a3f0',uuid=fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "address": "fa:16:3e:48:08:65", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aba45fe-36", "ovs_interfaceid": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Converting VIF {"id": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "address": "fa:16:3e:48:08:65", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aba45fe-36", "ovs_interfaceid": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:08:65,bridge_name='br-int',has_traffic_filtering=True,id=0aba45fe-3675-4a86-ac2d-9eac3af1ecc6,network=Network(c8edc360-319a-4e77-8af6-5b8e7a87ae82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aba45fe-36') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.objects.instance [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lazy-loading 'pci_devices' on Instance uuid fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] End _get_guest_xml xml=<domain type="kvm">
Oct 16 10:14:04 user nova-compute[74342]:   <uuid>fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9</uuid>
Oct 16 10:14:04 user nova-compute[74342]:   <name>instance-0000002e</name>
Oct 16 10:14:04 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 10:14:04 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 10:14:04 user nova-compute[74342]:   <metadata>
Oct 16 10:14:04 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 10:14:04 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 10:14:04 user nova-compute[74342]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-106833737</nova:name>
Oct 16 10:14:04 user nova-compute[74342]:       <nova:creationTime>2023-10-16 10:14:04</nova:creationTime>
Oct 16 10:14:04 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 10:14:04 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 10:14:04 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 10:14:04 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 10:14:04 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 10:14:04 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 10:14:04 user nova-compute[74342]:       </nova:flavor>
Oct 16 10:14:04 user nova-compute[74342]:       <nova:owner>
Oct 16 10:14:04 user nova-compute[74342]:         <nova:user uuid="2ca9ac24fcad4d9fbf8cb2fd7ec6a3f0">tempest-ServerRescueNegativeTestJSON-1027819060-project-member</nova:user>
Oct 16 10:14:04 user nova-compute[74342]:         <nova:project uuid="2453f549532c465da8952474a5218357">tempest-ServerRescueNegativeTestJSON-1027819060</nova:project>
Oct 16 10:14:04 user nova-compute[74342]:       </nova:owner>
Oct 16 10:14:04 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 10:14:04 user nova-compute[74342]:       <nova:ports>
Oct 16 10:14:04 user nova-compute[74342]:         <nova:port uuid="0aba45fe-3675-4a86-ac2d-9eac3af1ecc6">
Oct 16 10:14:04 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 10:14:04 user nova-compute[74342]:         </nova:port>
Oct 16 10:14:04 user nova-compute[74342]:       </nova:ports>
Oct 16 10:14:04 user nova-compute[74342]:     </nova:instance>
Oct 16 10:14:04 user nova-compute[74342]:   </metadata>
Oct 16 10:14:04 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 10:14:04 user nova-compute[74342]:     <system>
Oct 16 10:14:04 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 10:14:04 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 10:14:04 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 10:14:04 user nova-compute[74342]:       <entry name="serial">fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9</entry>
Oct 16 10:14:04 user nova-compute[74342]:       <entry name="uuid">fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9</entry>
Oct 16 10:14:04 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 10:14:04 user nova-compute[74342]:     </system>
Oct 16 10:14:04 user nova-compute[74342]:   </sysinfo>
Oct 16 10:14:04 user nova-compute[74342]:   <os>
Oct 16 10:14:04 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 10:14:04 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 10:14:04 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 10:14:04 user nova-compute[74342]:   </os>
Oct 16 10:14:04 user nova-compute[74342]:   <features>
Oct 16 10:14:04 user nova-compute[74342]:     <acpi/>
Oct 16 10:14:04 user nova-compute[74342]:     <apic/>
Oct 16 10:14:04 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 10:14:04 user nova-compute[74342]:   </features>
Oct 16 10:14:04 user nova-compute[74342]:   <clock offset="utc">
Oct 16 10:14:04 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 10:14:04 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 10:14:04 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 10:14:04 user nova-compute[74342]:   </clock>
Oct 16 10:14:04 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 10:14:04 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 10:14:04 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 10:14:04 user nova-compute[74342]:   </cpu>
Oct 16 10:14:04 user nova-compute[74342]:   <devices>
Oct 16 10:14:04 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 10:14:04 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 10:14:04 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk"/>
Oct 16 10:14:04 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 10:14:04 user nova-compute[74342]:     </disk>
Oct 16 10:14:04 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 10:14:04 user nova-compute[74342]:       <mac address="fa:16:3e:48:08:65"/>
Oct 16 10:14:04 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:14:04 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 10:14:04 user nova-compute[74342]:       <target dev="tap0aba45fe-36"/>
Oct 16 10:14:04 user nova-compute[74342]:     </interface>
Oct 16 10:14:04 user nova-compute[74342]:     <serial type="pty">
Oct 16 10:14:04 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/console.log" append="off"/>
Oct 16 10:14:04 user nova-compute[74342]:     </serial>
Oct 16 10:14:04 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 10:14:04 user nova-compute[74342]:     <video>
Oct 16 10:14:04 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:14:04 user nova-compute[74342]:     </video>
Oct 16 10:14:04 user nova-compute[74342]:     <rng model="virtio">
Oct 16 10:14:04 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 10:14:04 user nova-compute[74342]:     </rng>
Oct 16 10:14:04 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 10:14:04 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 10:14:04 user nova-compute[74342]:       <stats period="10"/>
Oct 16 10:14:04 user nova-compute[74342]:     </memballoon>
Oct 16 10:14:04 user nova-compute[74342]:   </devices>
Oct 16 10:14:04 user nova-compute[74342]: </domain>
Oct 16 10:14:04 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-106833737',display_name='tempest-ServerRescueNegativeTestJSON-server-106833737',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-106833737',id=46,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHwkB8B6xn1DLu5yc81DqKdns/QpqRd7Maa0OvHjHefs7SZk/XPhJ/VHDNwT5fWZndqBU/wq/L/2jGTcPWdzvUbeOGibIDnqir40C/LOzf0p8Lmes8291YTIWvjKyGHeg==',key_name='tempest-keypair-409457646',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2453f549532c465da8952474a5218357',ramdisk_id='',reservation_id='r-zlhwfjx4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1027819060',owner_user_name='tempest-ServerRescueNegativeTestJSON-1027819060-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:14:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ca9ac24fcad4d9fbf8cb2fd7ec6a3f0',uuid=fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "address": "fa:16:3e:48:08:65", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aba45fe-36", "ovs_interfaceid": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Converting VIF {"id": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "address": "fa:16:3e:48:08:65", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aba45fe-36", "ovs_interfaceid": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:08:65,bridge_name='br-int',has_traffic_filtering=True,id=0aba45fe-3675-4a86-ac2d-9eac3af1ecc6,network=Network(c8edc360-319a-4e77-8af6-5b8e7a87ae82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aba45fe-36') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG os_vif [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:08:65,bridge_name='br-int',has_traffic_filtering=True,id=0aba45fe-3675-4a86-ac2d-9eac3af1ecc6,network=Network(c8edc360-319a-4e77-8af6-5b8e7a87ae82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aba45fe-36') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '334dc089-998f-5c7b-b098-206ae2bc2ce1', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0aba45fe-36, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0aba45fe-36, col_values=(('qos', UUID('72785f68-791d-44a7-ae4d-265d2b289217')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0aba45fe-36, col_values=(('external_ids', {'iface-id': '0aba45fe-3675-4a86-ac2d-9eac3af1ecc6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:08:65', 'vm-uuid': 'fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:04 user nova-compute[74342]: INFO os_vif [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:08:65,bridge_name='br-int',has_traffic_filtering=True,id=0aba45fe-3675-4a86-ac2d-9eac3af1ecc6,network=Network(c8edc360-319a-4e77-8af6-5b8e7a87ae82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aba45fe-36')
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] No VIF found with MAC fa:16:3e:48:08:65, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.network.neutron [req-1a486b56-92bc-43ee-9077-a157b32430da req-9ef08dc5-76d4-44b3-a887-a0614b8497ca service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Updated VIF entry in instance network info cache for port 0aba45fe-3675-4a86-ac2d-9eac3af1ecc6. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG nova.network.neutron [req-1a486b56-92bc-43ee-9077-a157b32430da req-9ef08dc5-76d4-44b3-a887-a0614b8497ca service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Updating instance_info_cache with network_info: [{"id": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "address": "fa:16:3e:48:08:65", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aba45fe-36", "ovs_interfaceid": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:14:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-1a486b56-92bc-43ee-9077-a157b32430da req-9ef08dc5-76d4-44b3-a887-a0614b8497ca service nova] Releasing lock "refresh_cache-fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:14:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:05 user nova-compute[74342]: DEBUG nova.compute.manager [req-468b801a-d2f7-475f-906b-7002f2c59cb9 req-a6caf15f-4b83-4ab1-b65d-b14e02015978 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received event network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:14:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-468b801a-d2f7-475f-906b-7002f2c59cb9 req-a6caf15f-4b83-4ab1-b65d-b14e02015978 service nova] Acquiring lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:14:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-468b801a-d2f7-475f-906b-7002f2c59cb9 req-a6caf15f-4b83-4ab1-b65d-b14e02015978 service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:14:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-468b801a-d2f7-475f-906b-7002f2c59cb9 req-a6caf15f-4b83-4ab1-b65d-b14e02015978 service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:14:05 user nova-compute[74342]: DEBUG nova.compute.manager [req-468b801a-d2f7-475f-906b-7002f2c59cb9 req-a6caf15f-4b83-4ab1-b65d-b14e02015978 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] No waiting events found dispatching network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:14:05 user nova-compute[74342]: WARNING nova.compute.manager [req-468b801a-d2f7-475f-906b-7002f2c59cb9 req-a6caf15f-4b83-4ab1-b65d-b14e02015978 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received unexpected event network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 for instance with vm_state building and task_state spawning.
Oct 16 10:14:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:07 user nova-compute[74342]: DEBUG nova.compute.manager [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 10:14:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 10:14:07 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Instance spawned successfully.
Oct 16 10:14:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 10:14:07 user nova-compute[74342]: DEBUG nova.compute.manager [req-09e527dc-3b66-4b1a-a079-794363d5eebe req-56c3b299-1202-4742-b636-ac2cce4cf16d service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received event network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:14:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-09e527dc-3b66-4b1a-a079-794363d5eebe req-56c3b299-1202-4742-b636-ac2cce4cf16d service nova] Acquiring lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:14:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-09e527dc-3b66-4b1a-a079-794363d5eebe req-56c3b299-1202-4742-b636-ac2cce4cf16d service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:14:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-09e527dc-3b66-4b1a-a079-794363d5eebe req-56c3b299-1202-4742-b636-ac2cce4cf16d service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:14:07 user nova-compute[74342]: DEBUG nova.compute.manager [req-09e527dc-3b66-4b1a-a079-794363d5eebe req-56c3b299-1202-4742-b636-ac2cce4cf16d service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] No waiting events found dispatching network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:14:07 user nova-compute[74342]: WARNING nova.compute.manager [req-09e527dc-3b66-4b1a-a079-794363d5eebe req-56c3b299-1202-4742-b636-ac2cce4cf16d service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received unexpected event network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 for instance with vm_state building and task_state spawning.
Oct 16 10:14:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:14:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:14:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:14:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:14:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:14:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:14:07 user nova-compute[74342]: INFO nova.compute.manager [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Took 6.28 seconds to spawn the instance on the hypervisor.
Oct 16 10:14:07 user nova-compute[74342]: DEBUG nova.compute.manager [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:14:08 user nova-compute[74342]: INFO nova.compute.manager [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Took 7.07 seconds to build instance.
Oct 16 10:14:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0c514a51-013f-4e1e-afbc-49933a7a06ee tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.174s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:14:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:09 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:14:10 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 03f1f3a1-a62a-4f58-aa70-50b42bf35110 is timed out.
Oct 16 10:14:10 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Successfully detached device vdb from instance 03f1f3a1-a62a-4f58-aa70-50b42bf35110 from the live domain config.
Oct 16 10:14:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HKhNqkEB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:14:10 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:14:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c5ae584-699a-4abb-aa37-999b218c300c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 10:14:10 user nova-compute[74342]: No targets found.
Oct 16 10:14:10 user nova-compute[74342]: iSNS:
Oct 16 10:14:10 user nova-compute[74342]: No targets found.
Oct 16 10:14:10 user nova-compute[74342]: STATIC:
Oct 16 10:14:10 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429
Oct 16 10:14:10 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:14:10 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:14:10 user nova-compute[74342]: FIRMWARE:
Oct 16 10:14:10 user nova-compute[74342]: No targets found.
Oct 16 10:14:10 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 10:14:10 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 10:14:10 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9274a4b-5035-4202-bd2a-cbf408f7d884]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9bba44-d818-4eb4-a008-dc59ea8aafef]: (4, ('tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429 (non-flash)
Oct 16 10:14:10 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsi session list stdout=tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429 (non-flash)
Oct 16 10:14:10 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b60297c70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429'): ({'sdb'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Removing single pathed devices sdb {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b43cf6c-cb43-4341-84ab-14efa0c3e5ec]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b18da47-727d-4412-92c4-6ff68d8ea405]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Flushing IO for device /dev/sdb {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf5ce1d8-cf1b-48fd-a0ab-12d509b64abe]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee91498-f082-436c-9836-fe3f2e971de0]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4ed9a69-902e-4db9-8929-8cebd91e3e9b]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429 -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6bf7fa8-cb4c-493a-a3c9-dc008a3eeb9e]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429, portal: 172.16.0.220,3260]
Oct 16 10:14:10 user nova-compute[74342]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429, portal: 172.16.0.220,3260] successful.
Oct 16 10:14:10 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429 -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e8e01136-af47-41c0-8cf3-3b2b68aa0429 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8399d6f-ad7c-4571-99fe-e8b8a19dd33a]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] <== disconnect_volume: return (316ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f1f3a1-a62a-4f58-aa70-50b42bf35110/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f1f3a1-a62a-4f58-aa70-50b42bf35110/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:14:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f1f3a1-a62a-4f58-aa70-50b42bf35110/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:14:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/03f1f3a1-a62a-4f58-aa70-50b42bf35110/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:14:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:14:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:14:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:14:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:14:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:14:11 user nova-compute[74342]: DEBUG nova.objects.instance [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lazy-loading 'flavor' on Instance uuid 03f1f3a1-a62a-4f58-aa70-50b42bf35110 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:14:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6de1c887-b846-4163-921e-efeb6503c4df tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "03f1f3a1-a62a-4f58-aa70-50b42bf35110" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.052s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:14:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:14:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:14:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:14:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:14:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:14:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:14:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:14:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:14:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:14:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:14:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:14:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:14:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:14:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:14:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:14:13 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:14:13 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:14:13 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8524MB free_disk=24.918655395507812GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:14:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:14:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:14:13 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 34ef7d18-0724-479a-8448-981b9cf0d6ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:14:13 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7d016ab3-14c4-4c33-bd50-468f71339cd7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:14:13 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance b547349a-1126-4700-93ca-d39e1da5c5cd actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:14:13 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 03f1f3a1-a62a-4f58-aa70-50b42bf35110 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:14:13 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:14:13 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:14:13 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:14:13 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:14:13 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:14:13 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:14:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.405s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:14:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:16 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:14:16 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:14:16 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Rebuilding the list of instances to heal {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 10:14:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-34ef7d18-0724-479a-8448-981b9cf0d6ab" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:14:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-34ef7d18-0724-479a-8448-981b9cf0d6ab" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:14:16 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:14:16 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lazy-loading 'info_cache' on Instance uuid 34ef7d18-0724-479a-8448-981b9cf0d6ab {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:14:17 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Updating instance_info_cache with network_info: [{"id": "1495980a-a474-4a07-a8d1-27521ae89be7", "address": "fa:16:3e:0e:3e:44", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1495980a-a4", "ovs_interfaceid": "1495980a-a474-4a07-a8d1-27521ae89be7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:14:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-34ef7d18-0724-479a-8448-981b9cf0d6ab" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:14:17 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:14:17 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:14:17 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:14:17 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:14:17 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:14:18 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:14:18 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:14:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:21 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:14:21 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:14:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:40 user nova-compute[74342]: DEBUG nova.compute.manager [req-23c74a63-69f5-41c9-98a3-26fe9923d220 req-48c0c601-1dc8-4923-9f22-306ae2eb46ea service nova] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Received event network-changed-98f36e3c-3285-441a-9258-053b29ffa846 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:14:40 user nova-compute[74342]: DEBUG nova.compute.manager [req-23c74a63-69f5-41c9-98a3-26fe9923d220 req-48c0c601-1dc8-4923-9f22-306ae2eb46ea service nova] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Refreshing instance network info cache due to event network-changed-98f36e3c-3285-441a-9258-053b29ffa846. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:14:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-23c74a63-69f5-41c9-98a3-26fe9923d220 req-48c0c601-1dc8-4923-9f22-306ae2eb46ea service nova] Acquiring lock "refresh_cache-03f1f3a1-a62a-4f58-aa70-50b42bf35110" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:14:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-23c74a63-69f5-41c9-98a3-26fe9923d220 req-48c0c601-1dc8-4923-9f22-306ae2eb46ea service nova] Acquired lock "refresh_cache-03f1f3a1-a62a-4f58-aa70-50b42bf35110" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:14:40 user nova-compute[74342]: DEBUG nova.network.neutron [req-23c74a63-69f5-41c9-98a3-26fe9923d220 req-48c0c601-1dc8-4923-9f22-306ae2eb46ea service nova] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Refreshing network info cache for port 98f36e3c-3285-441a-9258-053b29ffa846 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:14:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9f202f5f-a0b1-4a1f-b5c3-a285c8eba491 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "03f1f3a1-a62a-4f58-aa70-50b42bf35110" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:14:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9f202f5f-a0b1-4a1f-b5c3-a285c8eba491 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "03f1f3a1-a62a-4f58-aa70-50b42bf35110" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:14:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9f202f5f-a0b1-4a1f-b5c3-a285c8eba491 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "03f1f3a1-a62a-4f58-aa70-50b42bf35110-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:14:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9f202f5f-a0b1-4a1f-b5c3-a285c8eba491 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "03f1f3a1-a62a-4f58-aa70-50b42bf35110-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:14:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9f202f5f-a0b1-4a1f-b5c3-a285c8eba491 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "03f1f3a1-a62a-4f58-aa70-50b42bf35110-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:14:40 user nova-compute[74342]: INFO nova.compute.manager [None req-9f202f5f-a0b1-4a1f-b5c3-a285c8eba491 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Terminating instance
Oct 16 10:14:40 user nova-compute[74342]: DEBUG nova.compute.manager [None req-9f202f5f-a0b1-4a1f-b5c3-a285c8eba491 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 10:14:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:41 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Instance destroyed successfully.
Oct 16 10:14:41 user nova-compute[74342]: DEBUG nova.objects.instance [None req-9f202f5f-a0b1-4a1f-b5c3-a285c8eba491 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lazy-loading 'resources' on Instance uuid 03f1f3a1-a62a-4f58-aa70-50b42bf35110 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:14:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-9f202f5f-a0b1-4a1f-b5c3-a285c8eba491 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:11:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1555382164',display_name='tempest-TestStampPattern-server-1555382164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1555382164',id=45,image_ref='3cb0d9b0-8f78-4756-b63c-b2e7817d4d5d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqaEvE2WxtZyUpj/QXmrU1PYxONwCsPW4U4I5X6LON7fZWTJ1Ui7jNxiJSotZ6hnR+YMLAgOjTfsC+JoMGOfw8b+qKTBDFop/S0eo6Ga/23kvhrgO0ezrKiqFMkS1cH3w==',key_name='tempest-TestStampPattern-174449930',keypairs=<?>,launch_index=0,launched_at=2023-10-16T10:11:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f185c7dee6c4e7f8fe0d7bb2e89e854',ramdisk_id='',reservation_id='r-mzxm26fy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='b547349a-1126-4700-93ca-d39e1da5c5cd',image_min_disk='1',image_min_ram='0',image_owner_id='5f185c7dee6c4e7f8fe0d7bb2e89e854',image_owner_project_name='tempest-TestStampPattern-1468188741',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-1468188741-project-member',image_user_id='122de085fe2d46d18ff8fff362bf7cf5',owner_project_name='tempest-TestStampPattern-1468188741',owner_user_name='tempest-TestStampPattern-1468188741-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T10:11:43Z,user_data=None,user_id='122de085fe2d46d18ff8fff362bf7cf5',uuid=03f1f3a1-a62a-4f58-aa70-50b42bf35110,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "98f36e3c-3285-441a-9258-053b29ffa846", "address": "fa:16:3e:f7:c8:3a", "network": {"id": "ca9b5a27-87ee-46f0-a771-1ba5925e04de", "bridge": "br-int", "label": "tempest-TestStampPattern-847672181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f185c7dee6c4e7f8fe0d7bb2e89e854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f36e3c-32", "ovs_interfaceid": "98f36e3c-3285-441a-9258-053b29ffa846", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 10:14:41 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-9f202f5f-a0b1-4a1f-b5c3-a285c8eba491 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Converting VIF {"id": "98f36e3c-3285-441a-9258-053b29ffa846", "address": "fa:16:3e:f7:c8:3a", "network": {"id": "ca9b5a27-87ee-46f0-a771-1ba5925e04de", "bridge": "br-int", "label": "tempest-TestStampPattern-847672181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.228", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f185c7dee6c4e7f8fe0d7bb2e89e854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f36e3c-32", "ovs_interfaceid": "98f36e3c-3285-441a-9258-053b29ffa846", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:14:41 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-9f202f5f-a0b1-4a1f-b5c3-a285c8eba491 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:c8:3a,bridge_name='br-int',has_traffic_filtering=True,id=98f36e3c-3285-441a-9258-053b29ffa846,network=Network(ca9b5a27-87ee-46f0-a771-1ba5925e04de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98f36e3c-32') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:14:41 user nova-compute[74342]: DEBUG os_vif [None req-9f202f5f-a0b1-4a1f-b5c3-a285c8eba491 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:c8:3a,bridge_name='br-int',has_traffic_filtering=True,id=98f36e3c-3285-441a-9258-053b29ffa846,network=Network(ca9b5a27-87ee-46f0-a771-1ba5925e04de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98f36e3c-32') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 10:14:41 user nova-compute[74342]: DEBUG nova.network.neutron [req-23c74a63-69f5-41c9-98a3-26fe9923d220 req-48c0c601-1dc8-4923-9f22-306ae2eb46ea service nova] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Updated VIF entry in instance network info cache for port 98f36e3c-3285-441a-9258-053b29ffa846. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:14:41 user nova-compute[74342]: DEBUG nova.network.neutron [req-23c74a63-69f5-41c9-98a3-26fe9923d220 req-48c0c601-1dc8-4923-9f22-306ae2eb46ea service nova] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Updating instance_info_cache with network_info: [{"id": "98f36e3c-3285-441a-9258-053b29ffa846", "address": "fa:16:3e:f7:c8:3a", "network": {"id": "ca9b5a27-87ee-46f0-a771-1ba5925e04de", "bridge": "br-int", "label": "tempest-TestStampPattern-847672181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f185c7dee6c4e7f8fe0d7bb2e89e854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap98f36e3c-32", "ovs_interfaceid": "98f36e3c-3285-441a-9258-053b29ffa846", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:14:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap98f36e3c-32, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:14:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:14:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=76b135d0-f84c-46e5-b007-082adca95314) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:14:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-23c74a63-69f5-41c9-98a3-26fe9923d220 req-48c0c601-1dc8-4923-9f22-306ae2eb46ea service nova] Releasing lock "refresh_cache-03f1f3a1-a62a-4f58-aa70-50b42bf35110" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:14:41 user nova-compute[74342]: INFO os_vif [None req-9f202f5f-a0b1-4a1f-b5c3-a285c8eba491 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:c8:3a,bridge_name='br-int',has_traffic_filtering=True,id=98f36e3c-3285-441a-9258-053b29ffa846,network=Network(ca9b5a27-87ee-46f0-a771-1ba5925e04de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap98f36e3c-32')
Oct 16 10:14:41 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-9f202f5f-a0b1-4a1f-b5c3-a285c8eba491 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Deleting instance files /opt/stack/data/nova/instances/03f1f3a1-a62a-4f58-aa70-50b42bf35110_del
Oct 16 10:14:41 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-9f202f5f-a0b1-4a1f-b5c3-a285c8eba491 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Deletion of /opt/stack/data/nova/instances/03f1f3a1-a62a-4f58-aa70-50b42bf35110_del complete
Oct 16 10:14:41 user nova-compute[74342]: INFO nova.compute.manager [None req-9f202f5f-a0b1-4a1f-b5c3-a285c8eba491 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Took 0.92 seconds to destroy the instance on the hypervisor.
Oct 16 10:14:41 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-9f202f5f-a0b1-4a1f-b5c3-a285c8eba491 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 10:14:41 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 10:14:41 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 10:14:42 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:14:42 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Took 0.71 seconds to deallocate network for instance.
Oct 16 10:14:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9f202f5f-a0b1-4a1f-b5c3-a285c8eba491 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:14:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9f202f5f-a0b1-4a1f-b5c3-a285c8eba491 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:14:42 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-9f202f5f-a0b1-4a1f-b5c3-a285c8eba491 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:14:42 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-9f202f5f-a0b1-4a1f-b5c3-a285c8eba491 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:14:42 user nova-compute[74342]: DEBUG nova.compute.manager [req-caec5c1b-1d4b-46fb-9c29-9fb3e52b3f9a req-10ac9080-17a3-405b-9226-6f5857fcdd7c service nova] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Received event network-vif-unplugged-98f36e3c-3285-441a-9258-053b29ffa846 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:14:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-caec5c1b-1d4b-46fb-9c29-9fb3e52b3f9a req-10ac9080-17a3-405b-9226-6f5857fcdd7c service nova] Acquiring lock "03f1f3a1-a62a-4f58-aa70-50b42bf35110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:14:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-caec5c1b-1d4b-46fb-9c29-9fb3e52b3f9a req-10ac9080-17a3-405b-9226-6f5857fcdd7c service nova] Lock "03f1f3a1-a62a-4f58-aa70-50b42bf35110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:14:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-caec5c1b-1d4b-46fb-9c29-9fb3e52b3f9a req-10ac9080-17a3-405b-9226-6f5857fcdd7c service nova] Lock "03f1f3a1-a62a-4f58-aa70-50b42bf35110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:14:42 user nova-compute[74342]: DEBUG nova.compute.manager [req-caec5c1b-1d4b-46fb-9c29-9fb3e52b3f9a req-10ac9080-17a3-405b-9226-6f5857fcdd7c service nova] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] No waiting events found dispatching network-vif-unplugged-98f36e3c-3285-441a-9258-053b29ffa846 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:14:42 user nova-compute[74342]: WARNING nova.compute.manager [req-caec5c1b-1d4b-46fb-9c29-9fb3e52b3f9a req-10ac9080-17a3-405b-9226-6f5857fcdd7c service nova] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Received unexpected event network-vif-unplugged-98f36e3c-3285-441a-9258-053b29ffa846 for instance with vm_state deleted and task_state None.
Oct 16 10:14:42 user nova-compute[74342]: DEBUG nova.compute.manager [req-caec5c1b-1d4b-46fb-9c29-9fb3e52b3f9a req-10ac9080-17a3-405b-9226-6f5857fcdd7c service nova] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Received event network-vif-plugged-98f36e3c-3285-441a-9258-053b29ffa846 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:14:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-caec5c1b-1d4b-46fb-9c29-9fb3e52b3f9a req-10ac9080-17a3-405b-9226-6f5857fcdd7c service nova] Acquiring lock "03f1f3a1-a62a-4f58-aa70-50b42bf35110-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:14:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-caec5c1b-1d4b-46fb-9c29-9fb3e52b3f9a req-10ac9080-17a3-405b-9226-6f5857fcdd7c service nova] Lock "03f1f3a1-a62a-4f58-aa70-50b42bf35110-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:14:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-caec5c1b-1d4b-46fb-9c29-9fb3e52b3f9a req-10ac9080-17a3-405b-9226-6f5857fcdd7c service nova] Lock "03f1f3a1-a62a-4f58-aa70-50b42bf35110-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:14:42 user nova-compute[74342]: DEBUG nova.compute.manager [req-caec5c1b-1d4b-46fb-9c29-9fb3e52b3f9a req-10ac9080-17a3-405b-9226-6f5857fcdd7c service nova] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] No waiting events found dispatching network-vif-plugged-98f36e3c-3285-441a-9258-053b29ffa846 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:14:42 user nova-compute[74342]: WARNING nova.compute.manager [req-caec5c1b-1d4b-46fb-9c29-9fb3e52b3f9a req-10ac9080-17a3-405b-9226-6f5857fcdd7c service nova] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Received unexpected event network-vif-plugged-98f36e3c-3285-441a-9258-053b29ffa846 for instance with vm_state deleted and task_state None.
Oct 16 10:14:42 user nova-compute[74342]: DEBUG nova.compute.manager [req-caec5c1b-1d4b-46fb-9c29-9fb3e52b3f9a req-10ac9080-17a3-405b-9226-6f5857fcdd7c service nova] [instance: 03f1f3a1-a62a-4f58-aa70-50b42bf35110] Received event network-vif-deleted-98f36e3c-3285-441a-9258-053b29ffa846 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:14:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9f202f5f-a0b1-4a1f-b5c3-a285c8eba491 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.256s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:14:42 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-9f202f5f-a0b1-4a1f-b5c3-a285c8eba491 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Deleted allocations for instance 03f1f3a1-a62a-4f58-aa70-50b42bf35110
Oct 16 10:14:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-9f202f5f-a0b1-4a1f-b5c3-a285c8eba491 tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "03f1f3a1-a62a-4f58-aa70-50b42bf35110" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.099s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:14:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:14:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:14:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:15:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:15:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:10 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:15:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:15:12 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:15:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:15:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:15:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:15:12 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:15:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:15:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:15:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:15:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:15:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:15:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:15:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:15:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:15:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:15:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json" returned: 0 in 0.199s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:15:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:15:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:15:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:15:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:15:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:15:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:15:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:15:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:15:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:15:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:15:14 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:15:14 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:15:14 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8622MB free_disk=24.889423370361328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:15:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:15:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:15:15 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 34ef7d18-0724-479a-8448-981b9cf0d6ab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:15:15 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7d016ab3-14c4-4c33-bd50-468f71339cd7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:15:15 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance b547349a-1126-4700-93ca-d39e1da5c5cd actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:15:15 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:15:15 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:15:15 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:15:15 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:15:15 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:15:15 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:15:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.320s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:15:15 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:15:15 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:15:15 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Cleaning up deleted instances {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 10:15:15 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] There are 1 instances to clean {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 10:15:15 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Instance has had 5 of 5 cleanup attempts {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 16 10:15:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:17 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:15:17 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:15:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-7d016ab3-14c4-4c33-bd50-468f71339cd7" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:15:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-7d016ab3-14c4-4c33-bd50-468f71339cd7" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:15:17 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:15:17 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Updating instance_info_cache with network_info: [{"id": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "address": "fa:16:3e:de:cb:e3", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74fa1b3-86", "ovs_interfaceid": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:15:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-7d016ab3-14c4-4c33-bd50-468f71339cd7" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:15:17 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:15:18 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:15:18 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:15:19 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:15:19 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:15:20 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:15:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:23 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:15:23 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:15:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:25 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:15:25 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74342) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 10:15:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "e5932eb4-88be-4933-8e2f-0201d9303ffc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:15:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:15:36 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 10:15:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:15:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:15:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 10:15:36 user nova-compute[74342]: INFO nova.compute.claims [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Claim successful on node user
Oct 16 10:15:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:36 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:15:36 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:15:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.281s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:15:36 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 10:15:36 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 10:15:36 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 10:15:36 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 10:15:36 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 10:15:36 user nova-compute[74342]: DEBUG nova.policy [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa5d15e5061141f798d8e0f58cae2c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd121feadb9b94fe09dd25b0d5adedb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 10:15:36 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 10:15:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 10:15:36 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Creating image(s)
Oct 16 10:15:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "/opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:15:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "/opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:15:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "/opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:15:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "e39c73c64aea252a31091e4bd2cc27798227fcef" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:15:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "e39c73c64aea252a31091e4bd2cc27798227fcef" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:15:37 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e39c73c64aea252a31091e4bd2cc27798227fcef.part --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:15:37 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Successfully created port: 8edcd15a-87a9-43d6-9674-8a8ec38c6155 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 10:15:37 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e39c73c64aea252a31091e4bd2cc27798227fcef.part --force-share --output=json" returned: 0 in 0.185s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:15:37 user nova-compute[74342]: DEBUG nova.virt.images [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] 89e64f2a-3d34-4fea-a74f-92e55e89516d was qcow2, converting to raw {{(pid=74342) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 10:15:37 user nova-compute[74342]: DEBUG nova.privsep.utils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 10:15:37 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e39c73c64aea252a31091e4bd2cc27798227fcef.part /opt/stack/data/nova/instances/_base/e39c73c64aea252a31091e4bd2cc27798227fcef.converted {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:15:37 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e39c73c64aea252a31091e4bd2cc27798227fcef.part /opt/stack/data/nova/instances/_base/e39c73c64aea252a31091e4bd2cc27798227fcef.converted" returned: 0 in 0.296s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:15:37 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e39c73c64aea252a31091e4bd2cc27798227fcef.converted --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:15:37 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e39c73c64aea252a31091e4bd2cc27798227fcef.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:15:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "e39c73c64aea252a31091e4bd2cc27798227fcef" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.140s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:15:37 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e39c73c64aea252a31091e4bd2cc27798227fcef --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:15:37 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Successfully updated port: 8edcd15a-87a9-43d6-9674-8a8ec38c6155 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 10:15:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "refresh_cache-e5932eb4-88be-4933-8e2f-0201d9303ffc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:15:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquired lock "refresh_cache-e5932eb4-88be-4933-8e2f-0201d9303ffc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:15:37 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:15:37 user nova-compute[74342]: DEBUG nova.compute.manager [req-4b0ec646-dad8-4366-858c-6f4f76aa0428 req-d63e465f-6160-45e1-9d4e-c2fdd2127226 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Received event network-changed-8edcd15a-87a9-43d6-9674-8a8ec38c6155 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:15:37 user nova-compute[74342]: DEBUG nova.compute.manager [req-4b0ec646-dad8-4366-858c-6f4f76aa0428 req-d63e465f-6160-45e1-9d4e-c2fdd2127226 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Refreshing instance network info cache due to event network-changed-8edcd15a-87a9-43d6-9674-8a8ec38c6155. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:15:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4b0ec646-dad8-4366-858c-6f4f76aa0428 req-d63e465f-6160-45e1-9d4e-c2fdd2127226 service nova] Acquiring lock "refresh_cache-e5932eb4-88be-4933-8e2f-0201d9303ffc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:15:37 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 10:15:37 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e39c73c64aea252a31091e4bd2cc27798227fcef --force-share --output=json" returned: 0 in 0.189s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:15:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "e39c73c64aea252a31091e4bd2cc27798227fcef" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:15:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "e39c73c64aea252a31091e4bd2cc27798227fcef" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:15:37 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e39c73c64aea252a31091e4bd2cc27798227fcef --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e39c73c64aea252a31091e4bd2cc27798227fcef --force-share --output=json" returned: 0 in 0.173s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e39c73c64aea252a31091e4bd2cc27798227fcef,backing_fmt=raw /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.network.neutron [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Updating instance_info_cache with network_info: [{"id": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "address": "fa:16:3e:47:35:4d", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edcd15a-87", "ovs_interfaceid": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e39c73c64aea252a31091e4bd2cc27798227fcef,backing_fmt=raw /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk 1073741824" returned: 0 in 0.047s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "e39c73c64aea252a31091e4bd2cc27798227fcef" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e39c73c64aea252a31091e4bd2cc27798227fcef --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Releasing lock "refresh_cache-e5932eb4-88be-4933-8e2f-0201d9303ffc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Instance network_info: |[{"id": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "address": "fa:16:3e:47:35:4d", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edcd15a-87", "ovs_interfaceid": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4b0ec646-dad8-4366-858c-6f4f76aa0428 req-d63e465f-6160-45e1-9d4e-c2fdd2127226 service nova] Acquired lock "refresh_cache-e5932eb4-88be-4933-8e2f-0201d9303ffc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.network.neutron [req-4b0ec646-dad8-4366-858c-6f4f76aa0428 req-d63e465f-6160-45e1-9d4e-c2fdd2127226 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Refreshing network info cache for port 8edcd15a-87a9-43d6-9674-8a8ec38c6155 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e39c73c64aea252a31091e4bd2cc27798227fcef --force-share --output=json" returned: 0 in 0.174s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Cannot resize image /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Ensure instance console log exists: /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Start _get_guest_xml network_info=[{"id": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "address": "fa:16:3e:47:35:4d", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edcd15a-87", "ovs_interfaceid": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T10:15:33Z,direct_url=<?>,disk_format='qcow2',id=89e64f2a-3d34-4fea-a74f-92e55e89516d,min_disk=0,min_ram=0,name='tempest-scenario-img--483563941',owner='d121feadb9b94fe09dd25b0d5adedb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T10:15:35Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '89e64f2a-3d34-4fea-a74f-92e55e89516d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 10:15:38 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:15:38 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T10:15:33Z,direct_url=<?>,disk_format='qcow2',id=89e64f2a-3d34-4fea-a74f-92e55e89516d,min_disk=0,min_ram=0,name='tempest-scenario-img--483563941',owner='d121feadb9b94fe09dd25b0d5adedb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T10:15:35Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1480925964',display_name='tempest-TestMinimumBasicScenario-server-1480925964',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1480925964',id=47,image_ref='89e64f2a-3d34-4fea-a74f-92e55e89516d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXXZhgHmnUAZ47mUNhjP/DiMnlMHb5+XnkQwzyGb4Ge2Imhmk9flfIoP+nvZ6DYxlWCRt0Biq7X30JLPqManXPpmNAaqN5f3CuL8UvtnY0eEgtz48VaNWN4h5HNPTP6XA==',key_name='tempest-TestMinimumBasicScenario-545706033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d121feadb9b94fe09dd25b0d5adedb6e',ramdisk_id='',reservation_id='r-h4fn136a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='89e64f2a-3d34-4fea-a74f-92e55e89516d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-643895215',owner_user_name='tempest-TestMinimumBasicScenario-643895215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:15:37Z,user_data=None,user_id='fa5d15e5061141f798d8e0f58cae2c7f',uuid=e5932eb4-88be-4933-8e2f-0201d9303ffc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "address": "fa:16:3e:47:35:4d", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edcd15a-87", "ovs_interfaceid": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Converting VIF {"id": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "address": "fa:16:3e:47:35:4d", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edcd15a-87", "ovs_interfaceid": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:35:4d,bridge_name='br-int',has_traffic_filtering=True,id=8edcd15a-87a9-43d6-9674-8a8ec38c6155,network=Network(9adc3611-05c0-400f-99d4-a61f2c9e74d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8edcd15a-87') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.objects.instance [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lazy-loading 'pci_devices' on Instance uuid e5932eb4-88be-4933-8e2f-0201d9303ffc {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] End _get_guest_xml xml=<domain type="kvm">
Oct 16 10:15:38 user nova-compute[74342]:   <uuid>e5932eb4-88be-4933-8e2f-0201d9303ffc</uuid>
Oct 16 10:15:38 user nova-compute[74342]:   <name>instance-0000002f</name>
Oct 16 10:15:38 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 10:15:38 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 10:15:38 user nova-compute[74342]:   <metadata>
Oct 16 10:15:38 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 10:15:38 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 10:15:38 user nova-compute[74342]:       <nova:name>tempest-TestMinimumBasicScenario-server-1480925964</nova:name>
Oct 16 10:15:38 user nova-compute[74342]:       <nova:creationTime>2023-10-16 10:15:38</nova:creationTime>
Oct 16 10:15:38 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 10:15:38 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 10:15:38 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 10:15:38 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 10:15:38 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 10:15:38 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 10:15:38 user nova-compute[74342]:       </nova:flavor>
Oct 16 10:15:38 user nova-compute[74342]:       <nova:owner>
Oct 16 10:15:38 user nova-compute[74342]:         <nova:user uuid="fa5d15e5061141f798d8e0f58cae2c7f">tempest-TestMinimumBasicScenario-643895215-project-member</nova:user>
Oct 16 10:15:38 user nova-compute[74342]:         <nova:project uuid="d121feadb9b94fe09dd25b0d5adedb6e">tempest-TestMinimumBasicScenario-643895215</nova:project>
Oct 16 10:15:38 user nova-compute[74342]:       </nova:owner>
Oct 16 10:15:38 user nova-compute[74342]:       <nova:root type="image" uuid="89e64f2a-3d34-4fea-a74f-92e55e89516d"/>
Oct 16 10:15:38 user nova-compute[74342]:       <nova:ports>
Oct 16 10:15:38 user nova-compute[74342]:         <nova:port uuid="8edcd15a-87a9-43d6-9674-8a8ec38c6155">
Oct 16 10:15:38 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 16 10:15:38 user nova-compute[74342]:         </nova:port>
Oct 16 10:15:38 user nova-compute[74342]:       </nova:ports>
Oct 16 10:15:38 user nova-compute[74342]:     </nova:instance>
Oct 16 10:15:38 user nova-compute[74342]:   </metadata>
Oct 16 10:15:38 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 10:15:38 user nova-compute[74342]:     <system>
Oct 16 10:15:38 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 10:15:38 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 10:15:38 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 10:15:38 user nova-compute[74342]:       <entry name="serial">e5932eb4-88be-4933-8e2f-0201d9303ffc</entry>
Oct 16 10:15:38 user nova-compute[74342]:       <entry name="uuid">e5932eb4-88be-4933-8e2f-0201d9303ffc</entry>
Oct 16 10:15:38 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 10:15:38 user nova-compute[74342]:     </system>
Oct 16 10:15:38 user nova-compute[74342]:   </sysinfo>
Oct 16 10:15:38 user nova-compute[74342]:   <os>
Oct 16 10:15:38 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 10:15:38 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 10:15:38 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 10:15:38 user nova-compute[74342]:   </os>
Oct 16 10:15:38 user nova-compute[74342]:   <features>
Oct 16 10:15:38 user nova-compute[74342]:     <acpi/>
Oct 16 10:15:38 user nova-compute[74342]:     <apic/>
Oct 16 10:15:38 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 10:15:38 user nova-compute[74342]:   </features>
Oct 16 10:15:38 user nova-compute[74342]:   <clock offset="utc">
Oct 16 10:15:38 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 10:15:38 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 10:15:38 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 10:15:38 user nova-compute[74342]:   </clock>
Oct 16 10:15:38 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 10:15:38 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 10:15:38 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 10:15:38 user nova-compute[74342]:   </cpu>
Oct 16 10:15:38 user nova-compute[74342]:   <devices>
Oct 16 10:15:38 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 10:15:38 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 10:15:38 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk"/>
Oct 16 10:15:38 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 10:15:38 user nova-compute[74342]:     </disk>
Oct 16 10:15:38 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 10:15:38 user nova-compute[74342]:       <mac address="fa:16:3e:47:35:4d"/>
Oct 16 10:15:38 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:15:38 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 10:15:38 user nova-compute[74342]:       <target dev="tap8edcd15a-87"/>
Oct 16 10:15:38 user nova-compute[74342]:     </interface>
Oct 16 10:15:38 user nova-compute[74342]:     <serial type="pty">
Oct 16 10:15:38 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/console.log" append="off"/>
Oct 16 10:15:38 user nova-compute[74342]:     </serial>
Oct 16 10:15:38 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 10:15:38 user nova-compute[74342]:     <video>
Oct 16 10:15:38 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:15:38 user nova-compute[74342]:     </video>
Oct 16 10:15:38 user nova-compute[74342]:     <rng model="virtio">
Oct 16 10:15:38 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 10:15:38 user nova-compute[74342]:     </rng>
Oct 16 10:15:38 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 10:15:38 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 10:15:38 user nova-compute[74342]:       <stats period="10"/>
Oct 16 10:15:38 user nova-compute[74342]:     </memballoon>
Oct 16 10:15:38 user nova-compute[74342]:   </devices>
Oct 16 10:15:38 user nova-compute[74342]: </domain>
Oct 16 10:15:38 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1480925964',display_name='tempest-TestMinimumBasicScenario-server-1480925964',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1480925964',id=47,image_ref='89e64f2a-3d34-4fea-a74f-92e55e89516d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXXZhgHmnUAZ47mUNhjP/DiMnlMHb5+XnkQwzyGb4Ge2Imhmk9flfIoP+nvZ6DYxlWCRt0Biq7X30JLPqManXPpmNAaqN5f3CuL8UvtnY0eEgtz48VaNWN4h5HNPTP6XA==',key_name='tempest-TestMinimumBasicScenario-545706033',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d121feadb9b94fe09dd25b0d5adedb6e',ramdisk_id='',reservation_id='r-h4fn136a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='89e64f2a-3d34-4fea-a74f-92e55e89516d',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-643895215',owner_user_name='tempest-TestMinimumBasicScenario-643895215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:15:37Z,user_data=None,user_id='fa5d15e5061141f798d8e0f58cae2c7f',uuid=e5932eb4-88be-4933-8e2f-0201d9303ffc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "address": "fa:16:3e:47:35:4d", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edcd15a-87", "ovs_interfaceid": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Converting VIF {"id": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "address": "fa:16:3e:47:35:4d", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edcd15a-87", "ovs_interfaceid": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:35:4d,bridge_name='br-int',has_traffic_filtering=True,id=8edcd15a-87a9-43d6-9674-8a8ec38c6155,network=Network(9adc3611-05c0-400f-99d4-a61f2c9e74d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8edcd15a-87') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG os_vif [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:35:4d,bridge_name='br-int',has_traffic_filtering=True,id=8edcd15a-87a9-43d6-9674-8a8ec38c6155,network=Network(9adc3611-05c0-400f-99d4-a61f2c9e74d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8edcd15a-87') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4bce745-ee99-5892-8251-bf6ae4b51146', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8edcd15a-87, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8edcd15a-87, col_values=(('qos', UUID('e0400fb0-f813-4790-8260-cde177ed5866')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8edcd15a-87, col_values=(('external_ids', {'iface-id': '8edcd15a-87a9-43d6-9674-8a8ec38c6155', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:35:4d', 'vm-uuid': 'e5932eb4-88be-4933-8e2f-0201d9303ffc'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:38 user nova-compute[74342]: INFO os_vif [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:35:4d,bridge_name='br-int',has_traffic_filtering=True,id=8edcd15a-87a9-43d6-9674-8a8ec38c6155,network=Network(9adc3611-05c0-400f-99d4-a61f2c9e74d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8edcd15a-87')
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.network.neutron [req-4b0ec646-dad8-4366-858c-6f4f76aa0428 req-d63e465f-6160-45e1-9d4e-c2fdd2127226 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Updated VIF entry in instance network info cache for port 8edcd15a-87a9-43d6-9674-8a8ec38c6155. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.network.neutron [req-4b0ec646-dad8-4366-858c-6f4f76aa0428 req-d63e465f-6160-45e1-9d4e-c2fdd2127226 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Updating instance_info_cache with network_info: [{"id": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "address": "fa:16:3e:47:35:4d", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edcd15a-87", "ovs_interfaceid": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4b0ec646-dad8-4366-858c-6f4f76aa0428 req-d63e465f-6160-45e1-9d4e-c2fdd2127226 service nova] Releasing lock "refresh_cache-e5932eb4-88be-4933-8e2f-0201d9303ffc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:15:38 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] No VIF found with MAC fa:16:3e:47:35:4d, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:15:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:40 user nova-compute[74342]: DEBUG nova.compute.manager [req-28bdbfc7-da0c-4855-be1f-bc79bfd6f9b7 req-bdb9e78d-dccf-467e-ba24-9e4ffcef79c0 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Received event network-vif-plugged-8edcd15a-87a9-43d6-9674-8a8ec38c6155 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:15:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-28bdbfc7-da0c-4855-be1f-bc79bfd6f9b7 req-bdb9e78d-dccf-467e-ba24-9e4ffcef79c0 service nova] Acquiring lock "e5932eb4-88be-4933-8e2f-0201d9303ffc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:15:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-28bdbfc7-da0c-4855-be1f-bc79bfd6f9b7 req-bdb9e78d-dccf-467e-ba24-9e4ffcef79c0 service nova] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:15:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-28bdbfc7-da0c-4855-be1f-bc79bfd6f9b7 req-bdb9e78d-dccf-467e-ba24-9e4ffcef79c0 service nova] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:15:40 user nova-compute[74342]: DEBUG nova.compute.manager [req-28bdbfc7-da0c-4855-be1f-bc79bfd6f9b7 req-bdb9e78d-dccf-467e-ba24-9e4ffcef79c0 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] No waiting events found dispatching network-vif-plugged-8edcd15a-87a9-43d6-9674-8a8ec38c6155 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:15:40 user nova-compute[74342]: WARNING nova.compute.manager [req-28bdbfc7-da0c-4855-be1f-bc79bfd6f9b7 req-bdb9e78d-dccf-467e-ba24-9e4ffcef79c0 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Received unexpected event network-vif-plugged-8edcd15a-87a9-43d6-9674-8a8ec38c6155 for instance with vm_state building and task_state spawning.
Oct 16 10:15:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:42 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 10:15:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 10:15:42 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Instance spawned successfully.
Oct 16 10:15:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 10:15:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:15:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:15:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:15:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:15:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:15:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:15:42 user nova-compute[74342]: INFO nova.compute.manager [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Took 5.61 seconds to spawn the instance on the hypervisor.
Oct 16 10:15:42 user nova-compute[74342]: DEBUG nova.compute.manager [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:15:42 user nova-compute[74342]: DEBUG nova.compute.manager [req-ece205d5-7b68-418f-88ae-83aad0c1f914 req-eb1368c7-378c-4e25-8e0a-288b3e735df1 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Received event network-vif-plugged-8edcd15a-87a9-43d6-9674-8a8ec38c6155 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:15:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ece205d5-7b68-418f-88ae-83aad0c1f914 req-eb1368c7-378c-4e25-8e0a-288b3e735df1 service nova] Acquiring lock "e5932eb4-88be-4933-8e2f-0201d9303ffc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:15:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ece205d5-7b68-418f-88ae-83aad0c1f914 req-eb1368c7-378c-4e25-8e0a-288b3e735df1 service nova] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:15:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ece205d5-7b68-418f-88ae-83aad0c1f914 req-eb1368c7-378c-4e25-8e0a-288b3e735df1 service nova] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:15:42 user nova-compute[74342]: DEBUG nova.compute.manager [req-ece205d5-7b68-418f-88ae-83aad0c1f914 req-eb1368c7-378c-4e25-8e0a-288b3e735df1 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] No waiting events found dispatching network-vif-plugged-8edcd15a-87a9-43d6-9674-8a8ec38c6155 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:15:42 user nova-compute[74342]: WARNING nova.compute.manager [req-ece205d5-7b68-418f-88ae-83aad0c1f914 req-eb1368c7-378c-4e25-8e0a-288b3e735df1 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Received unexpected event network-vif-plugged-8edcd15a-87a9-43d6-9674-8a8ec38c6155 for instance with vm_state building and task_state spawning.
Oct 16 10:15:42 user nova-compute[74342]: INFO nova.compute.manager [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Took 6.22 seconds to build instance.
Oct 16 10:15:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c28c2706-5a63-4644-8d67-624ee96f2a9b tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.321s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:15:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:49 user nova-compute[74342]: DEBUG nova.compute.manager [req-44e6a504-9449-48cd-8142-58488b98039c req-b2c86d22-bbdb-4e83-bb76-0b7856c598df service nova] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Received event network-changed-841bff3b-23d1-4225-af17-45709c874a35 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:15:49 user nova-compute[74342]: DEBUG nova.compute.manager [req-44e6a504-9449-48cd-8142-58488b98039c req-b2c86d22-bbdb-4e83-bb76-0b7856c598df service nova] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Refreshing instance network info cache due to event network-changed-841bff3b-23d1-4225-af17-45709c874a35. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:15:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-44e6a504-9449-48cd-8142-58488b98039c req-b2c86d22-bbdb-4e83-bb76-0b7856c598df service nova] Acquiring lock "refresh_cache-b547349a-1126-4700-93ca-d39e1da5c5cd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:15:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-44e6a504-9449-48cd-8142-58488b98039c req-b2c86d22-bbdb-4e83-bb76-0b7856c598df service nova] Acquired lock "refresh_cache-b547349a-1126-4700-93ca-d39e1da5c5cd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:15:49 user nova-compute[74342]: DEBUG nova.network.neutron [req-44e6a504-9449-48cd-8142-58488b98039c req-b2c86d22-bbdb-4e83-bb76-0b7856c598df service nova] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Refreshing network info cache for port 841bff3b-23d1-4225-af17-45709c874a35 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:15:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2e4951f2-df51-4340-8f1d-cedeef8ab32c tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "b547349a-1126-4700-93ca-d39e1da5c5cd" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:15:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2e4951f2-df51-4340-8f1d-cedeef8ab32c tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "b547349a-1126-4700-93ca-d39e1da5c5cd" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:15:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2e4951f2-df51-4340-8f1d-cedeef8ab32c tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "b547349a-1126-4700-93ca-d39e1da5c5cd-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:15:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2e4951f2-df51-4340-8f1d-cedeef8ab32c tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "b547349a-1126-4700-93ca-d39e1da5c5cd-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:15:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2e4951f2-df51-4340-8f1d-cedeef8ab32c tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "b547349a-1126-4700-93ca-d39e1da5c5cd-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:15:50 user nova-compute[74342]: INFO nova.compute.manager [None req-2e4951f2-df51-4340-8f1d-cedeef8ab32c tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Terminating instance
Oct 16 10:15:50 user nova-compute[74342]: DEBUG nova.compute.manager [None req-2e4951f2-df51-4340-8f1d-cedeef8ab32c tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 10:15:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:50 user nova-compute[74342]: DEBUG nova.network.neutron [req-44e6a504-9449-48cd-8142-58488b98039c req-b2c86d22-bbdb-4e83-bb76-0b7856c598df service nova] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Updated VIF entry in instance network info cache for port 841bff3b-23d1-4225-af17-45709c874a35. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:15:50 user nova-compute[74342]: DEBUG nova.network.neutron [req-44e6a504-9449-48cd-8142-58488b98039c req-b2c86d22-bbdb-4e83-bb76-0b7856c598df service nova] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Updating instance_info_cache with network_info: [{"id": "841bff3b-23d1-4225-af17-45709c874a35", "address": "fa:16:3e:8f:4b:dc", "network": {"id": "ca9b5a27-87ee-46f0-a771-1ba5925e04de", "bridge": "br-int", "label": "tempest-TestStampPattern-847672181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f185c7dee6c4e7f8fe0d7bb2e89e854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841bff3b-23", "ovs_interfaceid": "841bff3b-23d1-4225-af17-45709c874a35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:15:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-44e6a504-9449-48cd-8142-58488b98039c req-b2c86d22-bbdb-4e83-bb76-0b7856c598df service nova] Releasing lock "refresh_cache-b547349a-1126-4700-93ca-d39e1da5c5cd" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:15:50 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Instance destroyed successfully.
Oct 16 10:15:50 user nova-compute[74342]: DEBUG nova.objects.instance [None req-2e4951f2-df51-4340-8f1d-cedeef8ab32c tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lazy-loading 'resources' on Instance uuid b547349a-1126-4700-93ca-d39e1da5c5cd {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:15:50 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-2e4951f2-df51-4340-8f1d-cedeef8ab32c tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:07:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1363180860',display_name='tempest-TestStampPattern-server-1363180860',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1363180860',id=41,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNqaEvE2WxtZyUpj/QXmrU1PYxONwCsPW4U4I5X6LON7fZWTJ1Ui7jNxiJSotZ6hnR+YMLAgOjTfsC+JoMGOfw8b+qKTBDFop/S0eo6Ga/23kvhrgO0ezrKiqFMkS1cH3w==',key_name='tempest-TestStampPattern-174449930',keypairs=<?>,launch_index=0,launched_at=2023-10-16T10:08:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='5f185c7dee6c4e7f8fe0d7bb2e89e854',ramdisk_id='',reservation_id='r-093q486k',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-1468188741',owner_user_name='tempest-TestStampPattern-1468188741-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T10:11:33Z,user_data=None,user_id='122de085fe2d46d18ff8fff362bf7cf5',uuid=b547349a-1126-4700-93ca-d39e1da5c5cd,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "841bff3b-23d1-4225-af17-45709c874a35", "address": "fa:16:3e:8f:4b:dc", "network": {"id": "ca9b5a27-87ee-46f0-a771-1ba5925e04de", "bridge": "br-int", "label": "tempest-TestStampPattern-847672181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f185c7dee6c4e7f8fe0d7bb2e89e854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841bff3b-23", "ovs_interfaceid": "841bff3b-23d1-4225-af17-45709c874a35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 10:15:50 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-2e4951f2-df51-4340-8f1d-cedeef8ab32c tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Converting VIF {"id": "841bff3b-23d1-4225-af17-45709c874a35", "address": "fa:16:3e:8f:4b:dc", "network": {"id": "ca9b5a27-87ee-46f0-a771-1ba5925e04de", "bridge": "br-int", "label": "tempest-TestStampPattern-847672181-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "5f185c7dee6c4e7f8fe0d7bb2e89e854", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap841bff3b-23", "ovs_interfaceid": "841bff3b-23d1-4225-af17-45709c874a35", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:15:50 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-2e4951f2-df51-4340-8f1d-cedeef8ab32c tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:4b:dc,bridge_name='br-int',has_traffic_filtering=True,id=841bff3b-23d1-4225-af17-45709c874a35,network=Network(ca9b5a27-87ee-46f0-a771-1ba5925e04de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841bff3b-23') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:15:50 user nova-compute[74342]: DEBUG os_vif [None req-2e4951f2-df51-4340-8f1d-cedeef8ab32c tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:4b:dc,bridge_name='br-int',has_traffic_filtering=True,id=841bff3b-23d1-4225-af17-45709c874a35,network=Network(ca9b5a27-87ee-46f0-a771-1ba5925e04de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841bff3b-23') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 10:15:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap841bff3b-23, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:15:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:15:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=096517e9-5cd6-4a03-bf2e-cd221be2cc41) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:15:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:15:50 user nova-compute[74342]: INFO os_vif [None req-2e4951f2-df51-4340-8f1d-cedeef8ab32c tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:4b:dc,bridge_name='br-int',has_traffic_filtering=True,id=841bff3b-23d1-4225-af17-45709c874a35,network=Network(ca9b5a27-87ee-46f0-a771-1ba5925e04de),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap841bff3b-23')
Oct 16 10:15:50 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-2e4951f2-df51-4340-8f1d-cedeef8ab32c tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Deleting instance files /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd_del
Oct 16 10:15:50 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-2e4951f2-df51-4340-8f1d-cedeef8ab32c tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Deletion of /opt/stack/data/nova/instances/b547349a-1126-4700-93ca-d39e1da5c5cd_del complete
Oct 16 10:15:51 user nova-compute[74342]: INFO nova.compute.manager [None req-2e4951f2-df51-4340-8f1d-cedeef8ab32c tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Took 0.91 seconds to destroy the instance on the hypervisor.
Oct 16 10:15:51 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-2e4951f2-df51-4340-8f1d-cedeef8ab32c tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 10:15:51 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 10:15:51 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 10:15:51 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:15:51 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Took 0.40 seconds to deallocate network for instance.
Oct 16 10:15:51 user nova-compute[74342]: DEBUG nova.compute.manager [req-5982dd06-4c3e-4b28-9fe3-235f72580a89 req-e85c83d0-199e-4300-957a-69f028f066c8 service nova] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Received event network-vif-deleted-841bff3b-23d1-4225-af17-45709c874a35 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:15:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2e4951f2-df51-4340-8f1d-cedeef8ab32c tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:15:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2e4951f2-df51-4340-8f1d-cedeef8ab32c tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:15:51 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-2e4951f2-df51-4340-8f1d-cedeef8ab32c tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:15:51 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-2e4951f2-df51-4340-8f1d-cedeef8ab32c tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:15:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2e4951f2-df51-4340-8f1d-cedeef8ab32c tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.198s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:15:51 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-2e4951f2-df51-4340-8f1d-cedeef8ab32c tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Deleted allocations for instance b547349a-1126-4700-93ca-d39e1da5c5cd
Oct 16 10:15:51 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2e4951f2-df51-4340-8f1d-cedeef8ab32c tempest-TestStampPattern-1468188741 tempest-TestStampPattern-1468188741-project-member] Lock "b547349a-1126-4700-93ca-d39e1da5c5cd" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.715s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG nova.compute.manager [req-756009ec-ed6a-4639-8518-200790ae17b5 req-7705671d-6dc3-440b-877c-d050c7faaeba service nova] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Received event network-vif-unplugged-841bff3b-23d1-4225-af17-45709c874a35 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-756009ec-ed6a-4639-8518-200790ae17b5 req-7705671d-6dc3-440b-877c-d050c7faaeba service nova] Acquiring lock "b547349a-1126-4700-93ca-d39e1da5c5cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-756009ec-ed6a-4639-8518-200790ae17b5 req-7705671d-6dc3-440b-877c-d050c7faaeba service nova] Lock "b547349a-1126-4700-93ca-d39e1da5c5cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-756009ec-ed6a-4639-8518-200790ae17b5 req-7705671d-6dc3-440b-877c-d050c7faaeba service nova] Lock "b547349a-1126-4700-93ca-d39e1da5c5cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG nova.compute.manager [req-756009ec-ed6a-4639-8518-200790ae17b5 req-7705671d-6dc3-440b-877c-d050c7faaeba service nova] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] No waiting events found dispatching network-vif-unplugged-841bff3b-23d1-4225-af17-45709c874a35 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:15:52 user nova-compute[74342]: WARNING nova.compute.manager [req-756009ec-ed6a-4639-8518-200790ae17b5 req-7705671d-6dc3-440b-877c-d050c7faaeba service nova] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Received unexpected event network-vif-unplugged-841bff3b-23d1-4225-af17-45709c874a35 for instance with vm_state deleted and task_state None.
Oct 16 10:15:52 user nova-compute[74342]: DEBUG nova.compute.manager [req-756009ec-ed6a-4639-8518-200790ae17b5 req-7705671d-6dc3-440b-877c-d050c7faaeba service nova] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Received event network-vif-plugged-841bff3b-23d1-4225-af17-45709c874a35 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-756009ec-ed6a-4639-8518-200790ae17b5 req-7705671d-6dc3-440b-877c-d050c7faaeba service nova] Acquiring lock "b547349a-1126-4700-93ca-d39e1da5c5cd-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-756009ec-ed6a-4639-8518-200790ae17b5 req-7705671d-6dc3-440b-877c-d050c7faaeba service nova] Lock "b547349a-1126-4700-93ca-d39e1da5c5cd-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-756009ec-ed6a-4639-8518-200790ae17b5 req-7705671d-6dc3-440b-877c-d050c7faaeba service nova] Lock "b547349a-1126-4700-93ca-d39e1da5c5cd-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG nova.compute.manager [req-756009ec-ed6a-4639-8518-200790ae17b5 req-7705671d-6dc3-440b-877c-d050c7faaeba service nova] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] No waiting events found dispatching network-vif-plugged-841bff3b-23d1-4225-af17-45709c874a35 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:15:52 user nova-compute[74342]: WARNING nova.compute.manager [req-756009ec-ed6a-4639-8518-200790ae17b5 req-7705671d-6dc3-440b-877c-d050c7faaeba service nova] [instance: b547349a-1126-4700-93ca-d39e1da5c5cd] Received unexpected event network-vif-plugged-841bff3b-23d1-4225-af17-45709c874a35 for instance with vm_state deleted and task_state None.
Oct 16 10:15:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG nova.objects.instance [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lazy-loading 'flavor' on Instance uuid fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.054s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:15:52 user nova-compute[74342]: INFO nova.compute.manager [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Attaching volume 8e906e35-53f0-4ce3-a61f-511d9a37d890 to /dev/vdb
Oct 16 10:15:52 user nova-compute[74342]: DEBUG os_brick.utils [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9cf4fab-e859-4aa3-acf0-483a60b9851b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e859e39-b066-4930-8fc4-9fc902c7cf11]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5f9d8b-c3b4-49ee-ad62-8753ea328155]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[933120c9-8cb2-4eb3-83e1-918f91571d70]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:15:52 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 10:15:52 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f56af08e-0ad0-4150-9a38-089897d64b1c]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG os_brick.utils [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:15:52 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Updating existing volume attachment record: 6fe82a6f-d7e0-4aec-84e2-2de0cb58e05c {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 10:15:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:54 user nova-compute[74342]: DEBUG nova.compute.manager [req-c6eb965d-faba-40bc-bd83-164b7abe7ca6 req-e021387d-cef6-4177-a025-d3a7c2332e0d service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received event network-changed-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:15:54 user nova-compute[74342]: DEBUG nova.compute.manager [req-c6eb965d-faba-40bc-bd83-164b7abe7ca6 req-e021387d-cef6-4177-a025-d3a7c2332e0d service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Refreshing instance network info cache due to event network-changed-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:15:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c6eb965d-faba-40bc-bd83-164b7abe7ca6 req-e021387d-cef6-4177-a025-d3a7c2332e0d service nova] Acquiring lock "refresh_cache-fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:15:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c6eb965d-faba-40bc-bd83-164b7abe7ca6 req-e021387d-cef6-4177-a025-d3a7c2332e0d service nova] Acquired lock "refresh_cache-fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:15:54 user nova-compute[74342]: DEBUG nova.network.neutron [req-c6eb965d-faba-40bc-bd83-164b7abe7ca6 req-e021387d-cef6-4177-a025-d3a7c2332e0d service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Refreshing network info cache for port 0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:15:54 user nova-compute[74342]: DEBUG nova.network.neutron [req-c6eb965d-faba-40bc-bd83-164b7abe7ca6 req-e021387d-cef6-4177-a025-d3a7c2332e0d service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Updated VIF entry in instance network info cache for port 0aba45fe-3675-4a86-ac2d-9eac3af1ecc6. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:15:54 user nova-compute[74342]: DEBUG nova.network.neutron [req-c6eb965d-faba-40bc-bd83-164b7abe7ca6 req-e021387d-cef6-4177-a025-d3a7c2332e0d service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Updating instance_info_cache with network_info: [{"id": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "address": "fa:16:3e:48:08:65", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aba45fe-36", "ovs_interfaceid": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:15:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c6eb965d-faba-40bc-bd83-164b7abe7ca6 req-e021387d-cef6-4177-a025-d3a7c2332e0d service nova] Releasing lock "refresh_cache-fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:15:55 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:15:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xJmlCTda', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:16:08 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:16:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:16:08 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:16:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:16:08 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f8e1c5-4033-4350-8c97-7b4c02869b39]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 10:16:08 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[da7c919c-4997-473d-8e29-9ed02085ad19]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890] added
Oct 16 10:16:08 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b59bf783-4600-4d6b-9819-a3ec51b54795]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[643b1971-b0ff-4dd5-aed2-d6e86b5ab5e4]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xJmlCTda {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xJmlCTda" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd191b41-72ea-4afc-add3-ddcc0ba97e58]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xJmlCTda'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[23bb552a-c94a-4201-b1c9-db4af8db623f]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6059abd8-65c1-4960-8927-d9fe808d8ecf]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 10:16:08 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 10:16:08 user nova-compute[74342]:  {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:16:08 user nova-compute[74342]: WARNING os_brick.initiator.connectors.iscsi [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 10:16:08 user nova-compute[74342]: 
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0c6e7b5-f05a-43d2-9257-ddefe7ceb94f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890, portal: 172.16.0.220,3260]
Oct 16 10:16:08 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890, portal: 172.16.0.220,3260] successful.
Oct 16 10:16:08 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8688e1c4-49ba-4b7f-a708-5619518c4ab4]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[02949b21-b1a8-4d85-8654-d3215e56ec72]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 (non-flash)
Oct 16 10:16:08 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 (non-flash)
Oct 16 10:16:08 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.248s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f49cbe-1f31-4f60-9ab7-6f858f564241]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: None {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 10:16:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:09 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 10:16:09 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xJmlCTda', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 10:16:09 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.276s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:16:09 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '26661346630663733', 'path': '/dev/sdb'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:16:09 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661346630663733', 'path': '/dev/sdb'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 10:16:09 user nova-compute[74342]: DEBUG nova.objects.instance [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lazy-loading 'flavor' on Instance uuid fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:16:09 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 10:16:09 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:16:09 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 10:16:09 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:16:09 user nova-compute[74342]:   <serial>8e906e35-53f0-4ce3-a61f-511d9a37d890</serial>
Oct 16 10:16:09 user nova-compute[74342]: </disk>
Oct 16 10:16:09 user nova-compute[74342]:  {{(pid=74342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 10:16:09 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:16:09 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:16:09 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] No VIF found with MAC fa:16:3e:48:08:65, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:16:09 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-caa3d91f-7294-412d-8a79-5a5818005e76 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.288s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:16:10 user nova-compute[74342]: INFO nova.compute.manager [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Rescuing
Oct 16 10:16:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "refresh_cache-fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:16:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquired lock "refresh_cache-fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:16:10 user nova-compute[74342]: DEBUG nova.network.neutron [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:16:10 user nova-compute[74342]: DEBUG nova.network.neutron [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Updating instance_info_cache with network_info: [{"id": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "address": "fa:16:3e:48:08:65", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aba45fe-36", "ovs_interfaceid": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:16:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Releasing lock "refresh_cache-fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:16:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:11 user nova-compute[74342]: DEBUG nova.compute.manager [req-9a780f9d-a8d5-48a1-93e5-a7c10ed422ee req-22402d58-5f4f-4e14-b466-1547ac7473d2 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received event network-vif-unplugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:16:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9a780f9d-a8d5-48a1-93e5-a7c10ed422ee req-22402d58-5f4f-4e14-b466-1547ac7473d2 service nova] Acquiring lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:16:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9a780f9d-a8d5-48a1-93e5-a7c10ed422ee req-22402d58-5f4f-4e14-b466-1547ac7473d2 service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:16:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9a780f9d-a8d5-48a1-93e5-a7c10ed422ee req-22402d58-5f4f-4e14-b466-1547ac7473d2 service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:16:11 user nova-compute[74342]: DEBUG nova.compute.manager [req-9a780f9d-a8d5-48a1-93e5-a7c10ed422ee req-22402d58-5f4f-4e14-b466-1547ac7473d2 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] No waiting events found dispatching network-vif-unplugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:16:11 user nova-compute[74342]: WARNING nova.compute.manager [req-9a780f9d-a8d5-48a1-93e5-a7c10ed422ee req-22402d58-5f4f-4e14-b466-1547ac7473d2 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received unexpected event network-vif-unplugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 for instance with vm_state active and task_state rescuing.
Oct 16 10:16:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:11 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Instance destroyed successfully.
Oct 16 10:16:11 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Attempting rescue
Oct 16 10:16:11 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=74342) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Oct 16 10:16:11 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Instance directory exists: not creating {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Oct 16 10:16:11 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Creating image(s)
Oct 16 10:16:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "/opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:16:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "/opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:16:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "/opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:16:11 user nova-compute[74342]: DEBUG nova.objects.instance [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lazy-loading 'trusted_certs' on Instance uuid fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:16:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:16:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:16:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:16:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.169s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:16:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk.rescue {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:16:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk.rescue" returned: 0 in 0.053s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.objects.instance [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lazy-loading 'migration_context' on Instance uuid fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.objects.base [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Object Instance<fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9> lazy-loaded attributes: trusted_certs,migration_context {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Start _get_guest_xml network_info=[{"id": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "address": "fa:16:3e:48:08:65", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "vif_mac": "fa:16:3e:48:08:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aba45fe-36", "ovs_interfaceid": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.objects.instance [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lazy-loading 'resources' on Instance uuid fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.objects.base [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Object Instance<fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.objects.instance [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lazy-loading 'numa_topology' on Instance uuid fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.objects.base [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Object Instance<fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:16:12 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:16:12 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.objects.instance [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lazy-loading 'vcpu_model' on Instance uuid fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.objects.base [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Object Instance<fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-106833737',display_name='tempest-ServerRescueNegativeTestJSON-server-106833737',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-106833737',id=46,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHwkB8B6xn1DLu5yc81DqKdns/QpqRd7Maa0OvHjHefs7SZk/XPhJ/VHDNwT5fWZndqBU/wq/L/2jGTcPWdzvUbeOGibIDnqir40C/LOzf0p8Lmes8291YTIWvjKyGHeg==',key_name='tempest-keypair-409457646',keypairs=<?>,launch_index=0,launched_at=2023-10-16T10:14:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2453f549532c465da8952474a5218357',ramdisk_id='',reservation_id='r-zlhwfjx4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1027819060',owner_user_name='tempest-ServerRescueNegativeTestJSON-1027819060-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:14:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ca9ac24fcad4d9fbf8cb2fd7ec6a3f0',uuid=fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "address": "fa:16:3e:48:08:65", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "vif_mac": "fa:16:3e:48:08:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aba45fe-36", "ovs_interfaceid": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Converting VIF {"id": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "address": "fa:16:3e:48:08:65", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "vif_mac": "fa:16:3e:48:08:65"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aba45fe-36", "ovs_interfaceid": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:08:65,bridge_name='br-int',has_traffic_filtering=True,id=0aba45fe-3675-4a86-ac2d-9eac3af1ecc6,network=Network(c8edc360-319a-4e77-8af6-5b8e7a87ae82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aba45fe-36') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.objects.instance [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lazy-loading 'pci_devices' on Instance uuid fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.objects.base [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Object Instance<fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] End _get_guest_xml xml=<domain type="kvm">
Oct 16 10:16:12 user nova-compute[74342]:   <uuid>fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9</uuid>
Oct 16 10:16:12 user nova-compute[74342]:   <name>instance-0000002e</name>
Oct 16 10:16:12 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 10:16:12 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 10:16:12 user nova-compute[74342]:   <metadata>
Oct 16 10:16:12 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 10:16:12 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 10:16:12 user nova-compute[74342]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-106833737</nova:name>
Oct 16 10:16:12 user nova-compute[74342]:       <nova:creationTime>2023-10-16 10:16:12</nova:creationTime>
Oct 16 10:16:12 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 10:16:12 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 10:16:12 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 10:16:12 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 10:16:12 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 10:16:12 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 10:16:12 user nova-compute[74342]:       </nova:flavor>
Oct 16 10:16:12 user nova-compute[74342]:       <nova:owner>
Oct 16 10:16:12 user nova-compute[74342]:         <nova:user uuid="2ca9ac24fcad4d9fbf8cb2fd7ec6a3f0">tempest-ServerRescueNegativeTestJSON-1027819060-project-member</nova:user>
Oct 16 10:16:12 user nova-compute[74342]:         <nova:project uuid="2453f549532c465da8952474a5218357">tempest-ServerRescueNegativeTestJSON-1027819060</nova:project>
Oct 16 10:16:12 user nova-compute[74342]:       </nova:owner>
Oct 16 10:16:12 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 10:16:12 user nova-compute[74342]:       <nova:ports>
Oct 16 10:16:12 user nova-compute[74342]:         <nova:port uuid="0aba45fe-3675-4a86-ac2d-9eac3af1ecc6">
Oct 16 10:16:12 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Oct 16 10:16:12 user nova-compute[74342]:         </nova:port>
Oct 16 10:16:12 user nova-compute[74342]:       </nova:ports>
Oct 16 10:16:12 user nova-compute[74342]:     </nova:instance>
Oct 16 10:16:12 user nova-compute[74342]:   </metadata>
Oct 16 10:16:12 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 10:16:12 user nova-compute[74342]:     <system>
Oct 16 10:16:12 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 10:16:12 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 10:16:12 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 10:16:12 user nova-compute[74342]:       <entry name="serial">fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9</entry>
Oct 16 10:16:12 user nova-compute[74342]:       <entry name="uuid">fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9</entry>
Oct 16 10:16:12 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 10:16:12 user nova-compute[74342]:     </system>
Oct 16 10:16:12 user nova-compute[74342]:   </sysinfo>
Oct 16 10:16:12 user nova-compute[74342]:   <os>
Oct 16 10:16:12 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 10:16:12 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 10:16:12 user nova-compute[74342]:   </os>
Oct 16 10:16:12 user nova-compute[74342]:   <features>
Oct 16 10:16:12 user nova-compute[74342]:     <acpi/>
Oct 16 10:16:12 user nova-compute[74342]:     <apic/>
Oct 16 10:16:12 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 10:16:12 user nova-compute[74342]:   </features>
Oct 16 10:16:12 user nova-compute[74342]:   <clock offset="utc">
Oct 16 10:16:12 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 10:16:12 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 10:16:12 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 10:16:12 user nova-compute[74342]:   </clock>
Oct 16 10:16:12 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 10:16:12 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 10:16:12 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 10:16:12 user nova-compute[74342]:   </cpu>
Oct 16 10:16:12 user nova-compute[74342]:   <devices>
Oct 16 10:16:12 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 10:16:12 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 10:16:12 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk.rescue"/>
Oct 16 10:16:12 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 10:16:12 user nova-compute[74342]:     </disk>
Oct 16 10:16:12 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 10:16:12 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 10:16:12 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk"/>
Oct 16 10:16:12 user nova-compute[74342]:       <target dev="vdb" bus="virtio"/>
Oct 16 10:16:12 user nova-compute[74342]:     </disk>
Oct 16 10:16:12 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 10:16:12 user nova-compute[74342]:       <mac address="fa:16:3e:48:08:65"/>
Oct 16 10:16:12 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:16:12 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 10:16:12 user nova-compute[74342]:       <target dev="tap0aba45fe-36"/>
Oct 16 10:16:12 user nova-compute[74342]:     </interface>
Oct 16 10:16:12 user nova-compute[74342]:     <serial type="pty">
Oct 16 10:16:12 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/console.log" append="off"/>
Oct 16 10:16:12 user nova-compute[74342]:     </serial>
Oct 16 10:16:12 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 10:16:12 user nova-compute[74342]:     <video>
Oct 16 10:16:12 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:16:12 user nova-compute[74342]:     </video>
Oct 16 10:16:12 user nova-compute[74342]:     <rng model="virtio">
Oct 16 10:16:12 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 10:16:12 user nova-compute[74342]:     </rng>
Oct 16 10:16:12 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 10:16:12 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 10:16:12 user nova-compute[74342]:       <stats period="10"/>
Oct 16 10:16:12 user nova-compute[74342]:     </memballoon>
Oct 16 10:16:12 user nova-compute[74342]:   </devices>
Oct 16 10:16:12 user nova-compute[74342]: </domain>
Oct 16 10:16:12 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 10:16:12 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Instance destroyed successfully.
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] No VIF found with MAC fa:16:3e:48:08:65, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:16:12 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:16:13 user nova-compute[74342]: DEBUG nova.compute.manager [req-3a0cc774-27d4-4157-88bf-69897edcca20 req-24ab1572-4400-4c58-bcdd-05e8a80cea53 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received event network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:16:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-3a0cc774-27d4-4157-88bf-69897edcca20 req-24ab1572-4400-4c58-bcdd-05e8a80cea53 service nova] Acquiring lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:16:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-3a0cc774-27d4-4157-88bf-69897edcca20 req-24ab1572-4400-4c58-bcdd-05e8a80cea53 service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:16:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-3a0cc774-27d4-4157-88bf-69897edcca20 req-24ab1572-4400-4c58-bcdd-05e8a80cea53 service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:16:13 user nova-compute[74342]: DEBUG nova.compute.manager [req-3a0cc774-27d4-4157-88bf-69897edcca20 req-24ab1572-4400-4c58-bcdd-05e8a80cea53 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] No waiting events found dispatching network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:16:13 user nova-compute[74342]: WARNING nova.compute.manager [req-3a0cc774-27d4-4157-88bf-69897edcca20 req-24ab1572-4400-4c58-bcdd-05e8a80cea53 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received unexpected event network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 for instance with vm_state active and task_state rescuing.
Oct 16 10:16:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:14 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:16:14 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:16:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:16:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:16:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:16:14 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:16:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:16:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:16:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:16:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:16:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk (vdb) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 10:16:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:16:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:16:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:16:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:16:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:16:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-2e9944ef-30fa-447b-863e-2537c4972ce2 req-a8bb944e-2898-49fa-8d9b-435fad97d2c9 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received event network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:16:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-2e9944ef-30fa-447b-863e-2537c4972ce2 req-a8bb944e-2898-49fa-8d9b-435fad97d2c9 service nova] Acquiring lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:16:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-2e9944ef-30fa-447b-863e-2537c4972ce2 req-a8bb944e-2898-49fa-8d9b-435fad97d2c9 service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:16:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-2e9944ef-30fa-447b-863e-2537c4972ce2 req-a8bb944e-2898-49fa-8d9b-435fad97d2c9 service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:16:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-2e9944ef-30fa-447b-863e-2537c4972ce2 req-a8bb944e-2898-49fa-8d9b-435fad97d2c9 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] No waiting events found dispatching network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:16:15 user nova-compute[74342]: WARNING nova.compute.manager [req-2e9944ef-30fa-447b-863e-2537c4972ce2 req-a8bb944e-2898-49fa-8d9b-435fad97d2c9 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received unexpected event network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 for instance with vm_state active and task_state rescuing.
Oct 16 10:16:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-2e9944ef-30fa-447b-863e-2537c4972ce2 req-a8bb944e-2898-49fa-8d9b-435fad97d2c9 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received event network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:16:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-2e9944ef-30fa-447b-863e-2537c4972ce2 req-a8bb944e-2898-49fa-8d9b-435fad97d2c9 service nova] Acquiring lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:16:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-2e9944ef-30fa-447b-863e-2537c4972ce2 req-a8bb944e-2898-49fa-8d9b-435fad97d2c9 service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:16:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-2e9944ef-30fa-447b-863e-2537c4972ce2 req-a8bb944e-2898-49fa-8d9b-435fad97d2c9 service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:16:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-2e9944ef-30fa-447b-863e-2537c4972ce2 req-a8bb944e-2898-49fa-8d9b-435fad97d2c9 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] No waiting events found dispatching network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:16:15 user nova-compute[74342]: WARNING nova.compute.manager [req-2e9944ef-30fa-447b-863e-2537c4972ce2 req-a8bb944e-2898-49fa-8d9b-435fad97d2c9 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received unexpected event network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 for instance with vm_state active and task_state rescuing.
Oct 16 10:16:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:16:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:16:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:16:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:16:15 user nova-compute[74342]: DEBUG nova.compute.manager [None req-da050d18-9880-40cb-959e-a6ce6cf08ba4 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:16:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:16:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:16:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:16:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:16:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:16:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:16:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:16:16 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:16:16 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:16:16 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8661MB free_disk=24.914459228515625GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:16:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:16:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:16:16 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 34ef7d18-0724-479a-8448-981b9cf0d6ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:16:16 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7d016ab3-14c4-4c33-bd50-468f71339cd7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:16:16 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:16:16 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance e5932eb4-88be-4933-8e2f-0201d9303ffc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:16:16 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:16:16 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:16:16 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Refreshing inventories for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 10:16:16 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Updating ProviderTree inventory for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 10:16:16 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Updating inventory in ProviderTree for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 10:16:17 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Refreshing aggregate associations for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca, aggregates: None {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 10:16:17 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Refreshing trait associations for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 10:16:17 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:16:17 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:16:17 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:16:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.597s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:16:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:20 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:16:20 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:16:20 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:16:20 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:16:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:16:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:16:20 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:16:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:21 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Updating instance_info_cache with network_info: [{"id": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "address": "fa:16:3e:48:08:65", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aba45fe-36", "ovs_interfaceid": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:16:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:16:21 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:16:21 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:16:21 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:16:21 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:16:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:25 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:16:25 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:16:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:55 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:16:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:17:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:17:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:17:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:17:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:17:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:17:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:17:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:17:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:17:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:17:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:17:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:17:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:17:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:17:13 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:17:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:17:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:17:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:17:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:17:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:17:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:17:16 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:17:16 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:17:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:17:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:17:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:17:16 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:17:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:17:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:17:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:17:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk.rescue --force-share --output=json" returned: 0 in 0.189s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:17:16 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk (vdb) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 10:17:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:17:17 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:17:17 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:17:17 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:17:17 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:17:17 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:17:17 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:17:17 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json" returned: 0 in 0.241s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:17:17 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:17:17 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:17:17 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:17:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:17:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:17:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:17:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:17:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:17:18 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:17:18 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:17:18 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8645MB free_disk=24.91205596923828GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:17:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:17:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:17:19 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 34ef7d18-0724-479a-8448-981b9cf0d6ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:17:19 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7d016ab3-14c4-4c33-bd50-468f71339cd7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:17:19 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:17:19 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance e5932eb4-88be-4933-8e2f-0201d9303ffc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:17:19 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:17:19 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:17:19 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:17:19 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:17:19 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:17:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.342s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:17:20 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:17:20 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:17:20 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:17:20 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Rebuilding the list of instances to heal {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 10:17:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-34ef7d18-0724-479a-8448-981b9cf0d6ab" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:17:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-34ef7d18-0724-479a-8448-981b9cf0d6ab" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:17:20 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:17:20 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lazy-loading 'info_cache' on Instance uuid 34ef7d18-0724-479a-8448-981b9cf0d6ab {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:17:20 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Updating instance_info_cache with network_info: [{"id": "1495980a-a474-4a07-a8d1-27521ae89be7", "address": "fa:16:3e:0e:3e:44", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1495980a-a4", "ovs_interfaceid": "1495980a-a474-4a07-a8d1-27521ae89be7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:17:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-34ef7d18-0724-479a-8448-981b9cf0d6ab" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:17:20 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:17:20 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:17:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:17:21 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:17:22 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:17:25 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:17:25 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:17:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:17:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:17:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:17:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:17:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:17:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:17:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:17:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:17:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:17:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:17:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:17:30 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:17:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "e5932eb4-88be-4933-8e2f-0201d9303ffc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:17:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:17:31 user nova-compute[74342]: DEBUG nova.objects.instance [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lazy-loading 'flavor' on Instance uuid e5932eb4-88be-4933-8e2f-0201d9303ffc {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:17:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:17:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "e5932eb4-88be-4933-8e2f-0201d9303ffc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:17:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:17:31 user nova-compute[74342]: INFO nova.compute.manager [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Attaching volume 61ae5017-9f77-47ee-a2eb-756aaad09c96 to /dev/vdb
Oct 16 10:17:31 user nova-compute[74342]: DEBUG os_brick.utils [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:17:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:17:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:17:31 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d06b9c9-9562-4968-b2aa-c625d546ebff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:17:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:17:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:17:31 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[73be8d17-43a8-497e-8f91-611d4d89ab34]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:17:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:17:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:17:31 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa038c37-160a-44de-b562-8d29254f43dd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:17:31 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dabd1c-319c-487b-ad11-537c390e0b86]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:17:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:17:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:17:31 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 10:17:31 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:17:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:17:32 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 10:17:32 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbef6044-1883-4df7-a3a5-bb14bd2d4c2c]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:17:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 10:17:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 10:17:32 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 10:17:32 user nova-compute[74342]: DEBUG os_brick.utils [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:17:32 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Updating existing volume attachment record: 1dc20300-4c7d-406f-909e-9be24d075004 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 10:17:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:17:40 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:17:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:17:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:17:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:17:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:17:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:17:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eZBGxcqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:17:47 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:17:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:17:47 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:17:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:17:47 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[39d96b93-923a-4814-8b9f-982f310b5b4b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 10:17:47 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff18fb3-5e60-430f-98e1-2fb51d2c64b8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96] added
Oct 16 10:17:47 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[13104e8c-0b6a-491a-b21b-2e62858b4949]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.123s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[21038769-8a35-458c-a048-41761b4eec8d]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eZBGxcqt {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eZBGxcqt" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2e800b-13e8-46e0-b0bc-1af6009fdb73]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eZBGxcqt'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[67325248-2fb1-424f-846f-11ad05ef4019]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c58089-d6ad-4fb1-b464-2fd49f88254c]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 (non-flash)
Oct 16 10:17:47 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 (non-flash)
Oct 16 10:17:47 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ae78ad3-5864-4ee4-bb8e-c570c8e8b095]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96, portal: 172.16.0.220,3260]
Oct 16 10:17:47 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96, portal: 172.16.0.220,3260] successful.
Oct 16 10:17:47 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a537152-acb9-4294-8932-3cf599e34c78]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d7cb54-e04b-44af-990d-199ccea1c3ba]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 (non-flash)
Oct 16 10:17:47 user nova-compute[74342]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 (non-flash)
Oct 16 10:17:47 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 (non-flash)
Oct 16 10:17:47 user nova-compute[74342]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 (non-flash)
Oct 16 10:17:47 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.382s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] HCTL ('34', '-', '-', 0) found on session 41 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b6bb75a-f95b-48d7-ac46-ec9553e1ae7a]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Searching for a device in session 41 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 10:17:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eZBGxcqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 10:17:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.413s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:17:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] <== connect_volume: return (1415ms) {'type': 'block', 'scsi_wwn': '23037333364323035', 'path': '/dev/sdc'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:17:48 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037333364323035', 'path': '/dev/sdc'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 10:17:48 user nova-compute[74342]: DEBUG nova.objects.instance [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lazy-loading 'flavor' on Instance uuid e5932eb4-88be-4933-8e2f-0201d9303ffc {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:17:48 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 10:17:48 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:17:48 user nova-compute[74342]:   <source dev="/dev/sdc"/>
Oct 16 10:17:48 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:17:48 user nova-compute[74342]:   <serial>61ae5017-9f77-47ee-a2eb-756aaad09c96</serial>
Oct 16 10:17:48 user nova-compute[74342]: </disk>
Oct 16 10:17:48 user nova-compute[74342]:  {{(pid=74342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 10:17:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:17:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:17:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] No VIF found with MAC fa:16:3e:47:35:4d, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:17:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-1daefdc7-bd48-419a-a5ba-6d262282c757 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.667s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:17:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:17:55 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:17:55 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:17:55 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:17:55 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:17:55 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:17:55 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:17:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:00 user nova-compute[74342]: DEBUG nova.compute.manager [req-c868488a-4832-4c70-8f46-6e0b4b5eb8e0 req-00118efc-1ab2-48c1-883e-e93d0d7ba562 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Received event network-changed-8edcd15a-87a9-43d6-9674-8a8ec38c6155 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:18:00 user nova-compute[74342]: DEBUG nova.compute.manager [req-c868488a-4832-4c70-8f46-6e0b4b5eb8e0 req-00118efc-1ab2-48c1-883e-e93d0d7ba562 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Refreshing instance network info cache due to event network-changed-8edcd15a-87a9-43d6-9674-8a8ec38c6155. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:18:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c868488a-4832-4c70-8f46-6e0b4b5eb8e0 req-00118efc-1ab2-48c1-883e-e93d0d7ba562 service nova] Acquiring lock "refresh_cache-e5932eb4-88be-4933-8e2f-0201d9303ffc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:18:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c868488a-4832-4c70-8f46-6e0b4b5eb8e0 req-00118efc-1ab2-48c1-883e-e93d0d7ba562 service nova] Acquired lock "refresh_cache-e5932eb4-88be-4933-8e2f-0201d9303ffc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:18:00 user nova-compute[74342]: DEBUG nova.network.neutron [req-c868488a-4832-4c70-8f46-6e0b4b5eb8e0 req-00118efc-1ab2-48c1-883e-e93d0d7ba562 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Refreshing network info cache for port 8edcd15a-87a9-43d6-9674-8a8ec38c6155 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:18:00 user nova-compute[74342]: DEBUG nova.network.neutron [req-c868488a-4832-4c70-8f46-6e0b4b5eb8e0 req-00118efc-1ab2-48c1-883e-e93d0d7ba562 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Updated VIF entry in instance network info cache for port 8edcd15a-87a9-43d6-9674-8a8ec38c6155. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:18:00 user nova-compute[74342]: DEBUG nova.network.neutron [req-c868488a-4832-4c70-8f46-6e0b4b5eb8e0 req-00118efc-1ab2-48c1-883e-e93d0d7ba562 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Updating instance_info_cache with network_info: [{"id": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "address": "fa:16:3e:47:35:4d", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edcd15a-87", "ovs_interfaceid": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:18:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c868488a-4832-4c70-8f46-6e0b4b5eb8e0 req-00118efc-1ab2-48c1-883e-e93d0d7ba562 service nova] Releasing lock "refresh_cache-e5932eb4-88be-4933-8e2f-0201d9303ffc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:18:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:01 user nova-compute[74342]: INFO nova.compute.manager [None req-60beca62-6cef-4b66-bec1-dee6fc304660 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Unrescuing
Oct 16 10:18:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-60beca62-6cef-4b66-bec1-dee6fc304660 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "refresh_cache-fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:18:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-60beca62-6cef-4b66-bec1-dee6fc304660 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquired lock "refresh_cache-fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:18:01 user nova-compute[74342]: DEBUG nova.network.neutron [None req-60beca62-6cef-4b66-bec1-dee6fc304660 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:18:02 user nova-compute[74342]: DEBUG nova.network.neutron [None req-60beca62-6cef-4b66-bec1-dee6fc304660 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Updating instance_info_cache with network_info: [{"id": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "address": "fa:16:3e:48:08:65", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aba45fe-36", "ovs_interfaceid": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:18:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-60beca62-6cef-4b66-bec1-dee6fc304660 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Releasing lock "refresh_cache-fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:18:02 user nova-compute[74342]: DEBUG nova.objects.instance [None req-60beca62-6cef-4b66-bec1-dee6fc304660 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lazy-loading 'flavor' on Instance uuid fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:18:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-35cbf737-90b5-4595-ba5a-560fd3eb6476 req-e507b1fa-f0f9-4e30-bff7-3f6e2faea921 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received event network-vif-unplugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:18:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-35cbf737-90b5-4595-ba5a-560fd3eb6476 req-e507b1fa-f0f9-4e30-bff7-3f6e2faea921 service nova] Acquiring lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:18:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-35cbf737-90b5-4595-ba5a-560fd3eb6476 req-e507b1fa-f0f9-4e30-bff7-3f6e2faea921 service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:18:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-35cbf737-90b5-4595-ba5a-560fd3eb6476 req-e507b1fa-f0f9-4e30-bff7-3f6e2faea921 service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:18:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-35cbf737-90b5-4595-ba5a-560fd3eb6476 req-e507b1fa-f0f9-4e30-bff7-3f6e2faea921 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] No waiting events found dispatching network-vif-unplugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:18:02 user nova-compute[74342]: WARNING nova.compute.manager [req-35cbf737-90b5-4595-ba5a-560fd3eb6476 req-e507b1fa-f0f9-4e30-bff7-3f6e2faea921 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received unexpected event network-vif-unplugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 for instance with vm_state rescued and task_state unrescuing.
Oct 16 10:18:02 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Instance destroyed successfully.
Oct 16 10:18:03 user nova-compute[74342]: DEBUG nova.compute.manager [req-b5e6669b-6cb3-4769-b145-b99e21c6b773 req-c851e10e-e147-481f-8213-6ffc33e015e6 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Received event network-changed-8edcd15a-87a9-43d6-9674-8a8ec38c6155 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:18:03 user nova-compute[74342]: DEBUG nova.compute.manager [req-b5e6669b-6cb3-4769-b145-b99e21c6b773 req-c851e10e-e147-481f-8213-6ffc33e015e6 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Refreshing instance network info cache due to event network-changed-8edcd15a-87a9-43d6-9674-8a8ec38c6155. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:18:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b5e6669b-6cb3-4769-b145-b99e21c6b773 req-c851e10e-e147-481f-8213-6ffc33e015e6 service nova] Acquiring lock "refresh_cache-e5932eb4-88be-4933-8e2f-0201d9303ffc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:18:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b5e6669b-6cb3-4769-b145-b99e21c6b773 req-c851e10e-e147-481f-8213-6ffc33e015e6 service nova] Acquired lock "refresh_cache-e5932eb4-88be-4933-8e2f-0201d9303ffc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:18:03 user nova-compute[74342]: DEBUG nova.network.neutron [req-b5e6669b-6cb3-4769-b145-b99e21c6b773 req-c851e10e-e147-481f-8213-6ffc33e015e6 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Refreshing network info cache for port 8edcd15a-87a9-43d6-9674-8a8ec38c6155 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:18:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:04 user nova-compute[74342]: DEBUG nova.network.neutron [req-b5e6669b-6cb3-4769-b145-b99e21c6b773 req-c851e10e-e147-481f-8213-6ffc33e015e6 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Updated VIF entry in instance network info cache for port 8edcd15a-87a9-43d6-9674-8a8ec38c6155. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:18:04 user nova-compute[74342]: DEBUG nova.network.neutron [req-b5e6669b-6cb3-4769-b145-b99e21c6b773 req-c851e10e-e147-481f-8213-6ffc33e015e6 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Updating instance_info_cache with network_info: [{"id": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "address": "fa:16:3e:47:35:4d", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edcd15a-87", "ovs_interfaceid": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:18:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b5e6669b-6cb3-4769-b145-b99e21c6b773 req-c851e10e-e147-481f-8213-6ffc33e015e6 service nova] Releasing lock "refresh_cache-e5932eb4-88be-4933-8e2f-0201d9303ffc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:18:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:04 user nova-compute[74342]: DEBUG nova.compute.manager [req-c66a631a-c016-43d4-8f8b-837080352c95 req-dabf0ecb-3ace-4e16-b4d0-c27eb653b18e service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received event network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:18:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c66a631a-c016-43d4-8f8b-837080352c95 req-dabf0ecb-3ace-4e16-b4d0-c27eb653b18e service nova] Acquiring lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:18:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c66a631a-c016-43d4-8f8b-837080352c95 req-dabf0ecb-3ace-4e16-b4d0-c27eb653b18e service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:18:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c66a631a-c016-43d4-8f8b-837080352c95 req-dabf0ecb-3ace-4e16-b4d0-c27eb653b18e service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:18:04 user nova-compute[74342]: DEBUG nova.compute.manager [req-c66a631a-c016-43d4-8f8b-837080352c95 req-dabf0ecb-3ace-4e16-b4d0-c27eb653b18e service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] No waiting events found dispatching network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:18:04 user nova-compute[74342]: WARNING nova.compute.manager [req-c66a631a-c016-43d4-8f8b-837080352c95 req-dabf0ecb-3ace-4e16-b4d0-c27eb653b18e service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received unexpected event network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 for instance with vm_state rescued and task_state unrescuing.
Oct 16 10:18:04 user nova-compute[74342]: DEBUG nova.compute.manager [req-c66a631a-c016-43d4-8f8b-837080352c95 req-dabf0ecb-3ace-4e16-b4d0-c27eb653b18e service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received event network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:18:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c66a631a-c016-43d4-8f8b-837080352c95 req-dabf0ecb-3ace-4e16-b4d0-c27eb653b18e service nova] Acquiring lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:18:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c66a631a-c016-43d4-8f8b-837080352c95 req-dabf0ecb-3ace-4e16-b4d0-c27eb653b18e service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:18:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c66a631a-c016-43d4-8f8b-837080352c95 req-dabf0ecb-3ace-4e16-b4d0-c27eb653b18e service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:18:04 user nova-compute[74342]: DEBUG nova.compute.manager [req-c66a631a-c016-43d4-8f8b-837080352c95 req-dabf0ecb-3ace-4e16-b4d0-c27eb653b18e service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] No waiting events found dispatching network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:18:04 user nova-compute[74342]: WARNING nova.compute.manager [req-c66a631a-c016-43d4-8f8b-837080352c95 req-dabf0ecb-3ace-4e16-b4d0-c27eb653b18e service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received unexpected event network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 for instance with vm_state rescued and task_state unrescuing.
Oct 16 10:18:04 user nova-compute[74342]: DEBUG nova.compute.manager [req-c66a631a-c016-43d4-8f8b-837080352c95 req-dabf0ecb-3ace-4e16-b4d0-c27eb653b18e service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received event network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:18:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c66a631a-c016-43d4-8f8b-837080352c95 req-dabf0ecb-3ace-4e16-b4d0-c27eb653b18e service nova] Acquiring lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:18:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c66a631a-c016-43d4-8f8b-837080352c95 req-dabf0ecb-3ace-4e16-b4d0-c27eb653b18e service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:18:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c66a631a-c016-43d4-8f8b-837080352c95 req-dabf0ecb-3ace-4e16-b4d0-c27eb653b18e service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:18:04 user nova-compute[74342]: DEBUG nova.compute.manager [req-c66a631a-c016-43d4-8f8b-837080352c95 req-dabf0ecb-3ace-4e16-b4d0-c27eb653b18e service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] No waiting events found dispatching network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:18:04 user nova-compute[74342]: WARNING nova.compute.manager [req-c66a631a-c016-43d4-8f8b-837080352c95 req-dabf0ecb-3ace-4e16-b4d0-c27eb653b18e service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received unexpected event network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 for instance with vm_state rescued and task_state unrescuing.
Oct 16 10:18:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:06 user nova-compute[74342]: DEBUG nova.compute.manager [None req-60beca62-6cef-4b66-bec1-dee6fc304660 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:18:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:10 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "e5932eb4-88be-4933-8e2f-0201d9303ffc" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:18:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:18:13 user nova-compute[74342]: INFO nova.compute.manager [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Rebooting instance
Oct 16 10:18:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "refresh_cache-e5932eb4-88be-4933-8e2f-0201d9303ffc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:18:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquired lock "refresh_cache-e5932eb4-88be-4933-8e2f-0201d9303ffc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:18:14 user nova-compute[74342]: DEBUG nova.network.neutron [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:18:14 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:18:14 user nova-compute[74342]: DEBUG nova.network.neutron [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Updating instance_info_cache with network_info: [{"id": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "address": "fa:16:3e:47:35:4d", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edcd15a-87", "ovs_interfaceid": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:18:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Releasing lock "refresh_cache-e5932eb4-88be-4933-8e2f-0201d9303ffc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:18:14 user nova-compute[74342]: DEBUG nova.compute.manager [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:18:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:14 user nova-compute[74342]: DEBUG nova.compute.manager [req-ec66c30a-c6ea-4f5e-a420-d68cc5c0ab0d req-7b5a9214-6874-4b2a-a427-7970b93838ab service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Received event network-vif-unplugged-8edcd15a-87a9-43d6-9674-8a8ec38c6155 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:18:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ec66c30a-c6ea-4f5e-a420-d68cc5c0ab0d req-7b5a9214-6874-4b2a-a427-7970b93838ab service nova] Acquiring lock "e5932eb4-88be-4933-8e2f-0201d9303ffc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:18:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ec66c30a-c6ea-4f5e-a420-d68cc5c0ab0d req-7b5a9214-6874-4b2a-a427-7970b93838ab service nova] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:18:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ec66c30a-c6ea-4f5e-a420-d68cc5c0ab0d req-7b5a9214-6874-4b2a-a427-7970b93838ab service nova] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:18:14 user nova-compute[74342]: DEBUG nova.compute.manager [req-ec66c30a-c6ea-4f5e-a420-d68cc5c0ab0d req-7b5a9214-6874-4b2a-a427-7970b93838ab service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] No waiting events found dispatching network-vif-unplugged-8edcd15a-87a9-43d6-9674-8a8ec38c6155 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:18:14 user nova-compute[74342]: WARNING nova.compute.manager [req-ec66c30a-c6ea-4f5e-a420-d68cc5c0ab0d req-7b5a9214-6874-4b2a-a427-7970b93838ab service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Received unexpected event network-vif-unplugged-8edcd15a-87a9-43d6-9674-8a8ec38c6155 for instance with vm_state active and task_state reboot_started_hard.
Oct 16 10:18:15 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Instance destroyed successfully.
Oct 16 10:18:15 user nova-compute[74342]: DEBUG nova.objects.instance [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lazy-loading 'resources' on Instance uuid e5932eb4-88be-4933-8e2f-0201d9303ffc {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1480925964',display_name='tempest-TestMinimumBasicScenario-server-1480925964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1480925964',id=47,image_ref='89e64f2a-3d34-4fea-a74f-92e55e89516d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXXZhgHmnUAZ47mUNhjP/DiMnlMHb5+XnkQwzyGb4Ge2Imhmk9flfIoP+nvZ6DYxlWCRt0Biq7X30JLPqManXPpmNAaqN5f3CuL8UvtnY0eEgtz48VaNWN4h5HNPTP6XA==',key_name='tempest-TestMinimumBasicScenario-545706033',keypairs=<?>,launch_index=0,launched_at=2023-10-16T10:15:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d121feadb9b94fe09dd25b0d5adedb6e',ramdisk_id='',reservation_id='r-h4fn136a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='89e64f2a-3d34-4fea-a74f-92e55e89516d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-643895215',owner_user_name='tempest-TestMinimumBasicScenario-643895215-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T10:18:15Z,user_data=None,user_id='fa5d15e5061141f798d8e0f58cae2c7f',uuid=e5932eb4-88be-4933-8e2f-0201d9303ffc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "address": "fa:16:3e:47:35:4d", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edcd15a-87", "ovs_interfaceid": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Converting VIF {"id": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "address": "fa:16:3e:47:35:4d", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edcd15a-87", "ovs_interfaceid": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:35:4d,bridge_name='br-int',has_traffic_filtering=True,id=8edcd15a-87a9-43d6-9674-8a8ec38c6155,network=Network(9adc3611-05c0-400f-99d4-a61f2c9e74d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8edcd15a-87') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG os_vif [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:35:4d,bridge_name='br-int',has_traffic_filtering=True,id=8edcd15a-87a9-43d6-9674-8a8ec38c6155,network=Network(9adc3611-05c0-400f-99d4-a61f2c9e74d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8edcd15a-87') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8edcd15a-87, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e0400fb0-f813-4790-8260-cde177ed5866) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:18:15 user nova-compute[74342]: INFO os_vif [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:35:4d,bridge_name='br-int',has_traffic_filtering=True,id=8edcd15a-87a9-43d6-9674-8a8ec38c6155,network=Network(9adc3611-05c0-400f-99d4-a61f2c9e74d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8edcd15a-87')
Oct 16 10:18:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eZBGxcqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:18:15 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:18:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e6b669a-fd41-4712-8495-46b1e2d9c9bf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 10:18:15 user nova-compute[74342]: No targets found.
Oct 16 10:18:15 user nova-compute[74342]: iSNS:
Oct 16 10:18:15 user nova-compute[74342]: No targets found.
Oct 16 10:18:15 user nova-compute[74342]: STATIC:
Oct 16 10:18:15 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890
Oct 16 10:18:15 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:18:15 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:18:15 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96
Oct 16 10:18:15 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:18:15 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:18:15 user nova-compute[74342]: FIRMWARE:
Oct 16 10:18:15 user nova-compute[74342]: No targets found.
Oct 16 10:18:15 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 10:18:15 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 10:18:15 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[345f9071-cbed-465b-835d-736aea455c8e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d901c073-e677-4ba0-87bb-28eb24acca06]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 (non-flash)
Oct 16 10:18:15 user nova-compute[74342]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 (non-flash)
Oct 16 10:18:15 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 (non-flash)
Oct 16 10:18:15 user nova-compute[74342]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 (non-flash)
Oct 16 10:18:15 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b60294ee0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96'): ({'sdc'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Removing single pathed devices sdc {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3234b506-ff52-409d-8ace-b460d375d3a2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2b0f0f5-84fd-43bd-aea8-9266ffa84aac]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Flushing IO for device /dev/sdc {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[48a8ba72-9654-4319-97b7-01999cbc349d]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[14c602ea-5a8d-4c4a-964a-ec741492c37d]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] SCSI volumes sdc have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec624451-2b72-4263-af6a-69dac2eb6a79]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --logout" returned: 0 in 0.044s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95e9bcc-6c05-4b9a-a6c0-251a97b9843d]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96, portal: 172.16.0.220,3260]
Oct 16 10:18:15 user nova-compute[74342]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96, portal: 172.16.0.220,3260] successful.
Oct 16 10:18:15 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dea8507-7b44-4c32-bae6-af58cc33bda0]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.270s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] <== disconnect_volume: return (271ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Start _get_guest_xml network_info=[{"id": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "address": "fa:16:3e:47:35:4d", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edcd15a-87", "ovs_interfaceid": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=89e64f2a-3d34-4fea-a74f-92e55e89516d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '89e64f2a-3d34-4fea-a74f-92e55e89516d'}], 'ephemerals': [], 'block_device_mapping': [{'mount_device': '/dev/vdb', 'device_type': 'disk', 'boot_index': None, 'guest_format': None, 'delete_on_termination': False, 'attachment_id': '1dc20300-4c7d-406f-909e-9be24d075004', 'disk_bus': 'virtio', 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eZBGxcqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': 'e5932eb4-88be-4933-8e2f-0201d9303ffc', 'attached_at': '', 'detached_at': '', 'volume_id': '61ae5017-9f77-47ee-a2eb-756aaad09c96', 'serial': '61ae5017-9f77-47ee-a2eb-756aaad09c96'}, 'volume_type': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 10:18:15 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:18:15 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:18:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=89e64f2a-3d34-4fea-a74f-92e55e89516d,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG nova.objects.instance [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lazy-loading 'vcpu_model' on Instance uuid e5932eb4-88be-4933-8e2f-0201d9303ffc {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG nova.objects.base [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Object Instance<e5932eb4-88be-4933-8e2f-0201d9303ffc> lazy-loaded attributes: resources,vcpu_model {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eZBGxcqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:18:15 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:18:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:18:15 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:18:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:18:15 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b97cb69-c46e-46db-9b33-34e855663026]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 10:18:15 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:18:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf781880-8c88-4acf-b8c3-cf2c20847897]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96] added
Oct 16 10:18:16 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[44d3f0f8-a829-4504-aaf9-79165f0b5c31]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f75cc6-b24a-4812-aa83-483f1bdfbd10]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eZBGxcqt {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v eZBGxcqt" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcc8d70-e197-4034-82f9-b9c434d07e01]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'eZBGxcqt'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd661fe-dde2-4e12-9b9c-b34b9661e52e]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e2b5ff-f494-42d2-ba56-fec6bcef2f9d]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 (non-flash)
Oct 16 10:18:16 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 (non-flash)
Oct 16 10:18:16 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ff28c7-6c88-4c89-a3c0-83cd02f53a4f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96, portal: 172.16.0.220,3260]
Oct 16 10:18:16 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96, portal: 172.16.0.220,3260] successful.
Oct 16 10:18:16 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05b712d-5143-489d-8969-fc6726682a2a]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[15926807-044f-41d5-8090-6506d9b58e6e]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 (non-flash)
Oct 16 10:18:16 user nova-compute[74342]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 (non-flash)
Oct 16 10:18:16 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 (non-flash)
Oct 16 10:18:16 user nova-compute[74342]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 (non-flash)
Oct 16 10:18:16 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c9e6f8-8357-47fa-8ab3-fdaaf268c766]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eZBGxcqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG nova.compute.manager [req-9670de41-c506-4cbe-bbeb-2f4c406151a7 req-78c1b6f3-5316-4435-997e-3bfd56f28ff4 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Received event network-vif-plugged-8edcd15a-87a9-43d6-9674-8a8ec38c6155 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9670de41-c506-4cbe-bbeb-2f4c406151a7 req-78c1b6f3-5316-4435-997e-3bfd56f28ff4 service nova] Acquiring lock "e5932eb4-88be-4933-8e2f-0201d9303ffc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9670de41-c506-4cbe-bbeb-2f4c406151a7 req-78c1b6f3-5316-4435-997e-3bfd56f28ff4 service nova] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9670de41-c506-4cbe-bbeb-2f4c406151a7 req-78c1b6f3-5316-4435-997e-3bfd56f28ff4 service nova] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:18:16 user nova-compute[74342]: DEBUG nova.compute.manager [req-9670de41-c506-4cbe-bbeb-2f4c406151a7 req-78c1b6f3-5316-4435-997e-3bfd56f28ff4 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] No waiting events found dispatching network-vif-plugged-8edcd15a-87a9-43d6-9674-8a8ec38c6155 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:18:16 user nova-compute[74342]: WARNING nova.compute.manager [req-9670de41-c506-4cbe-bbeb-2f4c406151a7 req-78c1b6f3-5316-4435-997e-3bfd56f28ff4 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Received unexpected event network-vif-plugged-8edcd15a-87a9-43d6-9674-8a8ec38c6155 for instance with vm_state active and task_state reboot_started_hard.
Oct 16 10:18:17 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.281s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:18:17 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23037333364323035', 'path': '/dev/sdc'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:18:17 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037333364323035', 'path': '/dev/sdc'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 10:18:17 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1480925964',display_name='tempest-TestMinimumBasicScenario-server-1480925964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1480925964',id=47,image_ref='89e64f2a-3d34-4fea-a74f-92e55e89516d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXXZhgHmnUAZ47mUNhjP/DiMnlMHb5+XnkQwzyGb4Ge2Imhmk9flfIoP+nvZ6DYxlWCRt0Biq7X30JLPqManXPpmNAaqN5f3CuL8UvtnY0eEgtz48VaNWN4h5HNPTP6XA==',key_name='tempest-TestMinimumBasicScenario-545706033',keypairs=<?>,launch_index=0,launched_at=2023-10-16T10:15:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d121feadb9b94fe09dd25b0d5adedb6e',ramdisk_id='',reservation_id='r-h4fn136a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='89e64f2a-3d34-4fea-a74f-92e55e89516d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-643895215',owner_user_name='tempest-TestMinimumBasicScenario-643895215-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T10:18:15Z,user_data=None,user_id='fa5d15e5061141f798d8e0f58cae2c7f',uuid=e5932eb4-88be-4933-8e2f-0201d9303ffc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "address": "fa:16:3e:47:35:4d", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edcd15a-87", "ovs_interfaceid": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 10:18:17 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Converting VIF {"id": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "address": "fa:16:3e:47:35:4d", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edcd15a-87", "ovs_interfaceid": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:18:17 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:35:4d,bridge_name='br-int',has_traffic_filtering=True,id=8edcd15a-87a9-43d6-9674-8a8ec38c6155,network=Network(9adc3611-05c0-400f-99d4-a61f2c9e74d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8edcd15a-87') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:18:17 user nova-compute[74342]: DEBUG nova.objects.instance [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lazy-loading 'pci_devices' on Instance uuid e5932eb4-88be-4933-8e2f-0201d9303ffc {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:18:17 user nova-compute[74342]: DEBUG nova.objects.base [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Object Instance<e5932eb4-88be-4933-8e2f-0201d9303ffc> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:18:17 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] End _get_guest_xml xml=<domain type="kvm">
Oct 16 10:18:17 user nova-compute[74342]:   <uuid>e5932eb4-88be-4933-8e2f-0201d9303ffc</uuid>
Oct 16 10:18:17 user nova-compute[74342]:   <name>instance-0000002f</name>
Oct 16 10:18:17 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 10:18:17 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 10:18:17 user nova-compute[74342]:   <metadata>
Oct 16 10:18:17 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 10:18:17 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 10:18:17 user nova-compute[74342]:       <nova:name>tempest-TestMinimumBasicScenario-server-1480925964</nova:name>
Oct 16 10:18:17 user nova-compute[74342]:       <nova:creationTime>2023-10-16 10:18:15</nova:creationTime>
Oct 16 10:18:17 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 10:18:17 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 10:18:17 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 10:18:17 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 10:18:17 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 10:18:17 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 10:18:17 user nova-compute[74342]:       </nova:flavor>
Oct 16 10:18:17 user nova-compute[74342]:       <nova:owner>
Oct 16 10:18:17 user nova-compute[74342]:         <nova:user uuid="fa5d15e5061141f798d8e0f58cae2c7f">tempest-TestMinimumBasicScenario-643895215-project-member</nova:user>
Oct 16 10:18:17 user nova-compute[74342]:         <nova:project uuid="d121feadb9b94fe09dd25b0d5adedb6e">tempest-TestMinimumBasicScenario-643895215</nova:project>
Oct 16 10:18:17 user nova-compute[74342]:       </nova:owner>
Oct 16 10:18:17 user nova-compute[74342]:       <nova:root type="image" uuid="89e64f2a-3d34-4fea-a74f-92e55e89516d"/>
Oct 16 10:18:17 user nova-compute[74342]:       <nova:ports>
Oct 16 10:18:17 user nova-compute[74342]:         <nova:port uuid="8edcd15a-87a9-43d6-9674-8a8ec38c6155">
Oct 16 10:18:17 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 16 10:18:17 user nova-compute[74342]:         </nova:port>
Oct 16 10:18:17 user nova-compute[74342]:       </nova:ports>
Oct 16 10:18:17 user nova-compute[74342]:     </nova:instance>
Oct 16 10:18:17 user nova-compute[74342]:   </metadata>
Oct 16 10:18:17 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 10:18:17 user nova-compute[74342]:     <system>
Oct 16 10:18:17 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 10:18:17 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 10:18:17 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 10:18:17 user nova-compute[74342]:       <entry name="serial">e5932eb4-88be-4933-8e2f-0201d9303ffc</entry>
Oct 16 10:18:17 user nova-compute[74342]:       <entry name="uuid">e5932eb4-88be-4933-8e2f-0201d9303ffc</entry>
Oct 16 10:18:17 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 10:18:17 user nova-compute[74342]:     </system>
Oct 16 10:18:17 user nova-compute[74342]:   </sysinfo>
Oct 16 10:18:17 user nova-compute[74342]:   <os>
Oct 16 10:18:17 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 10:18:17 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 10:18:17 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 10:18:17 user nova-compute[74342]:   </os>
Oct 16 10:18:17 user nova-compute[74342]:   <features>
Oct 16 10:18:17 user nova-compute[74342]:     <acpi/>
Oct 16 10:18:17 user nova-compute[74342]:     <apic/>
Oct 16 10:18:17 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 10:18:17 user nova-compute[74342]:   </features>
Oct 16 10:18:17 user nova-compute[74342]:   <clock offset="utc">
Oct 16 10:18:17 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 10:18:17 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 10:18:17 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 10:18:17 user nova-compute[74342]:   </clock>
Oct 16 10:18:17 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 10:18:17 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 10:18:17 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 10:18:17 user nova-compute[74342]:   </cpu>
Oct 16 10:18:17 user nova-compute[74342]:   <devices>
Oct 16 10:18:17 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 10:18:17 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 10:18:17 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk"/>
Oct 16 10:18:17 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 10:18:17 user nova-compute[74342]:     </disk>
Oct 16 10:18:17 user nova-compute[74342]:     <disk type="block" device="disk">
Oct 16 10:18:17 user nova-compute[74342]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:18:17 user nova-compute[74342]:       <source dev="/dev/sdc"/>
Oct 16 10:18:17 user nova-compute[74342]:       <target dev="vdb" bus="virtio"/>
Oct 16 10:18:17 user nova-compute[74342]:       <serial>61ae5017-9f77-47ee-a2eb-756aaad09c96</serial>
Oct 16 10:18:17 user nova-compute[74342]:     </disk>
Oct 16 10:18:17 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 10:18:17 user nova-compute[74342]:       <mac address="fa:16:3e:47:35:4d"/>
Oct 16 10:18:17 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:18:17 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 10:18:17 user nova-compute[74342]:       <target dev="tap8edcd15a-87"/>
Oct 16 10:18:17 user nova-compute[74342]:     </interface>
Oct 16 10:18:17 user nova-compute[74342]:     <serial type="pty">
Oct 16 10:18:17 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/console.log" append="off"/>
Oct 16 10:18:17 user nova-compute[74342]:     </serial>
Oct 16 10:18:17 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 10:18:17 user nova-compute[74342]:     <video>
Oct 16 10:18:17 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:18:17 user nova-compute[74342]:     </video>
Oct 16 10:18:17 user nova-compute[74342]:     <rng model="virtio">
Oct 16 10:18:17 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 10:18:17 user nova-compute[74342]:     </rng>
Oct 16 10:18:17 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 10:18:17 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 10:18:17 user nova-compute[74342]:       <stats period="10"/>
Oct 16 10:18:17 user nova-compute[74342]:     </memballoon>
Oct 16 10:18:17 user nova-compute[74342]:   </devices>
Oct 16 10:18:17 user nova-compute[74342]: </domain>
Oct 16 10:18:17 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 10:18:17 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:17 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:18:17 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:18:17 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:17 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-7d016ab3-14c4-4c33-bd50-468f71339cd7" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:18:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-7d016ab3-14c4-4c33-bd50-468f71339cd7" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:18:17 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:18:17 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:17 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 10:18:17 user nova-compute[74342]: DEBUG nova.objects.instance [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lazy-loading 'trusted_certs' on Instance uuid e5932eb4-88be-4933-8e2f-0201d9303ffc {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:18:17 user nova-compute[74342]: DEBUG nova.objects.base [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Object Instance<e5932eb4-88be-4933-8e2f-0201d9303ffc> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:18:17 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e39c73c64aea252a31091e4bd2cc27798227fcef --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:17 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e39c73c64aea252a31091e4bd2cc27798227fcef --force-share --output=json" returned: 0 in 0.180s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:17 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 10:18:17 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:17 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Updating instance_info_cache with network_info: [{"id": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "address": "fa:16:3e:de:cb:e3", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74fa1b3-86", "ovs_interfaceid": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:18:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-7d016ab3-14c4-4c33-bd50-468f71339cd7" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:18:17 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:18:17 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:18:18 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:18 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Cannot resize image /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 10:18:18 user nova-compute[74342]: DEBUG nova.objects.instance [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lazy-loading 'migration_context' on Instance uuid e5932eb4-88be-4933-8e2f-0201d9303ffc {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:18:18 user nova-compute[74342]: DEBUG nova.objects.base [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Object Instance<e5932eb4-88be-4933-8e2f-0201d9303ffc> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=74342) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Oct 16 10:18:18 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1480925964',display_name='tempest-TestMinimumBasicScenario-server-1480925964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1480925964',id=47,image_ref='89e64f2a-3d34-4fea-a74f-92e55e89516d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXXZhgHmnUAZ47mUNhjP/DiMnlMHb5+XnkQwzyGb4Ge2Imhmk9flfIoP+nvZ6DYxlWCRt0Biq7X30JLPqManXPpmNAaqN5f3CuL8UvtnY0eEgtz48VaNWN4h5HNPTP6XA==',key_name='tempest-TestMinimumBasicScenario-545706033',keypairs=<?>,launch_index=0,launched_at=2023-10-16T10:15:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='d121feadb9b94fe09dd25b0d5adedb6e',ramdisk_id='',reservation_id='r-h4fn136a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='89e64f2a-3d34-4fea-a74f-92e55e89516d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-643895215',owner_user_name='tempest-TestMinimumBasicScenario-643895215-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:18:15Z,user_data=None,user_id='fa5d15e5061141f798d8e0f58cae2c7f',uuid=e5932eb4-88be-4933-8e2f-0201d9303ffc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "address": "fa:16:3e:47:35:4d", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edcd15a-87", "ovs_interfaceid": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 10:18:18 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Converting VIF {"id": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "address": "fa:16:3e:47:35:4d", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edcd15a-87", "ovs_interfaceid": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:18:18 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:35:4d,bridge_name='br-int',has_traffic_filtering=True,id=8edcd15a-87a9-43d6-9674-8a8ec38c6155,network=Network(9adc3611-05c0-400f-99d4-a61f2c9e74d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8edcd15a-87') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:18:18 user nova-compute[74342]: DEBUG os_vif [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:35:4d,bridge_name='br-int',has_traffic_filtering=True,id=8edcd15a-87a9-43d6-9674-8a8ec38c6155,network=Network(9adc3611-05c0-400f-99d4-a61f2c9e74d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8edcd15a-87') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 10:18:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:18:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 10:18:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4bce745-ee99-5892-8251-bf6ae4b51146', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:18:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:18:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8edcd15a-87, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:18:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8edcd15a-87, col_values=(('qos', UUID('715b83c0-0487-4a09-8afc-bd18f5f011c8')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:18:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8edcd15a-87, col_values=(('external_ids', {'iface-id': '8edcd15a-87a9-43d6-9674-8a8ec38c6155', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:35:4d', 'vm-uuid': 'e5932eb4-88be-4933-8e2f-0201d9303ffc'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:18:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:18:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:18 user nova-compute[74342]: INFO os_vif [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:35:4d,bridge_name='br-int',has_traffic_filtering=True,id=8edcd15a-87a9-43d6-9674-8a8ec38c6155,network=Network(9adc3611-05c0-400f-99d4-a61f2c9e74d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8edcd15a-87')
Oct 16 10:18:18 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:18:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:18:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:18:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:18:18 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:18:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:19 user nova-compute[74342]: DEBUG nova.compute.manager [req-55f2f792-9afc-4392-a045-d359089e1064 req-33d21900-acc4-4266-b40f-31fb9dd6a54f service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Received event network-vif-plugged-8edcd15a-87a9-43d6-9674-8a8ec38c6155 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:18:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-55f2f792-9afc-4392-a045-d359089e1064 req-33d21900-acc4-4266-b40f-31fb9dd6a54f service nova] Acquiring lock "e5932eb4-88be-4933-8e2f-0201d9303ffc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:18:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-55f2f792-9afc-4392-a045-d359089e1064 req-33d21900-acc4-4266-b40f-31fb9dd6a54f service nova] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:18:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-55f2f792-9afc-4392-a045-d359089e1064 req-33d21900-acc4-4266-b40f-31fb9dd6a54f service nova] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:18:19 user nova-compute[74342]: DEBUG nova.compute.manager [req-55f2f792-9afc-4392-a045-d359089e1064 req-33d21900-acc4-4266-b40f-31fb9dd6a54f service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] No waiting events found dispatching network-vif-plugged-8edcd15a-87a9-43d6-9674-8a8ec38c6155 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:18:19 user nova-compute[74342]: WARNING nova.compute.manager [req-55f2f792-9afc-4392-a045-d359089e1064 req-33d21900-acc4-4266-b40f-31fb9dd6a54f service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Received unexpected event network-vif-plugged-8edcd15a-87a9-43d6-9674-8a8ec38c6155 for instance with vm_state active and task_state reboot_started_hard.
Oct 16 10:18:20 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:20 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:20 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:20 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:20 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:20 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 10:18:20 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:20 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:20 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:20 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:20 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 10:18:20 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:18:21 user nova-compute[74342]: DEBUG nova.compute.manager [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 10:18:21 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Instance rebooted successfully.
Oct 16 10:18:21 user nova-compute[74342]: DEBUG nova.compute.manager [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:18:21 user nova-compute[74342]: DEBUG nova.compute.manager [req-96f56634-a19e-4c22-868e-1dd347ac79f0 req-178b982c-5dd3-4a28-8fc9-dba50635ce59 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Received event network-vif-plugged-8edcd15a-87a9-43d6-9674-8a8ec38c6155 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:18:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-96f56634-a19e-4c22-868e-1dd347ac79f0 req-178b982c-5dd3-4a28-8fc9-dba50635ce59 service nova] Acquiring lock "e5932eb4-88be-4933-8e2f-0201d9303ffc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:18:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-96f56634-a19e-4c22-868e-1dd347ac79f0 req-178b982c-5dd3-4a28-8fc9-dba50635ce59 service nova] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:18:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-96f56634-a19e-4c22-868e-1dd347ac79f0 req-178b982c-5dd3-4a28-8fc9-dba50635ce59 service nova] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:18:21 user nova-compute[74342]: DEBUG nova.compute.manager [req-96f56634-a19e-4c22-868e-1dd347ac79f0 req-178b982c-5dd3-4a28-8fc9-dba50635ce59 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] No waiting events found dispatching network-vif-plugged-8edcd15a-87a9-43d6-9674-8a8ec38c6155 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:18:21 user nova-compute[74342]: WARNING nova.compute.manager [req-96f56634-a19e-4c22-868e-1dd347ac79f0 req-178b982c-5dd3-4a28-8fc9-dba50635ce59 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Received unexpected event network-vif-plugged-8edcd15a-87a9-43d6-9674-8a8ec38c6155 for instance with vm_state active and task_state reboot_started_hard.
Oct 16 10:18:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:18:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f799df2d-f843-4658-86d4-c1b257ce0a52 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 8.232s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:18:22 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:18:22 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:18:22 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8676MB free_disk=24.90142059326172GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:18:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:18:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:18:22 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 34ef7d18-0724-479a-8448-981b9cf0d6ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:18:22 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7d016ab3-14c4-4c33-bd50-468f71339cd7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:18:22 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:18:22 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance e5932eb4-88be-4933-8e2f-0201d9303ffc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:18:22 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:18:22 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:18:22 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:18:22 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:18:22 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:18:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.283s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:18:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:25 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:18:25 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:18:25 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:18:25 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:18:25 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:18:26 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:18:26 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:18:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:18:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:19:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:19:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:19:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:19:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:19:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:19:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:19:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:19:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:19:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:19:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:19:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:19:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:19:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:19:14 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:19:17 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:19:17 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:19:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:19:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:19:17 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:19:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:19:18 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Updating instance_info_cache with network_info: [{"id": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "address": "fa:16:3e:48:08:65", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aba45fe-36", "ovs_interfaceid": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:19:18 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:19:18 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:19:19 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:19:20 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:19:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:19:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:19:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:19:20 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:19:20 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:19:20 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:19:20 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:19:20 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:19:20 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 10:19:20 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:19:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:19:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:19:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:19:21 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 10:19:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:19:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:19:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:19:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:19:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:19:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:19:21 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:19:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:19:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:19:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:19:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:19:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:19:22 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:19:22 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:19:22 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8715MB free_disk=24.8997802734375GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:19:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:19:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:19:22 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 34ef7d18-0724-479a-8448-981b9cf0d6ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:19:22 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7d016ab3-14c4-4c33-bd50-468f71339cd7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:19:22 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:19:22 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance e5932eb4-88be-4933-8e2f-0201d9303ffc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:19:22 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:19:22 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:19:23 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:19:23 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:19:23 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:19:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.306s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:19:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:19:25 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:19:25 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:19:25 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:19:25 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:19:27 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:19:27 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:19:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:19:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:19:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:19:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:19:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:19:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:19:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:19:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:19:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:19:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:19:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:19:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:19:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:19:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:19:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:19:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Verify base images {{(pid=74342) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Oct 16 10:19:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Image id 89e64f2a-3d34-4fea-a74f-92e55e89516d yields fingerprint e39c73c64aea252a31091e4bd2cc27798227fcef {{(pid=74342) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 16 10:19:41 user nova-compute[74342]: INFO nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] image 89e64f2a-3d34-4fea-a74f-92e55e89516d at (/opt/stack/data/nova/instances/_base/e39c73c64aea252a31091e4bd2cc27798227fcef): checking
Oct 16 10:19:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] image 89e64f2a-3d34-4fea-a74f-92e55e89516d at (/opt/stack/data/nova/instances/_base/e39c73c64aea252a31091e4bd2cc27798227fcef): image is in use {{(pid=74342) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 16 10:19:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=74342) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 16 10:19:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Image id 01fbac29-34fa-4a9a-a2f8-2f304b74a717 yields fingerprint e0ab47bb7e7263acaed522a0a70e99f7614494dd {{(pid=74342) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Oct 16 10:19:41 user nova-compute[74342]: INFO nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] image 01fbac29-34fa-4a9a-a2f8-2f304b74a717 at (/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd): checking
Oct 16 10:19:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] image 01fbac29-34fa-4a9a-a2f8-2f304b74a717 at (/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd): image is in use {{(pid=74342) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Oct 16 10:19:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] 34ef7d18-0724-479a-8448-981b9cf0d6ab is a valid instance name {{(pid=74342) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 16 10:19:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] 34ef7d18-0724-479a-8448-981b9cf0d6ab has a disk file {{(pid=74342) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 16 10:19:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:19:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:19:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 34ef7d18-0724-479a-8448-981b9cf0d6ab is backed by e0ab47bb7e7263acaed522a0a70e99f7614494dd {{(pid=74342) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 16 10:19:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9 is a valid instance name {{(pid=74342) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 16 10:19:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9 has a disk file {{(pid=74342) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 16 10:19:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:19:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:19:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9 is backed by e0ab47bb7e7263acaed522a0a70e99f7614494dd {{(pid=74342) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 16 10:19:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] 7d016ab3-14c4-4c33-bd50-468f71339cd7 is a valid instance name {{(pid=74342) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 16 10:19:41 user nova-compute[74342]: DEBUG nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] 7d016ab3-14c4-4c33-bd50-468f71339cd7 has a disk file {{(pid=74342) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 16 10:19:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:19:42 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:19:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7d016ab3-14c4-4c33-bd50-468f71339cd7 is backed by e0ab47bb7e7263acaed522a0a70e99f7614494dd {{(pid=74342) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 16 10:19:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] e5932eb4-88be-4933-8e2f-0201d9303ffc is a valid instance name {{(pid=74342) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Oct 16 10:19:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] e5932eb4-88be-4933-8e2f-0201d9303ffc has a disk file {{(pid=74342) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Oct 16 10:19:42 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:19:42 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:19:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance e5932eb4-88be-4933-8e2f-0201d9303ffc is backed by e39c73c64aea252a31091e4bd2cc27798227fcef {{(pid=74342) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Oct 16 10:19:42 user nova-compute[74342]: WARNING nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Unknown base file: /opt/stack/data/nova/instances/_base/69bfda58fcd66cfafdf8d98c945d7032a2c6bb35
Oct 16 10:19:42 user nova-compute[74342]: WARNING nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Unknown base file: /opt/stack/data/nova/instances/_base/054d9bb67d2a0fdc1e425ba0b5b6c0648a104971
Oct 16 10:19:42 user nova-compute[74342]: WARNING nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Unknown base file: /opt/stack/data/nova/instances/_base/23d68d07431b972e0a066a70baac4029c8b1c066
Oct 16 10:19:42 user nova-compute[74342]: WARNING nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Unknown base file: /opt/stack/data/nova/instances/_base/f5f1ce72ae61e1e6e02683e51ca48f3ec5b2dbb8
Oct 16 10:19:42 user nova-compute[74342]: WARNING nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b3ba3fb0c354b693bd039d6a525f61449cc13bef
Oct 16 10:19:42 user nova-compute[74342]: WARNING nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Unknown base file: /opt/stack/data/nova/instances/_base/a54828bc6b400d4c9912ebff5c81c0606e8de36b
Oct 16 10:19:42 user nova-compute[74342]: INFO nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Active base files: /opt/stack/data/nova/instances/_base/e39c73c64aea252a31091e4bd2cc27798227fcef /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd
Oct 16 10:19:42 user nova-compute[74342]: INFO nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Removable base files: /opt/stack/data/nova/instances/_base/69bfda58fcd66cfafdf8d98c945d7032a2c6bb35 /opt/stack/data/nova/instances/_base/054d9bb67d2a0fdc1e425ba0b5b6c0648a104971 /opt/stack/data/nova/instances/_base/23d68d07431b972e0a066a70baac4029c8b1c066 /opt/stack/data/nova/instances/_base/f5f1ce72ae61e1e6e02683e51ca48f3ec5b2dbb8 /opt/stack/data/nova/instances/_base/b3ba3fb0c354b693bd039d6a525f61449cc13bef /opt/stack/data/nova/instances/_base/a54828bc6b400d4c9912ebff5c81c0606e8de36b
Oct 16 10:19:42 user nova-compute[74342]: INFO nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/69bfda58fcd66cfafdf8d98c945d7032a2c6bb35
Oct 16 10:19:42 user nova-compute[74342]: INFO nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/054d9bb67d2a0fdc1e425ba0b5b6c0648a104971
Oct 16 10:19:42 user nova-compute[74342]: INFO nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/23d68d07431b972e0a066a70baac4029c8b1c066
Oct 16 10:19:42 user nova-compute[74342]: INFO nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/f5f1ce72ae61e1e6e02683e51ca48f3ec5b2dbb8
Oct 16 10:19:42 user nova-compute[74342]: INFO nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b3ba3fb0c354b693bd039d6a525f61449cc13bef
Oct 16 10:19:42 user nova-compute[74342]: INFO nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a54828bc6b400d4c9912ebff5c81c0606e8de36b
Oct 16 10:19:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Verification complete {{(pid=74342) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Oct 16 10:19:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Verify swap images {{(pid=74342) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Oct 16 10:19:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.imagecache [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Verify ephemeral images {{(pid=74342) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Oct 16 10:19:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:19:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:19:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:19:53 user nova-compute[74342]: DEBUG nova.compute.manager [req-c7741640-23bc-41dd-87c0-6c607cd14777 req-322bf015-ba83-4daa-ab02-d037edd20d63 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received event network-changed-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:19:53 user nova-compute[74342]: DEBUG nova.compute.manager [req-c7741640-23bc-41dd-87c0-6c607cd14777 req-322bf015-ba83-4daa-ab02-d037edd20d63 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Refreshing instance network info cache due to event network-changed-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:19:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c7741640-23bc-41dd-87c0-6c607cd14777 req-322bf015-ba83-4daa-ab02-d037edd20d63 service nova] Acquiring lock "refresh_cache-fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:19:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c7741640-23bc-41dd-87c0-6c607cd14777 req-322bf015-ba83-4daa-ab02-d037edd20d63 service nova] Acquired lock "refresh_cache-fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:19:53 user nova-compute[74342]: DEBUG nova.network.neutron [req-c7741640-23bc-41dd-87c0-6c607cd14777 req-322bf015-ba83-4daa-ab02-d037edd20d63 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Refreshing network info cache for port 0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:19:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:19:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:19:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:19:53 user nova-compute[74342]: INFO nova.compute.manager [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Detaching volume 8e906e35-53f0-4ce3-a61f-511d9a37d890
Oct 16 10:19:53 user nova-compute[74342]: INFO nova.virt.block_device [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Attempting to driver detach volume 8e906e35-53f0-4ce3-a61f-511d9a37d890 from mountpoint /dev/vdb
Oct 16 10:19:54 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Attempting to detach device vdb from instance fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9 from the persistent domain config. {{(pid=74342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 10:19:54 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 10:19:54 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:19:54 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 10:19:54 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:19:54 user nova-compute[74342]:   <serial>8e906e35-53f0-4ce3-a61f-511d9a37d890</serial>
Oct 16 10:19:54 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 10:19:54 user nova-compute[74342]: </disk>
Oct 16 10:19:54 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 10:19:54 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Successfully detached device vdb from instance fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9 from the persistent domain config.
Oct 16 10:19:54 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9 from the live domain config. {{(pid=74342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 10:19:54 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 10:19:54 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:19:54 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 10:19:54 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:19:54 user nova-compute[74342]:   <serial>8e906e35-53f0-4ce3-a61f-511d9a37d890</serial>
Oct 16 10:19:54 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 10:19:54 user nova-compute[74342]: </disk>
Oct 16 10:19:54 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 10:19:54 user nova-compute[74342]: DEBUG nova.network.neutron [req-c7741640-23bc-41dd-87c0-6c607cd14777 req-322bf015-ba83-4daa-ab02-d037edd20d63 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Updated VIF entry in instance network info cache for port 0aba45fe-3675-4a86-ac2d-9eac3af1ecc6. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:19:54 user nova-compute[74342]: DEBUG nova.network.neutron [req-c7741640-23bc-41dd-87c0-6c607cd14777 req-322bf015-ba83-4daa-ab02-d037edd20d63 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Updating instance_info_cache with network_info: [{"id": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "address": "fa:16:3e:48:08:65", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aba45fe-36", "ovs_interfaceid": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:19:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c7741640-23bc-41dd-87c0-6c607cd14777 req-322bf015-ba83-4daa-ab02-d037edd20d63 service nova] Releasing lock "refresh_cache-fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:19:54 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9 {{(pid=74342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 10:19:55 user nova-compute[74342]: DEBUG nova.compute.manager [req-9b55c6e7-81ec-42b5-a982-18537342090c req-7d79e026-d938-4ba8-a649-8bb4abe8ad1b service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received event network-changed-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:19:55 user nova-compute[74342]: DEBUG nova.compute.manager [req-9b55c6e7-81ec-42b5-a982-18537342090c req-7d79e026-d938-4ba8-a649-8bb4abe8ad1b service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Refreshing instance network info cache due to event network-changed-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:19:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9b55c6e7-81ec-42b5-a982-18537342090c req-7d79e026-d938-4ba8-a649-8bb4abe8ad1b service nova] Acquiring lock "refresh_cache-fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:19:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9b55c6e7-81ec-42b5-a982-18537342090c req-7d79e026-d938-4ba8-a649-8bb4abe8ad1b service nova] Acquired lock "refresh_cache-fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:19:55 user nova-compute[74342]: DEBUG nova.network.neutron [req-9b55c6e7-81ec-42b5-a982-18537342090c req-7d79e026-d938-4ba8-a649-8bb4abe8ad1b service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Refreshing network info cache for port 0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:19:55 user nova-compute[74342]: DEBUG nova.network.neutron [req-9b55c6e7-81ec-42b5-a982-18537342090c req-7d79e026-d938-4ba8-a649-8bb4abe8ad1b service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Updated VIF entry in instance network info cache for port 0aba45fe-3675-4a86-ac2d-9eac3af1ecc6. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:19:55 user nova-compute[74342]: DEBUG nova.network.neutron [req-9b55c6e7-81ec-42b5-a982-18537342090c req-7d79e026-d938-4ba8-a649-8bb4abe8ad1b service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Updating instance_info_cache with network_info: [{"id": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "address": "fa:16:3e:48:08:65", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aba45fe-36", "ovs_interfaceid": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:19:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9b55c6e7-81ec-42b5-a982-18537342090c req-7d79e026-d938-4ba8-a649-8bb4abe8ad1b service nova] Releasing lock "refresh_cache-fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:19:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:19:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:05 user nova-compute[74342]: DEBUG nova.compute.manager [req-b55217f3-266a-4af0-8f37-20494af451d6 req-b828cd8d-e719-486e-9da4-8e8044253fd3 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Received event network-changed-8edcd15a-87a9-43d6-9674-8a8ec38c6155 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:20:05 user nova-compute[74342]: DEBUG nova.compute.manager [req-b55217f3-266a-4af0-8f37-20494af451d6 req-b828cd8d-e719-486e-9da4-8e8044253fd3 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Refreshing instance network info cache due to event network-changed-8edcd15a-87a9-43d6-9674-8a8ec38c6155. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:20:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b55217f3-266a-4af0-8f37-20494af451d6 req-b828cd8d-e719-486e-9da4-8e8044253fd3 service nova] Acquiring lock "refresh_cache-e5932eb4-88be-4933-8e2f-0201d9303ffc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:20:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b55217f3-266a-4af0-8f37-20494af451d6 req-b828cd8d-e719-486e-9da4-8e8044253fd3 service nova] Acquired lock "refresh_cache-e5932eb4-88be-4933-8e2f-0201d9303ffc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:20:05 user nova-compute[74342]: DEBUG nova.network.neutron [req-b55217f3-266a-4af0-8f37-20494af451d6 req-b828cd8d-e719-486e-9da4-8e8044253fd3 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Refreshing network info cache for port 8edcd15a-87a9-43d6-9674-8a8ec38c6155 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:20:06 user nova-compute[74342]: DEBUG nova.network.neutron [req-b55217f3-266a-4af0-8f37-20494af451d6 req-b828cd8d-e719-486e-9da4-8e8044253fd3 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Updated VIF entry in instance network info cache for port 8edcd15a-87a9-43d6-9674-8a8ec38c6155. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:20:06 user nova-compute[74342]: DEBUG nova.network.neutron [req-b55217f3-266a-4af0-8f37-20494af451d6 req-b828cd8d-e719-486e-9da4-8e8044253fd3 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Updating instance_info_cache with network_info: [{"id": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "address": "fa:16:3e:47:35:4d", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edcd15a-87", "ovs_interfaceid": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:20:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b55217f3-266a-4af0-8f37-20494af451d6 req-b828cd8d-e719-486e-9da4-8e8044253fd3 service nova] Releasing lock "refresh_cache-e5932eb4-88be-4933-8e2f-0201d9303ffc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:20:06 user nova-compute[74342]: DEBUG nova.compute.manager [req-712fa732-c48d-410b-8655-adf7ae113b15 req-d9a908a4-0122-43f7-90a9-9fd8cfbb8d46 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Received event network-changed-8edcd15a-87a9-43d6-9674-8a8ec38c6155 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:20:06 user nova-compute[74342]: DEBUG nova.compute.manager [req-712fa732-c48d-410b-8655-adf7ae113b15 req-d9a908a4-0122-43f7-90a9-9fd8cfbb8d46 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Refreshing instance network info cache due to event network-changed-8edcd15a-87a9-43d6-9674-8a8ec38c6155. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:20:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-712fa732-c48d-410b-8655-adf7ae113b15 req-d9a908a4-0122-43f7-90a9-9fd8cfbb8d46 service nova] Acquiring lock "refresh_cache-e5932eb4-88be-4933-8e2f-0201d9303ffc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:20:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-712fa732-c48d-410b-8655-adf7ae113b15 req-d9a908a4-0122-43f7-90a9-9fd8cfbb8d46 service nova] Acquired lock "refresh_cache-e5932eb4-88be-4933-8e2f-0201d9303ffc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:20:06 user nova-compute[74342]: DEBUG nova.network.neutron [req-712fa732-c48d-410b-8655-adf7ae113b15 req-d9a908a4-0122-43f7-90a9-9fd8cfbb8d46 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Refreshing network info cache for port 8edcd15a-87a9-43d6-9674-8a8ec38c6155 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:20:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "e5932eb4-88be-4933-8e2f-0201d9303ffc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:20:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:20:07 user nova-compute[74342]: INFO nova.compute.manager [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Detaching volume 61ae5017-9f77-47ee-a2eb-756aaad09c96
Oct 16 10:20:07 user nova-compute[74342]: INFO nova.virt.block_device [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Attempting to driver detach volume 61ae5017-9f77-47ee-a2eb-756aaad09c96 from mountpoint /dev/vdb
Oct 16 10:20:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Attempting to detach device vdb from instance e5932eb4-88be-4933-8e2f-0201d9303ffc from the persistent domain config. {{(pid=74342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 10:20:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 10:20:07 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:20:07 user nova-compute[74342]:   <source dev="/dev/sdc"/>
Oct 16 10:20:07 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:20:07 user nova-compute[74342]:   <serial>61ae5017-9f77-47ee-a2eb-756aaad09c96</serial>
Oct 16 10:20:07 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 10:20:07 user nova-compute[74342]: </disk>
Oct 16 10:20:07 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 10:20:07 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Successfully detached device vdb from instance e5932eb4-88be-4933-8e2f-0201d9303ffc from the persistent domain config.
Oct 16 10:20:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e5932eb4-88be-4933-8e2f-0201d9303ffc from the live domain config. {{(pid=74342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 10:20:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 10:20:07 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:20:07 user nova-compute[74342]:   <source dev="/dev/sdc"/>
Oct 16 10:20:07 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:20:07 user nova-compute[74342]:   <serial>61ae5017-9f77-47ee-a2eb-756aaad09c96</serial>
Oct 16 10:20:07 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Oct 16 10:20:07 user nova-compute[74342]: </disk>
Oct 16 10:20:07 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 10:20:07 user nova-compute[74342]: DEBUG nova.network.neutron [req-712fa732-c48d-410b-8655-adf7ae113b15 req-d9a908a4-0122-43f7-90a9-9fd8cfbb8d46 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Updated VIF entry in instance network info cache for port 8edcd15a-87a9-43d6-9674-8a8ec38c6155. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:20:07 user nova-compute[74342]: DEBUG nova.network.neutron [req-712fa732-c48d-410b-8655-adf7ae113b15 req-d9a908a4-0122-43f7-90a9-9fd8cfbb8d46 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Updating instance_info_cache with network_info: [{"id": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "address": "fa:16:3e:47:35:4d", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edcd15a-87", "ovs_interfaceid": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:20:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-712fa732-c48d-410b-8655-adf7ae113b15 req-d9a908a4-0122-43f7-90a9-9fd8cfbb8d46 service nova] Releasing lock "refresh_cache-e5932eb4-88be-4933-8e2f-0201d9303ffc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:20:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e5932eb4-88be-4933-8e2f-0201d9303ffc {{(pid=74342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 10:20:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:14 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9 is timed out.
Oct 16 10:20:14 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Successfully detached device vdb from instance fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9 from the live domain config.
Oct 16 10:20:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xJmlCTda', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:20:14 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:20:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d16c7a-ef0c-49fb-aec8-40b63598ab0a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 10:20:14 user nova-compute[74342]: No targets found.
Oct 16 10:20:14 user nova-compute[74342]: iSNS:
Oct 16 10:20:14 user nova-compute[74342]: No targets found.
Oct 16 10:20:14 user nova-compute[74342]: STATIC:
Oct 16 10:20:14 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890
Oct 16 10:20:14 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:20:14 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:20:14 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96
Oct 16 10:20:14 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:20:14 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:20:14 user nova-compute[74342]: FIRMWARE:
Oct 16 10:20:14 user nova-compute[74342]: No targets found.
Oct 16 10:20:14 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 10:20:14 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 10:20:14 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd25dad2-7652-419f-94ab-922a462d601b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[395831d6-7b49-4d0c-9a38-f698468b3c66]: (4, ('tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 (non-flash)
Oct 16 10:20:14 user nova-compute[74342]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 (non-flash)
Oct 16 10:20:14 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] iscsi session list stdout=tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 (non-flash)
Oct 16 10:20:14 user nova-compute[74342]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 (non-flash)
Oct 16 10:20:14 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b603cd240>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890'): ({'sdb'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Removing single pathed devices sdb {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee74bac-9f2f-42f1-9a77-941f8a3b4255]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[60cbc188-ad17-4c52-9ea9-ae6a3eee09e4]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Flushing IO for device /dev/sdb {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3892839f-9ca9-4bf8-a846-3abad6fbf4eb]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e0c35e-8998-459f-9502-5736c56b9a5f]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccf6c100-7856-4b7f-bd11-8eb0b31d1d27]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd348557-0981-4442-838e-df5c92bd1991]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890, portal: 172.16.0.220,3260]
Oct 16 10:20:14 user nova-compute[74342]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890, portal: 172.16.0.220,3260] successful.
Oct 16 10:20:14 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8e906e35-53f0-4ce3-a61f-511d9a37d890 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8998355-2972-478d-b12e-faf971b56ed2]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.317s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] <== disconnect_volume: return (318ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:20:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 10:20:15 user nova-compute[74342]: DEBUG nova.objects.instance [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lazy-loading 'flavor' on Instance uuid fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:20:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-50a60922-5b5e-4ebb-b764-0bf6fa557ab9 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.757s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:20:17 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:20:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:20:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:20:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:20:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:20:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:18 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:20:18 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Cleaning up deleted instances {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 10:20:18 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] There are 1 instances to clean {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 10:20:18 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Instance has had 5 of 5 cleanup attempts {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 16 10:20:19 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:20:19 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:20:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-e5932eb4-88be-4933-8e2f-0201d9303ffc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:20:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-e5932eb4-88be-4933-8e2f-0201d9303ffc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:20:19 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:20:19 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Updating instance_info_cache with network_info: [{"id": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "address": "fa:16:3e:47:35:4d", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edcd15a-87", "ovs_interfaceid": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:20:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-e5932eb4-88be-4933-8e2f-0201d9303ffc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:20:19 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:20:21 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:20:22 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:20:22 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:20:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:20:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:20:22 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:20:22 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:20:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:20:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:20:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:20:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:20:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:20:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:20:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:20:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:20:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:20:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json" returned: 0 in 0.165s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:20:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:20:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:20:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:20:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:20:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:20:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:20:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:20:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:20:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:20:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:20:24 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:20:24 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:20:24 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8767MB free_disk=24.898834228515625GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:20:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:20:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:20:24 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 34ef7d18-0724-479a-8448-981b9cf0d6ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:20:24 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7d016ab3-14c4-4c33-bd50-468f71339cd7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:20:24 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:20:24 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance e5932eb4-88be-4933-8e2f-0201d9303ffc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:20:24 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:20:24 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:20:24 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:20:24 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:20:24 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:20:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.229s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:20:24 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:20:25 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:20:25 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:20:25 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:20:25 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:20:25 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:20:25 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74342) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:20:27 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e5932eb4-88be-4933-8e2f-0201d9303ffc is timed out.
Oct 16 10:20:27 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Successfully detached device vdb from instance e5932eb4-88be-4933-8e2f-0201d9303ffc from the live domain config.
Oct 16 10:20:27 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'eZBGxcqt', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:20:27 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:20:27 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1518d760-24f8-4dea-80c1-421648a07baa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 10:20:27 user nova-compute[74342]: No targets found.
Oct 16 10:20:27 user nova-compute[74342]: iSNS:
Oct 16 10:20:27 user nova-compute[74342]: No targets found.
Oct 16 10:20:27 user nova-compute[74342]: STATIC:
Oct 16 10:20:27 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96
Oct 16 10:20:27 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:20:27 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:20:27 user nova-compute[74342]: FIRMWARE:
Oct 16 10:20:27 user nova-compute[74342]: No targets found.
Oct 16 10:20:27 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 10:20:27 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 10:20:27 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a614b95-3327-473d-ab41-9865e735d4ea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[59305291-cd42-45d9-859d-1154fef62cb0]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 (non-flash)
Oct 16 10:20:27 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 (non-flash)
Oct 16 10:20:27 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b83fd7760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96'): ({'sdc'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Removing single pathed devices sdc {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41fff5f-d53f-4968-8adb-30239bf6843f]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7dd7560-f858-4f0b-8233-cdce7266895c]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Flushing IO for device /dev/sdc {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[feb514de-b6d9-40d9-ad54-0f725f86d11c]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.034s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e29ea1-cdad-418a-b304-7d078e49cbf8]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] SCSI volumes sdc have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec499591-7c2f-4c61-b453-9b450d7d8c75]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[637f01c8-5536-43e5-a940-f37773b41f7f]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96, portal: 172.16.0.220,3260]
Oct 16 10:20:27 user nova-compute[74342]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96, portal: 172.16.0.220,3260] successful.
Oct 16 10:20:27 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:61ae5017-9f77-47ee-a2eb-756aaad09c96 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[847103cd-bec1-4a50-ad36-9b18d29bd3b0]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.253s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] <== disconnect_volume: return (254ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:20:27 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 10:20:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:20:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:20:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:20:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:20:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:28 user nova-compute[74342]: DEBUG nova.objects.instance [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lazy-loading 'flavor' on Instance uuid e5932eb4-88be-4933-8e2f-0201d9303ffc {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:20:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-05b8ea6a-0d9f-4b0b-9482-94bfe4724cbf tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.908s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:20:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:20:35 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:20:35 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Triggering sync for uuid 34ef7d18-0724-479a-8448-981b9cf0d6ab {{(pid=74342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 10:20:35 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Triggering sync for uuid 7d016ab3-14c4-4c33-bd50-468f71339cd7 {{(pid=74342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 10:20:35 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Triggering sync for uuid fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9 {{(pid=74342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 10:20:35 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Triggering sync for uuid e5932eb4-88be-4933-8e2f-0201d9303ffc {{(pid=74342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 10:20:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "34ef7d18-0724-479a-8448-981b9cf0d6ab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:20:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:20:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "7d016ab3-14c4-4c33-bd50-468f71339cd7" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:20:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "7d016ab3-14c4-4c33-bd50-468f71339cd7" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:20:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:20:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:20:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "e5932eb4-88be-4933-8e2f-0201d9303ffc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:20:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:20:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "7d016ab3-14c4-4c33-bd50-468f71339cd7" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:20:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.034s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:20:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:20:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:20:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:20:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f6ec2887-f19e-4574-9049-97954c7e81c3 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:20:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f6ec2887-f19e-4574-9049-97954c7e81c3 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:20:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f6ec2887-f19e-4574-9049-97954c7e81c3 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:20:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f6ec2887-f19e-4574-9049-97954c7e81c3 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:20:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f6ec2887-f19e-4574-9049-97954c7e81c3 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:20:44 user nova-compute[74342]: INFO nova.compute.manager [None req-f6ec2887-f19e-4574-9049-97954c7e81c3 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Terminating instance
Oct 16 10:20:44 user nova-compute[74342]: DEBUG nova.compute.manager [None req-f6ec2887-f19e-4574-9049-97954c7e81c3 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 10:20:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:44 user nova-compute[74342]: DEBUG nova.compute.manager [req-b666a5af-28a4-49b4-97ae-0407c0a645a1 req-3a33503f-9dfb-45ec-8bc7-eb8e3fbc8aa2 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received event network-vif-unplugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:20:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b666a5af-28a4-49b4-97ae-0407c0a645a1 req-3a33503f-9dfb-45ec-8bc7-eb8e3fbc8aa2 service nova] Acquiring lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:20:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b666a5af-28a4-49b4-97ae-0407c0a645a1 req-3a33503f-9dfb-45ec-8bc7-eb8e3fbc8aa2 service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:20:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b666a5af-28a4-49b4-97ae-0407c0a645a1 req-3a33503f-9dfb-45ec-8bc7-eb8e3fbc8aa2 service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:20:44 user nova-compute[74342]: DEBUG nova.compute.manager [req-b666a5af-28a4-49b4-97ae-0407c0a645a1 req-3a33503f-9dfb-45ec-8bc7-eb8e3fbc8aa2 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] No waiting events found dispatching network-vif-unplugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:20:44 user nova-compute[74342]: DEBUG nova.compute.manager [req-b666a5af-28a4-49b4-97ae-0407c0a645a1 req-3a33503f-9dfb-45ec-8bc7-eb8e3fbc8aa2 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received event network-vif-unplugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 10:20:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:45 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Instance destroyed successfully.
Oct 16 10:20:45 user nova-compute[74342]: DEBUG nova.objects.instance [None req-f6ec2887-f19e-4574-9049-97954c7e81c3 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lazy-loading 'resources' on Instance uuid fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:20:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:45 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-f6ec2887-f19e-4574-9049-97954c7e81c3 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:14:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-106833737',display_name='tempest-ServerRescueNegativeTestJSON-server-106833737',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-106833737',id=46,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHHwkB8B6xn1DLu5yc81DqKdns/QpqRd7Maa0OvHjHefs7SZk/XPhJ/VHDNwT5fWZndqBU/wq/L/2jGTcPWdzvUbeOGibIDnqir40C/LOzf0p8Lmes8291YTIWvjKyGHeg==',key_name='tempest-keypair-409457646',keypairs=<?>,launch_index=0,launched_at=2023-10-16T10:16:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2453f549532c465da8952474a5218357',ramdisk_id='',reservation_id='r-zlhwfjx4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1027819060',owner_user_name='tempest-ServerRescueNegativeTestJSON-1027819060-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T10:18:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2ca9ac24fcad4d9fbf8cb2fd7ec6a3f0',uuid=fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "address": "fa:16:3e:48:08:65", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aba45fe-36", "ovs_interfaceid": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 10:20:45 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-f6ec2887-f19e-4574-9049-97954c7e81c3 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Converting VIF {"id": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "address": "fa:16:3e:48:08:65", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.194", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0aba45fe-36", "ovs_interfaceid": "0aba45fe-3675-4a86-ac2d-9eac3af1ecc6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:20:45 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-f6ec2887-f19e-4574-9049-97954c7e81c3 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:08:65,bridge_name='br-int',has_traffic_filtering=True,id=0aba45fe-3675-4a86-ac2d-9eac3af1ecc6,network=Network(c8edc360-319a-4e77-8af6-5b8e7a87ae82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aba45fe-36') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:20:45 user nova-compute[74342]: DEBUG os_vif [None req-f6ec2887-f19e-4574-9049-97954c7e81c3 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:08:65,bridge_name='br-int',has_traffic_filtering=True,id=0aba45fe-3675-4a86-ac2d-9eac3af1ecc6,network=Network(c8edc360-319a-4e77-8af6-5b8e7a87ae82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aba45fe-36') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 10:20:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0aba45fe-36, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:20:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:20:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=72785f68-791d-44a7-ae4d-265d2b289217) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:20:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:45 user nova-compute[74342]: INFO os_vif [None req-f6ec2887-f19e-4574-9049-97954c7e81c3 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:08:65,bridge_name='br-int',has_traffic_filtering=True,id=0aba45fe-3675-4a86-ac2d-9eac3af1ecc6,network=Network(c8edc360-319a-4e77-8af6-5b8e7a87ae82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0aba45fe-36')
Oct 16 10:20:45 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-f6ec2887-f19e-4574-9049-97954c7e81c3 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Deleting instance files /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9_del
Oct 16 10:20:45 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-f6ec2887-f19e-4574-9049-97954c7e81c3 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Deletion of /opt/stack/data/nova/instances/fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9_del complete
Oct 16 10:20:45 user nova-compute[74342]: INFO nova.compute.manager [None req-f6ec2887-f19e-4574-9049-97954c7e81c3 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Took 0.90 seconds to destroy the instance on the hypervisor.
Oct 16 10:20:45 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-f6ec2887-f19e-4574-9049-97954c7e81c3 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 10:20:45 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 10:20:45 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 10:20:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:45 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:46 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:20:46 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Took 0.75 seconds to deallocate network for instance.
Oct 16 10:20:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f6ec2887-f19e-4574-9049-97954c7e81c3 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:20:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f6ec2887-f19e-4574-9049-97954c7e81c3 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:20:46 user nova-compute[74342]: DEBUG nova.compute.manager [req-dc254d4c-95ee-4221-8561-652388a67928 req-a011187f-2f11-4dc6-9b46-41982648a85e service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received event network-vif-deleted-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:20:46 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-f6ec2887-f19e-4574-9049-97954c7e81c3 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:20:46 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-f6ec2887-f19e-4574-9049-97954c7e81c3 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:20:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f6ec2887-f19e-4574-9049-97954c7e81c3 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.223s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:20:46 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-f6ec2887-f19e-4574-9049-97954c7e81c3 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Deleted allocations for instance fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9
Oct 16 10:20:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-f6ec2887-f19e-4574-9049-97954c7e81c3 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.093s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:20:46 user nova-compute[74342]: DEBUG nova.compute.manager [req-f1ab60fd-281f-4ce3-a5d7-fe0be62d2e3d req-f837fe7b-45b9-4ad0-9a06-aa604d6d72d3 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received event network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:20:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f1ab60fd-281f-4ce3-a5d7-fe0be62d2e3d req-f837fe7b-45b9-4ad0-9a06-aa604d6d72d3 service nova] Acquiring lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:20:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f1ab60fd-281f-4ce3-a5d7-fe0be62d2e3d req-f837fe7b-45b9-4ad0-9a06-aa604d6d72d3 service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:20:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f1ab60fd-281f-4ce3-a5d7-fe0be62d2e3d req-f837fe7b-45b9-4ad0-9a06-aa604d6d72d3 service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:20:46 user nova-compute[74342]: DEBUG nova.compute.manager [req-f1ab60fd-281f-4ce3-a5d7-fe0be62d2e3d req-f837fe7b-45b9-4ad0-9a06-aa604d6d72d3 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] No waiting events found dispatching network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:20:46 user nova-compute[74342]: WARNING nova.compute.manager [req-f1ab60fd-281f-4ce3-a5d7-fe0be62d2e3d req-f837fe7b-45b9-4ad0-9a06-aa604d6d72d3 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received unexpected event network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 for instance with vm_state deleted and task_state None.
Oct 16 10:20:46 user nova-compute[74342]: DEBUG nova.compute.manager [req-f1ab60fd-281f-4ce3-a5d7-fe0be62d2e3d req-f837fe7b-45b9-4ad0-9a06-aa604d6d72d3 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received event network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:20:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f1ab60fd-281f-4ce3-a5d7-fe0be62d2e3d req-f837fe7b-45b9-4ad0-9a06-aa604d6d72d3 service nova] Acquiring lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:20:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f1ab60fd-281f-4ce3-a5d7-fe0be62d2e3d req-f837fe7b-45b9-4ad0-9a06-aa604d6d72d3 service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:20:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f1ab60fd-281f-4ce3-a5d7-fe0be62d2e3d req-f837fe7b-45b9-4ad0-9a06-aa604d6d72d3 service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:20:46 user nova-compute[74342]: DEBUG nova.compute.manager [req-f1ab60fd-281f-4ce3-a5d7-fe0be62d2e3d req-f837fe7b-45b9-4ad0-9a06-aa604d6d72d3 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] No waiting events found dispatching network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:20:46 user nova-compute[74342]: WARNING nova.compute.manager [req-f1ab60fd-281f-4ce3-a5d7-fe0be62d2e3d req-f837fe7b-45b9-4ad0-9a06-aa604d6d72d3 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received unexpected event network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 for instance with vm_state deleted and task_state None.
Oct 16 10:20:46 user nova-compute[74342]: DEBUG nova.compute.manager [req-f1ab60fd-281f-4ce3-a5d7-fe0be62d2e3d req-f837fe7b-45b9-4ad0-9a06-aa604d6d72d3 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received event network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:20:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f1ab60fd-281f-4ce3-a5d7-fe0be62d2e3d req-f837fe7b-45b9-4ad0-9a06-aa604d6d72d3 service nova] Acquiring lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:20:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f1ab60fd-281f-4ce3-a5d7-fe0be62d2e3d req-f837fe7b-45b9-4ad0-9a06-aa604d6d72d3 service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:20:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f1ab60fd-281f-4ce3-a5d7-fe0be62d2e3d req-f837fe7b-45b9-4ad0-9a06-aa604d6d72d3 service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:20:46 user nova-compute[74342]: DEBUG nova.compute.manager [req-f1ab60fd-281f-4ce3-a5d7-fe0be62d2e3d req-f837fe7b-45b9-4ad0-9a06-aa604d6d72d3 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] No waiting events found dispatching network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:20:46 user nova-compute[74342]: WARNING nova.compute.manager [req-f1ab60fd-281f-4ce3-a5d7-fe0be62d2e3d req-f837fe7b-45b9-4ad0-9a06-aa604d6d72d3 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received unexpected event network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 for instance with vm_state deleted and task_state None.
Oct 16 10:20:46 user nova-compute[74342]: DEBUG nova.compute.manager [req-f1ab60fd-281f-4ce3-a5d7-fe0be62d2e3d req-f837fe7b-45b9-4ad0-9a06-aa604d6d72d3 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received event network-vif-unplugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:20:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f1ab60fd-281f-4ce3-a5d7-fe0be62d2e3d req-f837fe7b-45b9-4ad0-9a06-aa604d6d72d3 service nova] Acquiring lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:20:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f1ab60fd-281f-4ce3-a5d7-fe0be62d2e3d req-f837fe7b-45b9-4ad0-9a06-aa604d6d72d3 service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:20:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f1ab60fd-281f-4ce3-a5d7-fe0be62d2e3d req-f837fe7b-45b9-4ad0-9a06-aa604d6d72d3 service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:20:46 user nova-compute[74342]: DEBUG nova.compute.manager [req-f1ab60fd-281f-4ce3-a5d7-fe0be62d2e3d req-f837fe7b-45b9-4ad0-9a06-aa604d6d72d3 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] No waiting events found dispatching network-vif-unplugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:20:46 user nova-compute[74342]: WARNING nova.compute.manager [req-f1ab60fd-281f-4ce3-a5d7-fe0be62d2e3d req-f837fe7b-45b9-4ad0-9a06-aa604d6d72d3 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received unexpected event network-vif-unplugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 for instance with vm_state deleted and task_state None.
Oct 16 10:20:46 user nova-compute[74342]: DEBUG nova.compute.manager [req-f1ab60fd-281f-4ce3-a5d7-fe0be62d2e3d req-f837fe7b-45b9-4ad0-9a06-aa604d6d72d3 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received event network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:20:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f1ab60fd-281f-4ce3-a5d7-fe0be62d2e3d req-f837fe7b-45b9-4ad0-9a06-aa604d6d72d3 service nova] Acquiring lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:20:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f1ab60fd-281f-4ce3-a5d7-fe0be62d2e3d req-f837fe7b-45b9-4ad0-9a06-aa604d6d72d3 service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:20:46 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f1ab60fd-281f-4ce3-a5d7-fe0be62d2e3d req-f837fe7b-45b9-4ad0-9a06-aa604d6d72d3 service nova] Lock "fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:20:46 user nova-compute[74342]: DEBUG nova.compute.manager [req-f1ab60fd-281f-4ce3-a5d7-fe0be62d2e3d req-f837fe7b-45b9-4ad0-9a06-aa604d6d72d3 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] No waiting events found dispatching network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:20:46 user nova-compute[74342]: WARNING nova.compute.manager [req-f1ab60fd-281f-4ce3-a5d7-fe0be62d2e3d req-f837fe7b-45b9-4ad0-9a06-aa604d6d72d3 service nova] [instance: fdc4ffff-5f4d-49f6-aaf9-1050d57c5dc9] Received unexpected event network-vif-plugged-0aba45fe-3675-4a86-ac2d-9eac3af1ecc6 for instance with vm_state deleted and task_state None.
Oct 16 10:20:50 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:20:55 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:21:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:21:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:21:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:21:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:21:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:21:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:21:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:21:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3a4f5e85-0cb2-4607-a274-b06e95c6939e tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "e5932eb4-88be-4933-8e2f-0201d9303ffc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:21:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3a4f5e85-0cb2-4607-a274-b06e95c6939e tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:21:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3a4f5e85-0cb2-4607-a274-b06e95c6939e tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "e5932eb4-88be-4933-8e2f-0201d9303ffc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:21:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3a4f5e85-0cb2-4607-a274-b06e95c6939e tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:21:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3a4f5e85-0cb2-4607-a274-b06e95c6939e tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:21:06 user nova-compute[74342]: INFO nova.compute.manager [None req-3a4f5e85-0cb2-4607-a274-b06e95c6939e tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Terminating instance
Oct 16 10:21:06 user nova-compute[74342]: DEBUG nova.compute.manager [None req-3a4f5e85-0cb2-4607-a274-b06e95c6939e tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 10:21:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:21:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:21:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:21:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:21:06 user nova-compute[74342]: DEBUG nova.compute.manager [req-a1bf16a5-413a-4e3d-b693-4e51ea68baff req-c02aff62-d84c-42bb-a8a9-a3e8c2dd784d service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Received event network-vif-unplugged-8edcd15a-87a9-43d6-9674-8a8ec38c6155 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:21:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a1bf16a5-413a-4e3d-b693-4e51ea68baff req-c02aff62-d84c-42bb-a8a9-a3e8c2dd784d service nova] Acquiring lock "e5932eb4-88be-4933-8e2f-0201d9303ffc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:21:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a1bf16a5-413a-4e3d-b693-4e51ea68baff req-c02aff62-d84c-42bb-a8a9-a3e8c2dd784d service nova] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:21:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a1bf16a5-413a-4e3d-b693-4e51ea68baff req-c02aff62-d84c-42bb-a8a9-a3e8c2dd784d service nova] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:21:06 user nova-compute[74342]: DEBUG nova.compute.manager [req-a1bf16a5-413a-4e3d-b693-4e51ea68baff req-c02aff62-d84c-42bb-a8a9-a3e8c2dd784d service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] No waiting events found dispatching network-vif-unplugged-8edcd15a-87a9-43d6-9674-8a8ec38c6155 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:21:06 user nova-compute[74342]: DEBUG nova.compute.manager [req-a1bf16a5-413a-4e3d-b693-4e51ea68baff req-c02aff62-d84c-42bb-a8a9-a3e8c2dd784d service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Received event network-vif-unplugged-8edcd15a-87a9-43d6-9674-8a8ec38c6155 for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 10:21:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:21:06 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Instance destroyed successfully.
Oct 16 10:21:06 user nova-compute[74342]: DEBUG nova.objects.instance [None req-3a4f5e85-0cb2-4607-a274-b06e95c6939e tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lazy-loading 'resources' on Instance uuid e5932eb4-88be-4933-8e2f-0201d9303ffc {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:21:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-3a4f5e85-0cb2-4607-a274-b06e95c6939e tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:15:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1480925964',display_name='tempest-TestMinimumBasicScenario-server-1480925964',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1480925964',id=47,image_ref='89e64f2a-3d34-4fea-a74f-92e55e89516d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEXXZhgHmnUAZ47mUNhjP/DiMnlMHb5+XnkQwzyGb4Ge2Imhmk9flfIoP+nvZ6DYxlWCRt0Biq7X30JLPqManXPpmNAaqN5f3CuL8UvtnY0eEgtz48VaNWN4h5HNPTP6XA==',key_name='tempest-TestMinimumBasicScenario-545706033',keypairs=<?>,launch_index=0,launched_at=2023-10-16T10:15:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d121feadb9b94fe09dd25b0d5adedb6e',ramdisk_id='',reservation_id='r-h4fn136a',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='89e64f2a-3d34-4fea-a74f-92e55e89516d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-643895215',owner_user_name='tempest-TestMinimumBasicScenario-643895215-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T10:18:22Z,user_data=None,user_id='fa5d15e5061141f798d8e0f58cae2c7f',uuid=e5932eb4-88be-4933-8e2f-0201d9303ffc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "address": "fa:16:3e:47:35:4d", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edcd15a-87", "ovs_interfaceid": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 10:21:06 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-3a4f5e85-0cb2-4607-a274-b06e95c6939e tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Converting VIF {"id": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "address": "fa:16:3e:47:35:4d", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8edcd15a-87", "ovs_interfaceid": "8edcd15a-87a9-43d6-9674-8a8ec38c6155", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:21:06 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-3a4f5e85-0cb2-4607-a274-b06e95c6939e tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:47:35:4d,bridge_name='br-int',has_traffic_filtering=True,id=8edcd15a-87a9-43d6-9674-8a8ec38c6155,network=Network(9adc3611-05c0-400f-99d4-a61f2c9e74d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8edcd15a-87') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:21:06 user nova-compute[74342]: DEBUG os_vif [None req-3a4f5e85-0cb2-4607-a274-b06e95c6939e tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:35:4d,bridge_name='br-int',has_traffic_filtering=True,id=8edcd15a-87a9-43d6-9674-8a8ec38c6155,network=Network(9adc3611-05c0-400f-99d4-a61f2c9e74d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8edcd15a-87') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 10:21:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:21:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8edcd15a-87, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:21:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:21:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:21:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:21:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=715b83c0-0487-4a09-8afc-bd18f5f011c8) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:21:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:21:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:21:06 user nova-compute[74342]: INFO os_vif [None req-3a4f5e85-0cb2-4607-a274-b06e95c6939e tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:47:35:4d,bridge_name='br-int',has_traffic_filtering=True,id=8edcd15a-87a9-43d6-9674-8a8ec38c6155,network=Network(9adc3611-05c0-400f-99d4-a61f2c9e74d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8edcd15a-87')
Oct 16 10:21:06 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-3a4f5e85-0cb2-4607-a274-b06e95c6939e tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Deleting instance files /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc_del
Oct 16 10:21:06 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-3a4f5e85-0cb2-4607-a274-b06e95c6939e tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Deletion of /opt/stack/data/nova/instances/e5932eb4-88be-4933-8e2f-0201d9303ffc_del complete
Oct 16 10:21:07 user nova-compute[74342]: INFO nova.compute.manager [None req-3a4f5e85-0cb2-4607-a274-b06e95c6939e tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 16 10:21:07 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-3a4f5e85-0cb2-4607-a274-b06e95c6939e tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 10:21:07 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 10:21:07 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 10:21:07 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:21:07 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Took 0.43 seconds to deallocate network for instance.
Oct 16 10:21:07 user nova-compute[74342]: DEBUG nova.compute.manager [req-1519cf2c-e028-4c41-8245-6d6bfe98dd2c req-a882c843-2639-4abb-b21c-61d1cf65b093 service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Received event network-vif-deleted-8edcd15a-87a9-43d6-9674-8a8ec38c6155 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:21:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3a4f5e85-0cb2-4607-a274-b06e95c6939e tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:21:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3a4f5e85-0cb2-4607-a274-b06e95c6939e tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:21:07 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-3a4f5e85-0cb2-4607-a274-b06e95c6939e tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:21:07 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-3a4f5e85-0cb2-4607-a274-b06e95c6939e tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:21:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3a4f5e85-0cb2-4607-a274-b06e95c6939e tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.179s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:21:07 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-3a4f5e85-0cb2-4607-a274-b06e95c6939e tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Deleted allocations for instance e5932eb4-88be-4933-8e2f-0201d9303ffc
Oct 16 10:21:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3a4f5e85-0cb2-4607-a274-b06e95c6939e tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.642s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:21:08 user nova-compute[74342]: DEBUG nova.compute.manager [req-feb2efbb-5cd4-48d2-92d7-41bb3a6c25db req-87a6eb3c-3f47-4428-be5c-479dc1e351bd service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Received event network-vif-plugged-8edcd15a-87a9-43d6-9674-8a8ec38c6155 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:21:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-feb2efbb-5cd4-48d2-92d7-41bb3a6c25db req-87a6eb3c-3f47-4428-be5c-479dc1e351bd service nova] Acquiring lock "e5932eb4-88be-4933-8e2f-0201d9303ffc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:21:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-feb2efbb-5cd4-48d2-92d7-41bb3a6c25db req-87a6eb3c-3f47-4428-be5c-479dc1e351bd service nova] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:21:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-feb2efbb-5cd4-48d2-92d7-41bb3a6c25db req-87a6eb3c-3f47-4428-be5c-479dc1e351bd service nova] Lock "e5932eb4-88be-4933-8e2f-0201d9303ffc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:21:08 user nova-compute[74342]: DEBUG nova.compute.manager [req-feb2efbb-5cd4-48d2-92d7-41bb3a6c25db req-87a6eb3c-3f47-4428-be5c-479dc1e351bd service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] No waiting events found dispatching network-vif-plugged-8edcd15a-87a9-43d6-9674-8a8ec38c6155 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:21:08 user nova-compute[74342]: WARNING nova.compute.manager [req-feb2efbb-5cd4-48d2-92d7-41bb3a6c25db req-87a6eb3c-3f47-4428-be5c-479dc1e351bd service nova] [instance: e5932eb4-88be-4933-8e2f-0201d9303ffc] Received unexpected event network-vif-plugged-8edcd15a-87a9-43d6-9674-8a8ec38c6155 for instance with vm_state deleted and task_state None.
Oct 16 10:21:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:21:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:21:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:21:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:21:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:21:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:21:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:21:17 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:21:21 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:21:21 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:21:21 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Rebuilding the list of instances to heal {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 10:21:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-34ef7d18-0724-479a-8448-981b9cf0d6ab" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:21:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-34ef7d18-0724-479a-8448-981b9cf0d6ab" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:21:21 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:21:21 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lazy-loading 'info_cache' on Instance uuid 34ef7d18-0724-479a-8448-981b9cf0d6ab {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:21:21 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Updating instance_info_cache with network_info: [{"id": "1495980a-a474-4a07-a8d1-27521ae89be7", "address": "fa:16:3e:0e:3e:44", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1495980a-a4", "ovs_interfaceid": "1495980a-a474-4a07-a8d1-27521ae89be7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:21:21 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-34ef7d18-0724-479a-8448-981b9cf0d6ab" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:21:21 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:21:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:21:22 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:21:23 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:21:23 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:21:23 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:21:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:21:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:21:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:21:23 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:21:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:21:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:21:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:21:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:21:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:21:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:21:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:21:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:21:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:21:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:21:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:21:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:21:25 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:21:25 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:21:25 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8924MB free_disk=24.95394515991211GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:21:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:21:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:21:25 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 34ef7d18-0724-479a-8448-981b9cf0d6ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:21:25 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7d016ab3-14c4-4c33-bd50-468f71339cd7 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:21:25 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:21:25 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:21:25 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Refreshing inventories for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 10:21:25 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Updating ProviderTree inventory for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 10:21:25 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Updating inventory in ProviderTree for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 10:21:25 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Refreshing aggregate associations for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca, aggregates: None {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 10:21:25 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Refreshing trait associations for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 10:21:25 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:21:25 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:21:25 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:21:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.494s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:21:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:21:27 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:21:27 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:21:29 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:21:29 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:21:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:21:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:21:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:21:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:21:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:21:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:21:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:21:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:21:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:21:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:21:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0b095623-727f-44fb-9f41-2303a1fba66c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "7d016ab3-14c4-4c33-bd50-468f71339cd7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:21:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0b095623-727f-44fb-9f41-2303a1fba66c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "7d016ab3-14c4-4c33-bd50-468f71339cd7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:21:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0b095623-727f-44fb-9f41-2303a1fba66c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "7d016ab3-14c4-4c33-bd50-468f71339cd7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:21:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0b095623-727f-44fb-9f41-2303a1fba66c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "7d016ab3-14c4-4c33-bd50-468f71339cd7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:21:52 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0b095623-727f-44fb-9f41-2303a1fba66c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "7d016ab3-14c4-4c33-bd50-468f71339cd7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:21:52 user nova-compute[74342]: INFO nova.compute.manager [None req-0b095623-727f-44fb-9f41-2303a1fba66c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Terminating instance
Oct 16 10:21:52 user nova-compute[74342]: DEBUG nova.compute.manager [None req-0b095623-727f-44fb-9f41-2303a1fba66c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 10:21:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:21:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:21:53 user nova-compute[74342]: DEBUG nova.compute.manager [req-ff9192a0-76d2-44b4-ad0e-6da7f8b22c04 req-42505083-f8bc-46ce-8ab0-bc5c098e8312 service nova] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Received event network-vif-unplugged-a74fa1b3-860c-44de-bc9d-207dc8ec9982 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:21:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ff9192a0-76d2-44b4-ad0e-6da7f8b22c04 req-42505083-f8bc-46ce-8ab0-bc5c098e8312 service nova] Acquiring lock "7d016ab3-14c4-4c33-bd50-468f71339cd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:21:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ff9192a0-76d2-44b4-ad0e-6da7f8b22c04 req-42505083-f8bc-46ce-8ab0-bc5c098e8312 service nova] Lock "7d016ab3-14c4-4c33-bd50-468f71339cd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:21:53 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ff9192a0-76d2-44b4-ad0e-6da7f8b22c04 req-42505083-f8bc-46ce-8ab0-bc5c098e8312 service nova] Lock "7d016ab3-14c4-4c33-bd50-468f71339cd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:21:53 user nova-compute[74342]: DEBUG nova.compute.manager [req-ff9192a0-76d2-44b4-ad0e-6da7f8b22c04 req-42505083-f8bc-46ce-8ab0-bc5c098e8312 service nova] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] No waiting events found dispatching network-vif-unplugged-a74fa1b3-860c-44de-bc9d-207dc8ec9982 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:21:53 user nova-compute[74342]: DEBUG nova.compute.manager [req-ff9192a0-76d2-44b4-ad0e-6da7f8b22c04 req-42505083-f8bc-46ce-8ab0-bc5c098e8312 service nova] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Received event network-vif-unplugged-a74fa1b3-860c-44de-bc9d-207dc8ec9982 for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 10:21:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:21:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:21:53 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Instance destroyed successfully.
Oct 16 10:21:53 user nova-compute[74342]: DEBUG nova.objects.instance [None req-0b095623-727f-44fb-9f41-2303a1fba66c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lazy-loading 'resources' on Instance uuid 7d016ab3-14c4-4c33-bd50-468f71339cd7 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:21:53 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-0b095623-727f-44fb-9f41-2303a1fba66c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:05:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-360954549',display_name='tempest-ServerRescueNegativeTestJSON-server-360954549',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-360954549',id=39,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T10:07:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2453f549532c465da8952474a5218357',ramdisk_id='',reservation_id='r-pmlvt0py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1027819060',owner_user_name='tempest-ServerRescueNegativeTestJSON-1027819060-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T10:07:19Z,user_data=None,user_id='2ca9ac24fcad4d9fbf8cb2fd7ec6a3f0',uuid=7d016ab3-14c4-4c33-bd50-468f71339cd7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "address": "fa:16:3e:de:cb:e3", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74fa1b3-86", "ovs_interfaceid": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 10:21:53 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-0b095623-727f-44fb-9f41-2303a1fba66c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Converting VIF {"id": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "address": "fa:16:3e:de:cb:e3", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa74fa1b3-86", "ovs_interfaceid": "a74fa1b3-860c-44de-bc9d-207dc8ec9982", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:21:53 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-0b095623-727f-44fb-9f41-2303a1fba66c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:cb:e3,bridge_name='br-int',has_traffic_filtering=True,id=a74fa1b3-860c-44de-bc9d-207dc8ec9982,network=Network(c8edc360-319a-4e77-8af6-5b8e7a87ae82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa74fa1b3-86') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:21:53 user nova-compute[74342]: DEBUG os_vif [None req-0b095623-727f-44fb-9f41-2303a1fba66c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:cb:e3,bridge_name='br-int',has_traffic_filtering=True,id=a74fa1b3-860c-44de-bc9d-207dc8ec9982,network=Network(c8edc360-319a-4e77-8af6-5b8e7a87ae82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa74fa1b3-86') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 10:21:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:21:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa74fa1b3-86, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:21:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:21:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:21:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:21:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bcedd05a-2593-46cc-b846-f8a4eab2fba6) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:21:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:21:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:21:53 user nova-compute[74342]: INFO os_vif [None req-0b095623-727f-44fb-9f41-2303a1fba66c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:cb:e3,bridge_name='br-int',has_traffic_filtering=True,id=a74fa1b3-860c-44de-bc9d-207dc8ec9982,network=Network(c8edc360-319a-4e77-8af6-5b8e7a87ae82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa74fa1b3-86')
Oct 16 10:21:53 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-0b095623-727f-44fb-9f41-2303a1fba66c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Deleting instance files /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7_del
Oct 16 10:21:53 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-0b095623-727f-44fb-9f41-2303a1fba66c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Deletion of /opt/stack/data/nova/instances/7d016ab3-14c4-4c33-bd50-468f71339cd7_del complete
Oct 16 10:21:53 user nova-compute[74342]: INFO nova.compute.manager [None req-0b095623-727f-44fb-9f41-2303a1fba66c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Took 0.70 seconds to destroy the instance on the hypervisor.
Oct 16 10:21:53 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-0b095623-727f-44fb-9f41-2303a1fba66c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 10:21:53 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 10:21:53 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 10:21:54 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:21:54 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Took 0.39 seconds to deallocate network for instance.
Oct 16 10:21:54 user nova-compute[74342]: DEBUG nova.compute.manager [req-6d9e3966-cf47-4239-aea9-d5ec5f6721eb req-b1a5f735-8ca4-46d0-a8fc-153c1ee1fc9f service nova] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Received event network-vif-deleted-a74fa1b3-860c-44de-bc9d-207dc8ec9982 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:21:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0b095623-727f-44fb-9f41-2303a1fba66c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:21:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0b095623-727f-44fb-9f41-2303a1fba66c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:21:54 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-0b095623-727f-44fb-9f41-2303a1fba66c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:21:54 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-0b095623-727f-44fb-9f41-2303a1fba66c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:21:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0b095623-727f-44fb-9f41-2303a1fba66c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.138s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:21:54 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-0b095623-727f-44fb-9f41-2303a1fba66c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Deleted allocations for instance 7d016ab3-14c4-4c33-bd50-468f71339cd7
Oct 16 10:21:54 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-0b095623-727f-44fb-9f41-2303a1fba66c tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "7d016ab3-14c4-4c33-bd50-468f71339cd7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.411s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:21:55 user nova-compute[74342]: DEBUG nova.compute.manager [req-27ccc727-788d-4e0d-9bd3-5671669f8ee7 req-23ad6890-1c9d-41b0-aa67-de4b87e5d955 service nova] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Received event network-vif-plugged-a74fa1b3-860c-44de-bc9d-207dc8ec9982 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:21:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-27ccc727-788d-4e0d-9bd3-5671669f8ee7 req-23ad6890-1c9d-41b0-aa67-de4b87e5d955 service nova] Acquiring lock "7d016ab3-14c4-4c33-bd50-468f71339cd7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:21:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-27ccc727-788d-4e0d-9bd3-5671669f8ee7 req-23ad6890-1c9d-41b0-aa67-de4b87e5d955 service nova] Lock "7d016ab3-14c4-4c33-bd50-468f71339cd7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:21:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-27ccc727-788d-4e0d-9bd3-5671669f8ee7 req-23ad6890-1c9d-41b0-aa67-de4b87e5d955 service nova] Lock "7d016ab3-14c4-4c33-bd50-468f71339cd7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:21:55 user nova-compute[74342]: DEBUG nova.compute.manager [req-27ccc727-788d-4e0d-9bd3-5671669f8ee7 req-23ad6890-1c9d-41b0-aa67-de4b87e5d955 service nova] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] No waiting events found dispatching network-vif-plugged-a74fa1b3-860c-44de-bc9d-207dc8ec9982 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:21:55 user nova-compute[74342]: WARNING nova.compute.manager [req-27ccc727-788d-4e0d-9bd3-5671669f8ee7 req-23ad6890-1c9d-41b0-aa67-de4b87e5d955 service nova] [instance: 7d016ab3-14c4-4c33-bd50-468f71339cd7] Received unexpected event network-vif-plugged-a74fa1b3-860c-44de-bc9d-207dc8ec9982 for instance with vm_state deleted and task_state None.
Oct 16 10:21:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:22:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:22:00 user nova-compute[74342]: DEBUG nova.compute.manager [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 10:22:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:22:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:22:00 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 10:22:00 user nova-compute[74342]: INFO nova.compute.claims [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Claim successful on node user
Oct 16 10:22:00 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:22:00 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:22:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.205s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:22:00 user nova-compute[74342]: DEBUG nova.compute.manager [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 10:22:00 user nova-compute[74342]: DEBUG nova.compute.manager [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 10:22:00 user nova-compute[74342]: DEBUG nova.network.neutron [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 10:22:00 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 10:22:00 user nova-compute[74342]: DEBUG nova.compute.manager [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 10:22:00 user nova-compute[74342]: DEBUG nova.policy [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fa5d15e5061141f798d8e0f58cae2c7f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd121feadb9b94fe09dd25b0d5adedb6e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 10:22:01 user nova-compute[74342]: DEBUG nova.compute.manager [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 10:22:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 10:22:01 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Creating image(s)
Oct 16 10:22:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "/opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:22:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "/opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:22:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "/opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:22:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "c29fd271168c238075686b253d5da47d3c4af284" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:22:01 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "c29fd271168c238075686b253d5da47d3c4af284" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:22:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c29fd271168c238075686b253d5da47d3c4af284.part --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:22:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c29fd271168c238075686b253d5da47d3c4af284.part --force-share --output=json" returned: 0 in 0.190s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:22:01 user nova-compute[74342]: DEBUG nova.virt.images [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] 598f3b39-2a87-414f-ae51-be0203ba0420 was qcow2, converting to raw {{(pid=74342) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Oct 16 10:22:01 user nova-compute[74342]: DEBUG nova.privsep.utils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=74342) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Oct 16 10:22:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c29fd271168c238075686b253d5da47d3c4af284.part /opt/stack/data/nova/instances/_base/c29fd271168c238075686b253d5da47d3c4af284.converted {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:22:01 user nova-compute[74342]: DEBUG nova.network.neutron [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Successfully created port: d1d303d0-dc4b-40a7-a24c-ff98556e0968 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 10:22:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/c29fd271168c238075686b253d5da47d3c4af284.part /opt/stack/data/nova/instances/_base/c29fd271168c238075686b253d5da47d3c4af284.converted" returned: 0 in 0.598s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:22:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c29fd271168c238075686b253d5da47d3c4af284.converted --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:22:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c29fd271168c238075686b253d5da47d3c4af284.converted --force-share --output=json" returned: 0 in 0.226s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:22:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "c29fd271168c238075686b253d5da47d3c4af284" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.455s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:22:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c29fd271168c238075686b253d5da47d3c4af284 --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:22:02 user nova-compute[74342]: DEBUG nova.network.neutron [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Successfully updated port: d1d303d0-dc4b-40a7-a24c-ff98556e0968 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 10:22:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-95a1278b-6043-4dfd-95e5-78756ba26635 req-9228125a-0fab-481d-8ba2-f10e0622dfde service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Received event network-changed-d1d303d0-dc4b-40a7-a24c-ff98556e0968 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:22:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-95a1278b-6043-4dfd-95e5-78756ba26635 req-9228125a-0fab-481d-8ba2-f10e0622dfde service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Refreshing instance network info cache due to event network-changed-d1d303d0-dc4b-40a7-a24c-ff98556e0968. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:22:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-95a1278b-6043-4dfd-95e5-78756ba26635 req-9228125a-0fab-481d-8ba2-f10e0622dfde service nova] Acquiring lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:22:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-95a1278b-6043-4dfd-95e5-78756ba26635 req-9228125a-0fab-481d-8ba2-f10e0622dfde service nova] Acquired lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:22:02 user nova-compute[74342]: DEBUG nova.network.neutron [req-95a1278b-6043-4dfd-95e5-78756ba26635 req-9228125a-0fab-481d-8ba2-f10e0622dfde service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Refreshing network info cache for port d1d303d0-dc4b-40a7-a24c-ff98556e0968 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:22:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:22:02 user nova-compute[74342]: DEBUG nova.network.neutron [req-95a1278b-6043-4dfd-95e5-78756ba26635 req-9228125a-0fab-481d-8ba2-f10e0622dfde service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 10:22:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c29fd271168c238075686b253d5da47d3c4af284 --force-share --output=json" returned: 0 in 0.245s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:22:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "c29fd271168c238075686b253d5da47d3c4af284" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:22:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "c29fd271168c238075686b253d5da47d3c4af284" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:22:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c29fd271168c238075686b253d5da47d3c4af284 --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:22:02 user nova-compute[74342]: DEBUG nova.network.neutron [req-95a1278b-6043-4dfd-95e5-78756ba26635 req-9228125a-0fab-481d-8ba2-f10e0622dfde service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:22:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-95a1278b-6043-4dfd-95e5-78756ba26635 req-9228125a-0fab-481d-8ba2-f10e0622dfde service nova] Releasing lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:22:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquired lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:22:02 user nova-compute[74342]: DEBUG nova.network.neutron [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:22:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c29fd271168c238075686b253d5da47d3c4af284 --force-share --output=json" returned: 0 in 0.189s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:22:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c29fd271168c238075686b253d5da47d3c4af284,backing_fmt=raw /opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:22:02 user nova-compute[74342]: DEBUG nova.network.neutron [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 10:22:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/c29fd271168c238075686b253d5da47d3c4af284,backing_fmt=raw /opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/disk 1073741824" returned: 0 in 0.054s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:22:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "c29fd271168c238075686b253d5da47d3c4af284" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:22:02 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c29fd271168c238075686b253d5da47d3c4af284 --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/c29fd271168c238075686b253d5da47d3c4af284 --force-share --output=json" returned: 0 in 0.201s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Checking if we can resize image /opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.network.neutron [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Updating instance_info_cache with network_info: [{"id": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "address": "fa:16:3e:b4:90:54", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d303d0-dc", "ovs_interfaceid": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Releasing lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.compute.manager [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Instance network_info: |[{"id": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "address": "fa:16:3e:b4:90:54", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d303d0-dc", "ovs_interfaceid": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Cannot resize image /opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Ensure instance console log exists: /opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Start _get_guest_xml network_info=[{"id": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "address": "fa:16:3e:b4:90:54", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d303d0-dc", "ovs_interfaceid": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T10:21:57Z,direct_url=<?>,disk_format='qcow2',id=598f3b39-2a87-414f-ae51-be0203ba0420,min_disk=0,min_ram=0,name='tempest-scenario-img--1754315621',owner='d121feadb9b94fe09dd25b0d5adedb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T10:21:59Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '598f3b39-2a87-414f-ae51-be0203ba0420'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 10:22:03 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:22:03 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T10:21:57Z,direct_url=<?>,disk_format='qcow2',id=598f3b39-2a87-414f-ae51-be0203ba0420,min_disk=0,min_ram=0,name='tempest-scenario-img--1754315621',owner='d121feadb9b94fe09dd25b0d5adedb6e',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T10:21:59Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:21:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2114161969',display_name='tempest-TestMinimumBasicScenario-server-2114161969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2114161969',id=48,image_ref='598f3b39-2a87-414f-ae51-be0203ba0420',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMLdVxHP9DQfGaf7l/F8b8j9svdVOwmmAM8tfncm+EqiAdBPX+jagLOONOGBIGtSXa+sDo5cOBPScGB+C+nkbdpfnEZIvfsVoFBswcYmsVNB8Cc8vvALqnrxjgG7Gfldg==',key_name='tempest-TestMinimumBasicScenario-634640765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d121feadb9b94fe09dd25b0d5adedb6e',ramdisk_id='',reservation_id='r-a9w1z4fr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='598f3b39-2a87-414f-ae51-be0203ba0420',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-643895215',owner_user_name='tempest-TestMinimumBasicScenario-643895215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:22:01Z,user_data=None,user_id='fa5d15e5061141f798d8e0f58cae2c7f',uuid=654c5596-c318-4ae5-9fc3-cb9c89b9edcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "address": "fa:16:3e:b4:90:54", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d303d0-dc", "ovs_interfaceid": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Converting VIF {"id": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "address": "fa:16:3e:b4:90:54", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d303d0-dc", "ovs_interfaceid": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:90:54,bridge_name='br-int',has_traffic_filtering=True,id=d1d303d0-dc4b-40a7-a24c-ff98556e0968,network=Network(9adc3611-05c0-400f-99d4-a61f2c9e74d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d303d0-dc') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.objects.instance [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lazy-loading 'pci_devices' on Instance uuid 654c5596-c318-4ae5-9fc3-cb9c89b9edcc {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] End _get_guest_xml xml=<domain type="kvm">
Oct 16 10:22:03 user nova-compute[74342]:   <uuid>654c5596-c318-4ae5-9fc3-cb9c89b9edcc</uuid>
Oct 16 10:22:03 user nova-compute[74342]:   <name>instance-00000030</name>
Oct 16 10:22:03 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 10:22:03 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 10:22:03 user nova-compute[74342]:   <metadata>
Oct 16 10:22:03 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 10:22:03 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 10:22:03 user nova-compute[74342]:       <nova:name>tempest-TestMinimumBasicScenario-server-2114161969</nova:name>
Oct 16 10:22:03 user nova-compute[74342]:       <nova:creationTime>2023-10-16 10:22:03</nova:creationTime>
Oct 16 10:22:03 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 10:22:03 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 10:22:03 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 10:22:03 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 10:22:03 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 10:22:03 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 10:22:03 user nova-compute[74342]:       </nova:flavor>
Oct 16 10:22:03 user nova-compute[74342]:       <nova:owner>
Oct 16 10:22:03 user nova-compute[74342]:         <nova:user uuid="fa5d15e5061141f798d8e0f58cae2c7f">tempest-TestMinimumBasicScenario-643895215-project-member</nova:user>
Oct 16 10:22:03 user nova-compute[74342]:         <nova:project uuid="d121feadb9b94fe09dd25b0d5adedb6e">tempest-TestMinimumBasicScenario-643895215</nova:project>
Oct 16 10:22:03 user nova-compute[74342]:       </nova:owner>
Oct 16 10:22:03 user nova-compute[74342]:       <nova:root type="image" uuid="598f3b39-2a87-414f-ae51-be0203ba0420"/>
Oct 16 10:22:03 user nova-compute[74342]:       <nova:ports>
Oct 16 10:22:03 user nova-compute[74342]:         <nova:port uuid="d1d303d0-dc4b-40a7-a24c-ff98556e0968">
Oct 16 10:22:03 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Oct 16 10:22:03 user nova-compute[74342]:         </nova:port>
Oct 16 10:22:03 user nova-compute[74342]:       </nova:ports>
Oct 16 10:22:03 user nova-compute[74342]:     </nova:instance>
Oct 16 10:22:03 user nova-compute[74342]:   </metadata>
Oct 16 10:22:03 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 10:22:03 user nova-compute[74342]:     <system>
Oct 16 10:22:03 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 10:22:03 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 10:22:03 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 10:22:03 user nova-compute[74342]:       <entry name="serial">654c5596-c318-4ae5-9fc3-cb9c89b9edcc</entry>
Oct 16 10:22:03 user nova-compute[74342]:       <entry name="uuid">654c5596-c318-4ae5-9fc3-cb9c89b9edcc</entry>
Oct 16 10:22:03 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 10:22:03 user nova-compute[74342]:     </system>
Oct 16 10:22:03 user nova-compute[74342]:   </sysinfo>
Oct 16 10:22:03 user nova-compute[74342]:   <os>
Oct 16 10:22:03 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 10:22:03 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 10:22:03 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 10:22:03 user nova-compute[74342]:   </os>
Oct 16 10:22:03 user nova-compute[74342]:   <features>
Oct 16 10:22:03 user nova-compute[74342]:     <acpi/>
Oct 16 10:22:03 user nova-compute[74342]:     <apic/>
Oct 16 10:22:03 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 10:22:03 user nova-compute[74342]:   </features>
Oct 16 10:22:03 user nova-compute[74342]:   <clock offset="utc">
Oct 16 10:22:03 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 10:22:03 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 10:22:03 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 10:22:03 user nova-compute[74342]:   </clock>
Oct 16 10:22:03 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 10:22:03 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 10:22:03 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 10:22:03 user nova-compute[74342]:   </cpu>
Oct 16 10:22:03 user nova-compute[74342]:   <devices>
Oct 16 10:22:03 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 10:22:03 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 10:22:03 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/disk"/>
Oct 16 10:22:03 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 10:22:03 user nova-compute[74342]:     </disk>
Oct 16 10:22:03 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 10:22:03 user nova-compute[74342]:       <mac address="fa:16:3e:b4:90:54"/>
Oct 16 10:22:03 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:22:03 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 10:22:03 user nova-compute[74342]:       <target dev="tapd1d303d0-dc"/>
Oct 16 10:22:03 user nova-compute[74342]:     </interface>
Oct 16 10:22:03 user nova-compute[74342]:     <serial type="pty">
Oct 16 10:22:03 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/console.log" append="off"/>
Oct 16 10:22:03 user nova-compute[74342]:     </serial>
Oct 16 10:22:03 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 10:22:03 user nova-compute[74342]:     <video>
Oct 16 10:22:03 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:22:03 user nova-compute[74342]:     </video>
Oct 16 10:22:03 user nova-compute[74342]:     <rng model="virtio">
Oct 16 10:22:03 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 10:22:03 user nova-compute[74342]:     </rng>
Oct 16 10:22:03 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 10:22:03 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 10:22:03 user nova-compute[74342]:       <stats period="10"/>
Oct 16 10:22:03 user nova-compute[74342]:     </memballoon>
Oct 16 10:22:03 user nova-compute[74342]:   </devices>
Oct 16 10:22:03 user nova-compute[74342]: </domain>
Oct 16 10:22:03 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:21:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2114161969',display_name='tempest-TestMinimumBasicScenario-server-2114161969',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2114161969',id=48,image_ref='598f3b39-2a87-414f-ae51-be0203ba0420',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMLdVxHP9DQfGaf7l/F8b8j9svdVOwmmAM8tfncm+EqiAdBPX+jagLOONOGBIGtSXa+sDo5cOBPScGB+C+nkbdpfnEZIvfsVoFBswcYmsVNB8Cc8vvALqnrxjgG7Gfldg==',key_name='tempest-TestMinimumBasicScenario-634640765',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d121feadb9b94fe09dd25b0d5adedb6e',ramdisk_id='',reservation_id='r-a9w1z4fr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='598f3b39-2a87-414f-ae51-be0203ba0420',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-643895215',owner_user_name='tempest-TestMinimumBasicScenario-643895215-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:22:01Z,user_data=None,user_id='fa5d15e5061141f798d8e0f58cae2c7f',uuid=654c5596-c318-4ae5-9fc3-cb9c89b9edcc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "address": "fa:16:3e:b4:90:54", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d303d0-dc", "ovs_interfaceid": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Converting VIF {"id": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "address": "fa:16:3e:b4:90:54", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d303d0-dc", "ovs_interfaceid": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:90:54,bridge_name='br-int',has_traffic_filtering=True,id=d1d303d0-dc4b-40a7-a24c-ff98556e0968,network=Network(9adc3611-05c0-400f-99d4-a61f2c9e74d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d303d0-dc') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG os_vif [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:90:54,bridge_name='br-int',has_traffic_filtering=True,id=d1d303d0-dc4b-40a7-a24c-ff98556e0968,network=Network(9adc3611-05c0-400f-99d4-a61f2c9e74d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d303d0-dc') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b7808802-d758-5b10-98a3-55f195d5b1f1', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd1d303d0-dc, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd1d303d0-dc, col_values=(('qos', UUID('9dfa4af6-652d-4a53-90b9-8957cc43544b')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd1d303d0-dc, col_values=(('external_ids', {'iface-id': 'd1d303d0-dc4b-40a7-a24c-ff98556e0968', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:90:54', 'vm-uuid': '654c5596-c318-4ae5-9fc3-cb9c89b9edcc'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:03 user nova-compute[74342]: INFO os_vif [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:90:54,bridge_name='br-int',has_traffic_filtering=True,id=d1d303d0-dc4b-40a7-a24c-ff98556e0968,network=Network(9adc3611-05c0-400f-99d4-a61f2c9e74d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d303d0-dc')
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:22:03 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] No VIF found with MAC fa:16:3e:b4:90:54, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:22:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:05 user nova-compute[74342]: DEBUG nova.compute.manager [req-d088e8ad-48e5-4dca-940c-db2e2db47db8 req-dc414918-326b-400f-ba50-73e708b8c7a7 service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Received event network-vif-plugged-d1d303d0-dc4b-40a7-a24c-ff98556e0968 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:22:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d088e8ad-48e5-4dca-940c-db2e2db47db8 req-dc414918-326b-400f-ba50-73e708b8c7a7 service nova] Acquiring lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:22:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d088e8ad-48e5-4dca-940c-db2e2db47db8 req-dc414918-326b-400f-ba50-73e708b8c7a7 service nova] Lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:22:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d088e8ad-48e5-4dca-940c-db2e2db47db8 req-dc414918-326b-400f-ba50-73e708b8c7a7 service nova] Lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:22:05 user nova-compute[74342]: DEBUG nova.compute.manager [req-d088e8ad-48e5-4dca-940c-db2e2db47db8 req-dc414918-326b-400f-ba50-73e708b8c7a7 service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] No waiting events found dispatching network-vif-plugged-d1d303d0-dc4b-40a7-a24c-ff98556e0968 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:22:05 user nova-compute[74342]: WARNING nova.compute.manager [req-d088e8ad-48e5-4dca-940c-db2e2db47db8 req-dc414918-326b-400f-ba50-73e708b8c7a7 service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Received unexpected event network-vif-plugged-d1d303d0-dc4b-40a7-a24c-ff98556e0968 for instance with vm_state building and task_state spawning.
Oct 16 10:22:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:07 user nova-compute[74342]: DEBUG nova.compute.manager [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 10:22:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 10:22:07 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Instance spawned successfully.
Oct 16 10:22:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 10:22:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:22:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:22:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:22:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:22:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:22:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:22:07 user nova-compute[74342]: INFO nova.compute.manager [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Took 6.16 seconds to spawn the instance on the hypervisor.
Oct 16 10:22:07 user nova-compute[74342]: DEBUG nova.compute.manager [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:22:07 user nova-compute[74342]: INFO nova.compute.manager [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Took 6.71 seconds to build instance.
Oct 16 10:22:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3a5e5486-2339-4e98-ba06-fbaf088abc61 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.813s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:22:07 user nova-compute[74342]: DEBUG nova.compute.manager [req-d70e4b2a-6e7f-41dd-8ee4-f4b2a81cecd6 req-0e215c97-095f-4d3c-ad42-32e4419808c4 service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Received event network-vif-plugged-d1d303d0-dc4b-40a7-a24c-ff98556e0968 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:22:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d70e4b2a-6e7f-41dd-8ee4-f4b2a81cecd6 req-0e215c97-095f-4d3c-ad42-32e4419808c4 service nova] Acquiring lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:22:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d70e4b2a-6e7f-41dd-8ee4-f4b2a81cecd6 req-0e215c97-095f-4d3c-ad42-32e4419808c4 service nova] Lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:22:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d70e4b2a-6e7f-41dd-8ee4-f4b2a81cecd6 req-0e215c97-095f-4d3c-ad42-32e4419808c4 service nova] Lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:22:07 user nova-compute[74342]: DEBUG nova.compute.manager [req-d70e4b2a-6e7f-41dd-8ee4-f4b2a81cecd6 req-0e215c97-095f-4d3c-ad42-32e4419808c4 service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] No waiting events found dispatching network-vif-plugged-d1d303d0-dc4b-40a7-a24c-ff98556e0968 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:22:07 user nova-compute[74342]: WARNING nova.compute.manager [req-d70e4b2a-6e7f-41dd-8ee4-f4b2a81cecd6 req-0e215c97-095f-4d3c-ad42-32e4419808c4 service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Received unexpected event network-vif-plugged-d1d303d0-dc4b-40a7-a24c-ff98556e0968 for instance with vm_state active and task_state None.
Oct 16 10:22:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:17 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:22:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:22:23 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:22:23 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:22:23 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Didn't find any instances for network info cache update. {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 10:22:23 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:22:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:22:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:22:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:22:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:22:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:24 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:22:25 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:22:25 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:22:25 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:22:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:22:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:22:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:22:25 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:22:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:22:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:22:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:22:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:22:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:22:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:22:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:22:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:22:26 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:22:26 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:22:26 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8828MB free_disk=24.925296783447266GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:22:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:22:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:22:26 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 34ef7d18-0724-479a-8448-981b9cf0d6ab actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:22:26 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 654c5596-c318-4ae5-9fc3-cb9c89b9edcc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:22:26 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:22:26 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:22:26 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:22:26 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:22:26 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:22:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.223s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:22:27 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:22:27 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:22:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:29 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:22:29 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:22:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3c2f3fdd-6f7c-4d18-b38f-c3e36e51c1d6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "34ef7d18-0724-479a-8448-981b9cf0d6ab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:22:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3c2f3fdd-6f7c-4d18-b38f-c3e36e51c1d6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:22:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3c2f3fdd-6f7c-4d18-b38f-c3e36e51c1d6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:22:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3c2f3fdd-6f7c-4d18-b38f-c3e36e51c1d6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:22:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3c2f3fdd-6f7c-4d18-b38f-c3e36e51c1d6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:22:43 user nova-compute[74342]: INFO nova.compute.manager [None req-3c2f3fdd-6f7c-4d18-b38f-c3e36e51c1d6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Terminating instance
Oct 16 10:22:43 user nova-compute[74342]: DEBUG nova.compute.manager [None req-3c2f3fdd-6f7c-4d18-b38f-c3e36e51c1d6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 10:22:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:43 user nova-compute[74342]: DEBUG nova.compute.manager [req-0d0e2663-bc04-44a3-9717-63688c097b06 req-ec5e1b28-a282-4248-ba95-ceba88b5e317 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Received event network-vif-unplugged-1495980a-a474-4a07-a8d1-27521ae89be7 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:22:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0d0e2663-bc04-44a3-9717-63688c097b06 req-ec5e1b28-a282-4248-ba95-ceba88b5e317 service nova] Acquiring lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:22:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0d0e2663-bc04-44a3-9717-63688c097b06 req-ec5e1b28-a282-4248-ba95-ceba88b5e317 service nova] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:22:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0d0e2663-bc04-44a3-9717-63688c097b06 req-ec5e1b28-a282-4248-ba95-ceba88b5e317 service nova] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:22:43 user nova-compute[74342]: DEBUG nova.compute.manager [req-0d0e2663-bc04-44a3-9717-63688c097b06 req-ec5e1b28-a282-4248-ba95-ceba88b5e317 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] No waiting events found dispatching network-vif-unplugged-1495980a-a474-4a07-a8d1-27521ae89be7 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:22:43 user nova-compute[74342]: DEBUG nova.compute.manager [req-0d0e2663-bc04-44a3-9717-63688c097b06 req-ec5e1b28-a282-4248-ba95-ceba88b5e317 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Received event network-vif-unplugged-1495980a-a474-4a07-a8d1-27521ae89be7 for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 10:22:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:44 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Instance destroyed successfully.
Oct 16 10:22:44 user nova-compute[74342]: DEBUG nova.objects.instance [None req-3c2f3fdd-6f7c-4d18-b38f-c3e36e51c1d6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lazy-loading 'resources' on Instance uuid 34ef7d18-0724-479a-8448-981b9cf0d6ab {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:22:44 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-3c2f3fdd-6f7c-4d18-b38f-c3e36e51c1d6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:05:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2002535416',display_name='tempest-ServerRescueNegativeTestJSON-server-2002535416',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2002535416',id=38,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T10:10:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2453f549532c465da8952474a5218357',ramdisk_id='',reservation_id='r-taj2n86i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1027819060',owner_user_name='tempest-ServerRescueNegativeTestJSON-1027819060-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T10:12:08Z,user_data=None,user_id='2ca9ac24fcad4d9fbf8cb2fd7ec6a3f0',uuid=34ef7d18-0724-479a-8448-981b9cf0d6ab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1495980a-a474-4a07-a8d1-27521ae89be7", "address": "fa:16:3e:0e:3e:44", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1495980a-a4", "ovs_interfaceid": "1495980a-a474-4a07-a8d1-27521ae89be7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 10:22:44 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-3c2f3fdd-6f7c-4d18-b38f-c3e36e51c1d6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Converting VIF {"id": "1495980a-a474-4a07-a8d1-27521ae89be7", "address": "fa:16:3e:0e:3e:44", "network": {"id": "c8edc360-319a-4e77-8af6-5b8e7a87ae82", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1709460221-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2453f549532c465da8952474a5218357", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1495980a-a4", "ovs_interfaceid": "1495980a-a474-4a07-a8d1-27521ae89be7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:22:44 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-3c2f3fdd-6f7c-4d18-b38f-c3e36e51c1d6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:3e:44,bridge_name='br-int',has_traffic_filtering=True,id=1495980a-a474-4a07-a8d1-27521ae89be7,network=Network(c8edc360-319a-4e77-8af6-5b8e7a87ae82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1495980a-a4') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:22:44 user nova-compute[74342]: DEBUG os_vif [None req-3c2f3fdd-6f7c-4d18-b38f-c3e36e51c1d6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:3e:44,bridge_name='br-int',has_traffic_filtering=True,id=1495980a-a474-4a07-a8d1-27521ae89be7,network=Network(c8edc360-319a-4e77-8af6-5b8e7a87ae82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1495980a-a4') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 10:22:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1495980a-a4, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:22:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:22:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=206f1801-8aa4-45d7-9bc1-a3c4fe45fe31) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:22:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:44 user nova-compute[74342]: INFO os_vif [None req-3c2f3fdd-6f7c-4d18-b38f-c3e36e51c1d6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:3e:44,bridge_name='br-int',has_traffic_filtering=True,id=1495980a-a474-4a07-a8d1-27521ae89be7,network=Network(c8edc360-319a-4e77-8af6-5b8e7a87ae82),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1495980a-a4')
Oct 16 10:22:44 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-3c2f3fdd-6f7c-4d18-b38f-c3e36e51c1d6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Deleting instance files /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab_del
Oct 16 10:22:44 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-3c2f3fdd-6f7c-4d18-b38f-c3e36e51c1d6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Deletion of /opt/stack/data/nova/instances/34ef7d18-0724-479a-8448-981b9cf0d6ab_del complete
Oct 16 10:22:44 user nova-compute[74342]: INFO nova.compute.manager [None req-3c2f3fdd-6f7c-4d18-b38f-c3e36e51c1d6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Took 1.01 seconds to destroy the instance on the hypervisor.
Oct 16 10:22:44 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-3c2f3fdd-6f7c-4d18-b38f-c3e36e51c1d6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 10:22:44 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 10:22:44 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 10:22:44 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:22:44 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Took 0.39 seconds to deallocate network for instance.
Oct 16 10:22:44 user nova-compute[74342]: DEBUG nova.compute.manager [req-12dc0316-bda1-4e1c-9875-d52c46c9300b req-fded7ec3-a80d-429c-a925-57839862c279 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Received event network-vif-deleted-1495980a-a474-4a07-a8d1-27521ae89be7 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:22:44 user nova-compute[74342]: INFO nova.compute.manager [req-12dc0316-bda1-4e1c-9875-d52c46c9300b req-fded7ec3-a80d-429c-a925-57839862c279 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Neutron deleted interface 1495980a-a474-4a07-a8d1-27521ae89be7; detaching it from the instance and deleting it from the info cache
Oct 16 10:22:44 user nova-compute[74342]: DEBUG nova.network.neutron [req-12dc0316-bda1-4e1c-9875-d52c46c9300b req-fded7ec3-a80d-429c-a925-57839862c279 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:22:44 user nova-compute[74342]: DEBUG nova.compute.manager [req-12dc0316-bda1-4e1c-9875-d52c46c9300b req-fded7ec3-a80d-429c-a925-57839862c279 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Detach interface failed, port_id=1495980a-a474-4a07-a8d1-27521ae89be7, reason: Instance 34ef7d18-0724-479a-8448-981b9cf0d6ab could not be found. {{(pid=74342) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 10:22:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3c2f3fdd-6f7c-4d18-b38f-c3e36e51c1d6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:22:44 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3c2f3fdd-6f7c-4d18-b38f-c3e36e51c1d6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:22:44 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-3c2f3fdd-6f7c-4d18-b38f-c3e36e51c1d6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:22:44 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-3c2f3fdd-6f7c-4d18-b38f-c3e36e51c1d6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:22:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3c2f3fdd-6f7c-4d18-b38f-c3e36e51c1d6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:22:45 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-3c2f3fdd-6f7c-4d18-b38f-c3e36e51c1d6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Deleted allocations for instance 34ef7d18-0724-479a-8448-981b9cf0d6ab
Oct 16 10:22:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-3c2f3fdd-6f7c-4d18-b38f-c3e36e51c1d6 tempest-ServerRescueNegativeTestJSON-1027819060 tempest-ServerRescueNegativeTestJSON-1027819060-project-member] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.736s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:22:45 user nova-compute[74342]: DEBUG nova.compute.manager [req-727d4197-bf25-4f58-9bd0-a4eafb194ed1 req-a863a05a-5e41-47b1-a66e-048c84b01d33 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Received event network-vif-plugged-1495980a-a474-4a07-a8d1-27521ae89be7 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:22:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-727d4197-bf25-4f58-9bd0-a4eafb194ed1 req-a863a05a-5e41-47b1-a66e-048c84b01d33 service nova] Acquiring lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:22:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-727d4197-bf25-4f58-9bd0-a4eafb194ed1 req-a863a05a-5e41-47b1-a66e-048c84b01d33 service nova] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:22:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-727d4197-bf25-4f58-9bd0-a4eafb194ed1 req-a863a05a-5e41-47b1-a66e-048c84b01d33 service nova] Lock "34ef7d18-0724-479a-8448-981b9cf0d6ab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:22:45 user nova-compute[74342]: DEBUG nova.compute.manager [req-727d4197-bf25-4f58-9bd0-a4eafb194ed1 req-a863a05a-5e41-47b1-a66e-048c84b01d33 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] No waiting events found dispatching network-vif-plugged-1495980a-a474-4a07-a8d1-27521ae89be7 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:22:45 user nova-compute[74342]: WARNING nova.compute.manager [req-727d4197-bf25-4f58-9bd0-a4eafb194ed1 req-a863a05a-5e41-47b1-a66e-048c84b01d33 service nova] [instance: 34ef7d18-0724-479a-8448-981b9cf0d6ab] Received unexpected event network-vif-plugged-1495980a-a474-4a07-a8d1-27521ae89be7 for instance with vm_state deleted and task_state None.
Oct 16 10:22:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:54 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:22:54 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:54 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:22:54 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:22:54 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:22:54 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:22:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:23:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:23:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:23:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:23:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:23:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:23:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:23:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:23:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:23:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:23:19 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:23:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:23:24 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:23:24 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:23:24 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Rebuilding the list of instances to heal {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 10:23:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:23:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:23:24 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:23:24 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lazy-loading 'info_cache' on Instance uuid 654c5596-c318-4ae5-9fc3-cb9c89b9edcc {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:23:24 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Updating instance_info_cache with network_info: [{"id": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "address": "fa:16:3e:b4:90:54", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d303d0-dc", "ovs_interfaceid": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:23:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:23:24 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:23:25 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:23:26 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:23:26 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:23:26 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:23:26 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:23:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:23:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:23:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:23:26 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:23:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:23:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:23:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:23:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:23:27 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:23:27 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:23:27 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=9013MB free_disk=24.951068878173828GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:23:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:23:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:23:27 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 654c5596-c318-4ae5-9fc3-cb9c89b9edcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:23:27 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:23:27 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:23:27 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:23:27 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:23:27 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:23:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.203s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:23:28 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:23:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:23:29 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:23:29 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:23:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:23:35 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:23:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:23:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:23:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:23:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:23:54 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:23:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:23:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:23:55 user nova-compute[74342]: DEBUG nova.objects.instance [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lazy-loading 'flavor' on Instance uuid 654c5596-c318-4ae5-9fc3-cb9c89b9edcc {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:23:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:23:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:23:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:23:56 user nova-compute[74342]: INFO nova.compute.manager [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Attaching volume 42e64add-cada-419f-a1bd-0e8cbc967c2c to /dev/vdb
Oct 16 10:23:56 user nova-compute[74342]: DEBUG os_brick.utils [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:23:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:23:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:23:56 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4321e2-9e9a-4a25-90ce-5e3068309c93]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:23:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:23:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:23:56 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[64a5f3cd-2471-4b7c-a61d-3e27680b2e7d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:23:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:23:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:23:56 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a217962-81e4-4861-bccd-a75aa27c9e26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:23:56 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d704fb-0e05-4c26-9d28-239c59677970]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:23:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:23:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:23:56 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 10:23:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:23:56 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:23:56 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 10:23:56 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d2f87b-d5ca-4365-aff1-e451ea337d69]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:23:56 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 10:23:56 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 10:23:56 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 10:23:56 user nova-compute[74342]: DEBUG os_brick.utils [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:23:56 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Updating existing volume attachment record: 23f7b7ae-122e-4dd9-a523-16a0dcbb096d {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 10:23:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:24:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:24:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:24:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:24:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:24:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQRUFilo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:24:11 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:24:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:24:11 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:24:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:24:11 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 10:24:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[745b5883-e68c-421a-827e-f1c6d778a016]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 10:24:11 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ba186e-95ad-4c95-aa83-aec403e1f43d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c] added
Oct 16 10:24:11 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f87ee2c2-d719-4cb3-98de-09fafe1f66e6]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c069eb9-daa4-45c3-ac09-93097b55ae70]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SQRUFilo {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SQRUFilo" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8cb1822-7012-4bfd-8396-dadde8da7203]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SQRUFilo'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2130fa-0bf3-4d06-a70c-946362da2cde]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e3f979c-bdc4-42d2-b5a4-8a0326ac3457]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 10:24:11 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 10:24:11 user nova-compute[74342]:  {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:24:11 user nova-compute[74342]: WARNING os_brick.initiator.connectors.iscsi [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 10:24:11 user nova-compute[74342]: 
Oct 16 10:24:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b12d5b-f357-4833-b85a-f21624449395]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c, portal: 172.16.0.220,3260]
Oct 16 10:24:11 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c, portal: 172.16.0.220,3260] successful.
Oct 16 10:24:11 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca83d7d2-cd1c-4c78-8308-31cb4f480075]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:24:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:24:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:24:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c08b4e-d439-45b9-a4e2-f0b57f574707]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:24:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c (non-flash)
Oct 16 10:24:12 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:24:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c (non-flash)
Oct 16 10:24:12 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:24:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.237s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:24:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 10:24:12 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 10:24:12 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 10:24:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:24:12 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.025s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:24:12 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[47112fd7-0dc5-4d57-bd13-8dc6d04e633a]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:24:12 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 10:24:12 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQRUFilo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 10:24:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.275s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:24:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] <== connect_volume: return (1277ms) {'type': 'block', 'scsi_wwn': '23533653738366166', 'path': '/dev/sdb'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:24:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23533653738366166', 'path': '/dev/sdb'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 10:24:13 user nova-compute[74342]: DEBUG nova.objects.instance [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lazy-loading 'flavor' on Instance uuid 654c5596-c318-4ae5-9fc3-cb9c89b9edcc {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:24:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 10:24:13 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:24:13 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 10:24:13 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:24:13 user nova-compute[74342]:   <serial>42e64add-cada-419f-a1bd-0e8cbc967c2c</serial>
Oct 16 10:24:13 user nova-compute[74342]: </disk>
Oct 16 10:24:13 user nova-compute[74342]:  {{(pid=74342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 10:24:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:24:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:24:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] No VIF found with MAC fa:16:3e:b4:90:54, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:24:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-6da38c09-7113-4c7f-bf2e-dd2ce854b592 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.515s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:24:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:16 user nova-compute[74342]: DEBUG nova.compute.manager [req-ba3ed40b-9eaa-4ae6-9b18-70cd00b7d798 req-df97d02d-ed28-43f3-b236-2f33f3387287 service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Received event network-changed-d1d303d0-dc4b-40a7-a24c-ff98556e0968 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:24:16 user nova-compute[74342]: DEBUG nova.compute.manager [req-ba3ed40b-9eaa-4ae6-9b18-70cd00b7d798 req-df97d02d-ed28-43f3-b236-2f33f3387287 service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Refreshing instance network info cache due to event network-changed-d1d303d0-dc4b-40a7-a24c-ff98556e0968. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:24:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ba3ed40b-9eaa-4ae6-9b18-70cd00b7d798 req-df97d02d-ed28-43f3-b236-2f33f3387287 service nova] Acquiring lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:24:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ba3ed40b-9eaa-4ae6-9b18-70cd00b7d798 req-df97d02d-ed28-43f3-b236-2f33f3387287 service nova] Acquired lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:24:16 user nova-compute[74342]: DEBUG nova.network.neutron [req-ba3ed40b-9eaa-4ae6-9b18-70cd00b7d798 req-df97d02d-ed28-43f3-b236-2f33f3387287 service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Refreshing network info cache for port d1d303d0-dc4b-40a7-a24c-ff98556e0968 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:24:17 user nova-compute[74342]: DEBUG nova.network.neutron [req-ba3ed40b-9eaa-4ae6-9b18-70cd00b7d798 req-df97d02d-ed28-43f3-b236-2f33f3387287 service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Updated VIF entry in instance network info cache for port d1d303d0-dc4b-40a7-a24c-ff98556e0968. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:24:17 user nova-compute[74342]: DEBUG nova.network.neutron [req-ba3ed40b-9eaa-4ae6-9b18-70cd00b7d798 req-df97d02d-ed28-43f3-b236-2f33f3387287 service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Updating instance_info_cache with network_info: [{"id": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "address": "fa:16:3e:b4:90:54", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d303d0-dc", "ovs_interfaceid": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:24:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ba3ed40b-9eaa-4ae6-9b18-70cd00b7d798 req-df97d02d-ed28-43f3-b236-2f33f3387287 service nova] Releasing lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:24:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:19 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:24:19 user nova-compute[74342]: DEBUG nova.compute.manager [req-d786c0e4-8133-4d22-a632-15997399a5e1 req-c7ab6ce2-24a6-4354-8042-d0138375347a service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Received event network-changed-d1d303d0-dc4b-40a7-a24c-ff98556e0968 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:24:19 user nova-compute[74342]: DEBUG nova.compute.manager [req-d786c0e4-8133-4d22-a632-15997399a5e1 req-c7ab6ce2-24a6-4354-8042-d0138375347a service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Refreshing instance network info cache due to event network-changed-d1d303d0-dc4b-40a7-a24c-ff98556e0968. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:24:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d786c0e4-8133-4d22-a632-15997399a5e1 req-c7ab6ce2-24a6-4354-8042-d0138375347a service nova] Acquiring lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:24:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d786c0e4-8133-4d22-a632-15997399a5e1 req-c7ab6ce2-24a6-4354-8042-d0138375347a service nova] Acquired lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:24:19 user nova-compute[74342]: DEBUG nova.network.neutron [req-d786c0e4-8133-4d22-a632-15997399a5e1 req-c7ab6ce2-24a6-4354-8042-d0138375347a service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Refreshing network info cache for port d1d303d0-dc4b-40a7-a24c-ff98556e0968 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:24:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-462fbe8a-852e-48d2-a642-d8343f3fe087 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:24:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-462fbe8a-852e-48d2-a642-d8343f3fe087 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:24:19 user nova-compute[74342]: INFO nova.compute.manager [None req-462fbe8a-852e-48d2-a642-d8343f3fe087 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Rebooting instance
Oct 16 10:24:19 user nova-compute[74342]: DEBUG nova.network.neutron [req-d786c0e4-8133-4d22-a632-15997399a5e1 req-c7ab6ce2-24a6-4354-8042-d0138375347a service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Updated VIF entry in instance network info cache for port d1d303d0-dc4b-40a7-a24c-ff98556e0968. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:24:19 user nova-compute[74342]: DEBUG nova.network.neutron [req-d786c0e4-8133-4d22-a632-15997399a5e1 req-c7ab6ce2-24a6-4354-8042-d0138375347a service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Updating instance_info_cache with network_info: [{"id": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "address": "fa:16:3e:b4:90:54", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d303d0-dc", "ovs_interfaceid": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:24:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d786c0e4-8133-4d22-a632-15997399a5e1 req-c7ab6ce2-24a6-4354-8042-d0138375347a service nova] Releasing lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:24:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-462fbe8a-852e-48d2-a642-d8343f3fe087 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:24:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-462fbe8a-852e-48d2-a642-d8343f3fe087 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquired lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:24:20 user nova-compute[74342]: DEBUG nova.network.neutron [None req-462fbe8a-852e-48d2-a642-d8343f3fe087 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:24:20 user nova-compute[74342]: DEBUG nova.network.neutron [None req-462fbe8a-852e-48d2-a642-d8343f3fe087 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Updating instance_info_cache with network_info: [{"id": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "address": "fa:16:3e:b4:90:54", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d303d0-dc", "ovs_interfaceid": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:24:20 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-462fbe8a-852e-48d2-a642-d8343f3fe087 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Releasing lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:24:20 user nova-compute[74342]: DEBUG nova.compute.manager [None req-462fbe8a-852e-48d2-a642-d8343f3fe087 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:24:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:23 user nova-compute[74342]: DEBUG nova.compute.manager [req-ff5a6373-28d2-4ab4-8a6d-1030d542a4e7 req-c9fe35ee-f673-4e6f-868f-f9068e30e94c service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Received event network-vif-unplugged-d1d303d0-dc4b-40a7-a24c-ff98556e0968 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:24:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ff5a6373-28d2-4ab4-8a6d-1030d542a4e7 req-c9fe35ee-f673-4e6f-868f-f9068e30e94c service nova] Acquiring lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:24:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ff5a6373-28d2-4ab4-8a6d-1030d542a4e7 req-c9fe35ee-f673-4e6f-868f-f9068e30e94c service nova] Lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:24:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ff5a6373-28d2-4ab4-8a6d-1030d542a4e7 req-c9fe35ee-f673-4e6f-868f-f9068e30e94c service nova] Lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:24:23 user nova-compute[74342]: DEBUG nova.compute.manager [req-ff5a6373-28d2-4ab4-8a6d-1030d542a4e7 req-c9fe35ee-f673-4e6f-868f-f9068e30e94c service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] No waiting events found dispatching network-vif-unplugged-d1d303d0-dc4b-40a7-a24c-ff98556e0968 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:24:23 user nova-compute[74342]: WARNING nova.compute.manager [req-ff5a6373-28d2-4ab4-8a6d-1030d542a4e7 req-c9fe35ee-f673-4e6f-868f-f9068e30e94c service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Received unexpected event network-vif-unplugged-d1d303d0-dc4b-40a7-a24c-ff98556e0968 for instance with vm_state active and task_state reboot_started.
Oct 16 10:24:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:24 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-462fbe8a-852e-48d2-a642-d8343f3fe087 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Instance shutdown successfully.
Oct 16 10:24:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:25 user nova-compute[74342]: DEBUG nova.compute.manager [req-3c05087f-927f-43dc-9b4f-1a9112fe8649 req-f8274200-dd0d-4168-8b89-532646023dbf service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Received event network-vif-plugged-d1d303d0-dc4b-40a7-a24c-ff98556e0968 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:24:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-3c05087f-927f-43dc-9b4f-1a9112fe8649 req-f8274200-dd0d-4168-8b89-532646023dbf service nova] Acquiring lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:24:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-3c05087f-927f-43dc-9b4f-1a9112fe8649 req-f8274200-dd0d-4168-8b89-532646023dbf service nova] Lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:24:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-3c05087f-927f-43dc-9b4f-1a9112fe8649 req-f8274200-dd0d-4168-8b89-532646023dbf service nova] Lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:24:25 user nova-compute[74342]: DEBUG nova.compute.manager [req-3c05087f-927f-43dc-9b4f-1a9112fe8649 req-f8274200-dd0d-4168-8b89-532646023dbf service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] No waiting events found dispatching network-vif-plugged-d1d303d0-dc4b-40a7-a24c-ff98556e0968 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:24:25 user nova-compute[74342]: WARNING nova.compute.manager [req-3c05087f-927f-43dc-9b4f-1a9112fe8649 req-f8274200-dd0d-4168-8b89-532646023dbf service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Received unexpected event network-vif-plugged-d1d303d0-dc4b-40a7-a24c-ff98556e0968 for instance with vm_state active and task_state reboot_started.
Oct 16 10:24:25 user nova-compute[74342]: DEBUG nova.compute.manager [req-3c05087f-927f-43dc-9b4f-1a9112fe8649 req-f8274200-dd0d-4168-8b89-532646023dbf service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Received event network-vif-plugged-d1d303d0-dc4b-40a7-a24c-ff98556e0968 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:24:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-3c05087f-927f-43dc-9b4f-1a9112fe8649 req-f8274200-dd0d-4168-8b89-532646023dbf service nova] Acquiring lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:24:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-3c05087f-927f-43dc-9b4f-1a9112fe8649 req-f8274200-dd0d-4168-8b89-532646023dbf service nova] Lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:24:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-3c05087f-927f-43dc-9b4f-1a9112fe8649 req-f8274200-dd0d-4168-8b89-532646023dbf service nova] Lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:24:25 user nova-compute[74342]: DEBUG nova.compute.manager [req-3c05087f-927f-43dc-9b4f-1a9112fe8649 req-f8274200-dd0d-4168-8b89-532646023dbf service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] No waiting events found dispatching network-vif-plugged-d1d303d0-dc4b-40a7-a24c-ff98556e0968 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:24:25 user nova-compute[74342]: WARNING nova.compute.manager [req-3c05087f-927f-43dc-9b4f-1a9112fe8649 req-f8274200-dd0d-4168-8b89-532646023dbf service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Received unexpected event network-vif-plugged-d1d303d0-dc4b-40a7-a24c-ff98556e0968 for instance with vm_state active and task_state reboot_started.
Oct 16 10:24:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:25 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:26 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:24:26 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:24:26 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Rebuilding the list of instances to heal {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 10:24:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:24:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:24:26 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:24:26 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lazy-loading 'info_cache' on Instance uuid 654c5596-c318-4ae5-9fc3-cb9c89b9edcc {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:24:26 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Updating instance_info_cache with network_info: [{"id": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "address": "fa:16:3e:b4:90:54", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d303d0-dc", "ovs_interfaceid": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:24:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:24:26 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:24:26 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:24:26 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:24:27 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Instance running successfully.
Oct 16 10:24:27 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-462fbe8a-852e-48d2-a642-d8343f3fe087 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Instance soft rebooted successfully.
Oct 16 10:24:27 user nova-compute[74342]: DEBUG nova.compute.manager [None req-462fbe8a-852e-48d2-a642-d8343f3fe087 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:24:27 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:24:27 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:24:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-462fbe8a-852e-48d2-a642-d8343f3fe087 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.502s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:24:27 user nova-compute[74342]: DEBUG nova.compute.manager [req-ee105b7a-19f3-4755-8c49-66868ff8f786 req-50fe1beb-f30f-4983-a78b-bb440a7b3a50 service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Received event network-vif-plugged-d1d303d0-dc4b-40a7-a24c-ff98556e0968 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:24:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ee105b7a-19f3-4755-8c49-66868ff8f786 req-50fe1beb-f30f-4983-a78b-bb440a7b3a50 service nova] Acquiring lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:24:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ee105b7a-19f3-4755-8c49-66868ff8f786 req-50fe1beb-f30f-4983-a78b-bb440a7b3a50 service nova] Lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:24:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ee105b7a-19f3-4755-8c49-66868ff8f786 req-50fe1beb-f30f-4983-a78b-bb440a7b3a50 service nova] Lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:24:27 user nova-compute[74342]: DEBUG nova.compute.manager [req-ee105b7a-19f3-4755-8c49-66868ff8f786 req-50fe1beb-f30f-4983-a78b-bb440a7b3a50 service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] No waiting events found dispatching network-vif-plugged-d1d303d0-dc4b-40a7-a24c-ff98556e0968 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:24:27 user nova-compute[74342]: WARNING nova.compute.manager [req-ee105b7a-19f3-4755-8c49-66868ff8f786 req-50fe1beb-f30f-4983-a78b-bb440a7b3a50 service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Received unexpected event network-vif-plugged-d1d303d0-dc4b-40a7-a24c-ff98556e0968 for instance with vm_state active and task_state None.
Oct 16 10:24:28 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:24:28 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:24:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:24:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:24:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:24:28 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:24:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:24:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:24:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:24:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:24:28 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 10:24:29 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:24:29 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:24:29 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=9061MB free_disk=24.947696685791016GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:24:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:24:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:24:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:29 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 654c5596-c318-4ae5-9fc3-cb9c89b9edcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:24:29 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:24:29 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:24:29 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:24:29 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:24:29 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:24:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:24:31 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:24:31 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:24:32 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:24:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:24:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:24:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:24:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:24:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:24:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:54 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:24:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:25:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:25:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:25:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:25:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:25:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:25:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:25:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:25:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:25:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:25:19 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:25:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:25:27 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:25:27 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:25:27 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:25:27 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:25:27 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Cleaning up deleted instances {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 10:25:27 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] There are 1 instances to clean {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 10:25:27 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Instance has had 5 of 5 cleanup attempts {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 16 10:25:28 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:25:28 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:25:28 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:25:28 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Rebuilding the list of instances to heal {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 10:25:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:25:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:25:28 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:25:28 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lazy-loading 'info_cache' on Instance uuid 654c5596-c318-4ae5-9fc3-cb9c89b9edcc {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:25:28 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Updating instance_info_cache with network_info: [{"id": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "address": "fa:16:3e:b4:90:54", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d303d0-dc", "ovs_interfaceid": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:25:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:25:28 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:25:28 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:25:28 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:25:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:25:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:25:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:25:28 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:25:29 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:25:29 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:25:29 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:25:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:25:29 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:25:29 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 10:25:29 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:25:29 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:25:29 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=9015MB free_disk=24.946216583251953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:25:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:25:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:25:29 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 654c5596-c318-4ae5-9fc3-cb9c89b9edcc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:25:29 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:25:29 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:25:29 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:25:29 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:25:29 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:25:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.167s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:25:31 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:25:31 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:25:31 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:25:31 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74342) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 10:25:31 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:25:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:25:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:25:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:25:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:25:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:25:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:25:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:25:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:25:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:25:54 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:25:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:26:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:26:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:26:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:26:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Acquiring lock "c5b1b987-ae35-4005-96ad-04c3d556bba4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:26:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Lock "c5b1b987-ae35-4005-96ad-04c3d556bba4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:26:10 user nova-compute[74342]: DEBUG nova.compute.manager [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 10:26:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:26:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:26:10 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 10:26:10 user nova-compute[74342]: INFO nova.compute.claims [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Claim successful on node user
Oct 16 10:26:10 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:26:10 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:26:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.242s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:26:10 user nova-compute[74342]: DEBUG nova.compute.manager [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 10:26:10 user nova-compute[74342]: DEBUG nova.compute.manager [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 10:26:10 user nova-compute[74342]: DEBUG nova.network.neutron [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 10:26:10 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 10:26:10 user nova-compute[74342]: DEBUG nova.compute.manager [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 10:26:10 user nova-compute[74342]: DEBUG nova.policy [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'bcfe652a1980470286d174cfbc80ee93', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd0094ef7a54433a8d34ce0054f94f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 10:26:10 user nova-compute[74342]: DEBUG nova.compute.manager [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 10:26:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 10:26:10 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Creating image(s)
Oct 16 10:26:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Acquiring lock "/opt/stack/data/nova/instances/c5b1b987-ae35-4005-96ad-04c3d556bba4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:26:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Lock "/opt/stack/data/nova/instances/c5b1b987-ae35-4005-96ad-04c3d556bba4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:26:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Lock "/opt/stack/data/nova/instances/c5b1b987-ae35-4005-96ad-04c3d556bba4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:26:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:26:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.174s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:26:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:26:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:26:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:26:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.189s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:26:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/c5b1b987-ae35-4005-96ad-04c3d556bba4/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:26:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/c5b1b987-ae35-4005-96ad-04c3d556bba4/disk 1073741824" returned: 0 in 0.050s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:26:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:26:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:26:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.177s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:26:11 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c5b1b987-ae35-4005-96ad-04c3d556bba4/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 10:26:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b1b987-ae35-4005-96ad-04c3d556bba4/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:26:11 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b1b987-ae35-4005-96ad-04c3d556bba4/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:26:11 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Cannot resize image /opt/stack/data/nova/instances/c5b1b987-ae35-4005-96ad-04c3d556bba4/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 10:26:11 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 10:26:11 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Ensure instance console log exists: /opt/stack/data/nova/instances/c5b1b987-ae35-4005-96ad-04c3d556bba4/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 10:26:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:26:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:26:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:26:11 user nova-compute[74342]: DEBUG nova.network.neutron [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Successfully created port: ca5857a7-6360-4f25-8413-bfd5ff3427b2 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.compute.manager [req-88712bfc-0abc-4eba-91af-a9af532c9cf6 req-16cc9d9a-64e6-46e0-8066-d51b34647016 service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Received event network-changed-d1d303d0-dc4b-40a7-a24c-ff98556e0968 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.compute.manager [req-88712bfc-0abc-4eba-91af-a9af532c9cf6 req-16cc9d9a-64e6-46e0-8066-d51b34647016 service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Refreshing instance network info cache due to event network-changed-d1d303d0-dc4b-40a7-a24c-ff98556e0968. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-88712bfc-0abc-4eba-91af-a9af532c9cf6 req-16cc9d9a-64e6-46e0-8066-d51b34647016 service nova] Acquiring lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-88712bfc-0abc-4eba-91af-a9af532c9cf6 req-16cc9d9a-64e6-46e0-8066-d51b34647016 service nova] Acquired lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.network.neutron [req-88712bfc-0abc-4eba-91af-a9af532c9cf6 req-16cc9d9a-64e6-46e0-8066-d51b34647016 service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Refreshing network info cache for port d1d303d0-dc4b-40a7-a24c-ff98556e0968 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.network.neutron [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Successfully updated port: ca5857a7-6360-4f25-8413-bfd5ff3427b2 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Acquiring lock "refresh_cache-c5b1b987-ae35-4005-96ad-04c3d556bba4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Acquired lock "refresh_cache-c5b1b987-ae35-4005-96ad-04c3d556bba4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.network.neutron [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.network.neutron [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.network.neutron [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Updating instance_info_cache with network_info: [{"id": "ca5857a7-6360-4f25-8413-bfd5ff3427b2", "address": "fa:16:3e:ad:23:8f", "network": {"id": "76430deb-8bfe-4c5e-9274-4d877837d10e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f16edca225a74e20981d0c557f45d33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5857a7-63", "ovs_interfaceid": "ca5857a7-6360-4f25-8413-bfd5ff3427b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Releasing lock "refresh_cache-c5b1b987-ae35-4005-96ad-04c3d556bba4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.compute.manager [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Instance network_info: |[{"id": "ca5857a7-6360-4f25-8413-bfd5ff3427b2", "address": "fa:16:3e:ad:23:8f", "network": {"id": "76430deb-8bfe-4c5e-9274-4d877837d10e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f16edca225a74e20981d0c557f45d33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5857a7-63", "ovs_interfaceid": "ca5857a7-6360-4f25-8413-bfd5ff3427b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Start _get_guest_xml network_info=[{"id": "ca5857a7-6360-4f25-8413-bfd5ff3427b2", "address": "fa:16:3e:ad:23:8f", "network": {"id": "76430deb-8bfe-4c5e-9274-4d877837d10e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f16edca225a74e20981d0c557f45d33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5857a7-63", "ovs_interfaceid": "ca5857a7-6360-4f25-8413-bfd5ff3427b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 10:26:12 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:26:12 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:26:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-459443100',display_name='tempest-VolumesNegativeTest-instance-459443100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-459443100',id=49,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd0094ef7a54433a8d34ce0054f94f87',ramdisk_id='',reservation_id='r-ib7jcxyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1449753714',owner_user_name='tempest-VolumesNegativeTest-1449753714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:26:11Z,user_data=None,user_id='bcfe652a1980470286d174cfbc80ee93',uuid=c5b1b987-ae35-4005-96ad-04c3d556bba4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca5857a7-6360-4f25-8413-bfd5ff3427b2", "address": "fa:16:3e:ad:23:8f", "network": {"id": "76430deb-8bfe-4c5e-9274-4d877837d10e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f16edca225a74e20981d0c557f45d33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5857a7-63", "ovs_interfaceid": "ca5857a7-6360-4f25-8413-bfd5ff3427b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Converting VIF {"id": "ca5857a7-6360-4f25-8413-bfd5ff3427b2", "address": "fa:16:3e:ad:23:8f", "network": {"id": "76430deb-8bfe-4c5e-9274-4d877837d10e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f16edca225a74e20981d0c557f45d33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5857a7-63", "ovs_interfaceid": "ca5857a7-6360-4f25-8413-bfd5ff3427b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:23:8f,bridge_name='br-int',has_traffic_filtering=True,id=ca5857a7-6360-4f25-8413-bfd5ff3427b2,network=Network(76430deb-8bfe-4c5e-9274-4d877837d10e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca5857a7-63') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.objects.instance [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Lazy-loading 'pci_devices' on Instance uuid c5b1b987-ae35-4005-96ad-04c3d556bba4 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.network.neutron [req-88712bfc-0abc-4eba-91af-a9af532c9cf6 req-16cc9d9a-64e6-46e0-8066-d51b34647016 service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Updated VIF entry in instance network info cache for port d1d303d0-dc4b-40a7-a24c-ff98556e0968. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.network.neutron [req-88712bfc-0abc-4eba-91af-a9af532c9cf6 req-16cc9d9a-64e6-46e0-8066-d51b34647016 service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Updating instance_info_cache with network_info: [{"id": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "address": "fa:16:3e:b4:90:54", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.217", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d303d0-dc", "ovs_interfaceid": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] End _get_guest_xml xml=<domain type="kvm">
Oct 16 10:26:12 user nova-compute[74342]:   <uuid>c5b1b987-ae35-4005-96ad-04c3d556bba4</uuid>
Oct 16 10:26:12 user nova-compute[74342]:   <name>instance-00000031</name>
Oct 16 10:26:12 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 10:26:12 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 10:26:12 user nova-compute[74342]:   <metadata>
Oct 16 10:26:12 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 10:26:12 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 10:26:12 user nova-compute[74342]:       <nova:name>tempest-VolumesNegativeTest-instance-459443100</nova:name>
Oct 16 10:26:12 user nova-compute[74342]:       <nova:creationTime>2023-10-16 10:26:12</nova:creationTime>
Oct 16 10:26:12 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 10:26:12 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 10:26:12 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 10:26:12 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 10:26:12 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 10:26:12 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 10:26:12 user nova-compute[74342]:       </nova:flavor>
Oct 16 10:26:12 user nova-compute[74342]:       <nova:owner>
Oct 16 10:26:12 user nova-compute[74342]:         <nova:user uuid="bcfe652a1980470286d174cfbc80ee93">tempest-VolumesNegativeTest-1449753714-project-member</nova:user>
Oct 16 10:26:12 user nova-compute[74342]:         <nova:project uuid="fd0094ef7a54433a8d34ce0054f94f87">tempest-VolumesNegativeTest-1449753714</nova:project>
Oct 16 10:26:12 user nova-compute[74342]:       </nova:owner>
Oct 16 10:26:12 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 10:26:12 user nova-compute[74342]:       <nova:ports>
Oct 16 10:26:12 user nova-compute[74342]:         <nova:port uuid="ca5857a7-6360-4f25-8413-bfd5ff3427b2">
Oct 16 10:26:12 user nova-compute[74342]:           <nova:ip type="fixed" address="192.168.233.30" ipVersion="4"/>
Oct 16 10:26:12 user nova-compute[74342]:         </nova:port>
Oct 16 10:26:12 user nova-compute[74342]:       </nova:ports>
Oct 16 10:26:12 user nova-compute[74342]:     </nova:instance>
Oct 16 10:26:12 user nova-compute[74342]:   </metadata>
Oct 16 10:26:12 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 10:26:12 user nova-compute[74342]:     <system>
Oct 16 10:26:12 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 10:26:12 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 10:26:12 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 10:26:12 user nova-compute[74342]:       <entry name="serial">c5b1b987-ae35-4005-96ad-04c3d556bba4</entry>
Oct 16 10:26:12 user nova-compute[74342]:       <entry name="uuid">c5b1b987-ae35-4005-96ad-04c3d556bba4</entry>
Oct 16 10:26:12 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 10:26:12 user nova-compute[74342]:     </system>
Oct 16 10:26:12 user nova-compute[74342]:   </sysinfo>
Oct 16 10:26:12 user nova-compute[74342]:   <os>
Oct 16 10:26:12 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 10:26:12 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 10:26:12 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 10:26:12 user nova-compute[74342]:   </os>
Oct 16 10:26:12 user nova-compute[74342]:   <features>
Oct 16 10:26:12 user nova-compute[74342]:     <acpi/>
Oct 16 10:26:12 user nova-compute[74342]:     <apic/>
Oct 16 10:26:12 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 10:26:12 user nova-compute[74342]:   </features>
Oct 16 10:26:12 user nova-compute[74342]:   <clock offset="utc">
Oct 16 10:26:12 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 10:26:12 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 10:26:12 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 10:26:12 user nova-compute[74342]:   </clock>
Oct 16 10:26:12 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 10:26:12 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 10:26:12 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 10:26:12 user nova-compute[74342]:   </cpu>
Oct 16 10:26:12 user nova-compute[74342]:   <devices>
Oct 16 10:26:12 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 10:26:12 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 10:26:12 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/c5b1b987-ae35-4005-96ad-04c3d556bba4/disk"/>
Oct 16 10:26:12 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 10:26:12 user nova-compute[74342]:     </disk>
Oct 16 10:26:12 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 10:26:12 user nova-compute[74342]:       <mac address="fa:16:3e:ad:23:8f"/>
Oct 16 10:26:12 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:26:12 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 10:26:12 user nova-compute[74342]:       <target dev="tapca5857a7-63"/>
Oct 16 10:26:12 user nova-compute[74342]:     </interface>
Oct 16 10:26:12 user nova-compute[74342]:     <serial type="pty">
Oct 16 10:26:12 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/c5b1b987-ae35-4005-96ad-04c3d556bba4/console.log" append="off"/>
Oct 16 10:26:12 user nova-compute[74342]:     </serial>
Oct 16 10:26:12 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 10:26:12 user nova-compute[74342]:     <video>
Oct 16 10:26:12 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:26:12 user nova-compute[74342]:     </video>
Oct 16 10:26:12 user nova-compute[74342]:     <rng model="virtio">
Oct 16 10:26:12 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 10:26:12 user nova-compute[74342]:     </rng>
Oct 16 10:26:12 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 10:26:12 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 10:26:12 user nova-compute[74342]:       <stats period="10"/>
Oct 16 10:26:12 user nova-compute[74342]:     </memballoon>
Oct 16 10:26:12 user nova-compute[74342]:   </devices>
Oct 16 10:26:12 user nova-compute[74342]: </domain>
Oct 16 10:26:12 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:26:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-459443100',display_name='tempest-VolumesNegativeTest-instance-459443100',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-459443100',id=49,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fd0094ef7a54433a8d34ce0054f94f87',ramdisk_id='',reservation_id='r-ib7jcxyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-1449753714',owner_user_name='tempest-VolumesNegativeTest-1449753714-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:26:11Z,user_data=None,user_id='bcfe652a1980470286d174cfbc80ee93',uuid=c5b1b987-ae35-4005-96ad-04c3d556bba4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ca5857a7-6360-4f25-8413-bfd5ff3427b2", "address": "fa:16:3e:ad:23:8f", "network": {"id": "76430deb-8bfe-4c5e-9274-4d877837d10e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f16edca225a74e20981d0c557f45d33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5857a7-63", "ovs_interfaceid": "ca5857a7-6360-4f25-8413-bfd5ff3427b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Converting VIF {"id": "ca5857a7-6360-4f25-8413-bfd5ff3427b2", "address": "fa:16:3e:ad:23:8f", "network": {"id": "76430deb-8bfe-4c5e-9274-4d877837d10e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f16edca225a74e20981d0c557f45d33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5857a7-63", "ovs_interfaceid": "ca5857a7-6360-4f25-8413-bfd5ff3427b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:23:8f,bridge_name='br-int',has_traffic_filtering=True,id=ca5857a7-6360-4f25-8413-bfd5ff3427b2,network=Network(76430deb-8bfe-4c5e-9274-4d877837d10e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca5857a7-63') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG os_vif [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:23:8f,bridge_name='br-int',has_traffic_filtering=True,id=ca5857a7-6360-4f25-8413-bfd5ff3427b2,network=Network(76430deb-8bfe-4c5e-9274-4d877837d10e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca5857a7-63') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-88712bfc-0abc-4eba-91af-a9af532c9cf6 req-16cc9d9a-64e6-46e0-8066-d51b34647016 service nova] Releasing lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2f7d5eaf-1ce3-50cc-b4be-2680c9ab7b19', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapca5857a7-63, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapca5857a7-63, col_values=(('qos', UUID('9652773a-f033-445b-bdcb-516d983834d0')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapca5857a7-63, col_values=(('external_ids', {'iface-id': 'ca5857a7-6360-4f25-8413-bfd5ff3427b2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:23:8f', 'vm-uuid': 'c5b1b987-ae35-4005-96ad-04c3d556bba4'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:26:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:26:13 user nova-compute[74342]: INFO os_vif [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:23:8f,bridge_name='br-int',has_traffic_filtering=True,id=ca5857a7-6360-4f25-8413-bfd5ff3427b2,network=Network(76430deb-8bfe-4c5e-9274-4d877837d10e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca5857a7-63')
Oct 16 10:26:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:26:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] No VIF found with MAC fa:16:3e:ad:23:8f, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:26:13 user nova-compute[74342]: DEBUG nova.compute.manager [req-ebec44c0-4d89-4c55-9076-ce6994c8a859 req-4af9e831-8ecd-40a9-87f1-1b085886893f service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Received event network-changed-d1d303d0-dc4b-40a7-a24c-ff98556e0968 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:26:13 user nova-compute[74342]: DEBUG nova.compute.manager [req-ebec44c0-4d89-4c55-9076-ce6994c8a859 req-4af9e831-8ecd-40a9-87f1-1b085886893f service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Refreshing instance network info cache due to event network-changed-d1d303d0-dc4b-40a7-a24c-ff98556e0968. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:26:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ebec44c0-4d89-4c55-9076-ce6994c8a859 req-4af9e831-8ecd-40a9-87f1-1b085886893f service nova] Acquiring lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:26:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ebec44c0-4d89-4c55-9076-ce6994c8a859 req-4af9e831-8ecd-40a9-87f1-1b085886893f service nova] Acquired lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:26:13 user nova-compute[74342]: DEBUG nova.network.neutron [req-ebec44c0-4d89-4c55-9076-ce6994c8a859 req-4af9e831-8ecd-40a9-87f1-1b085886893f service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Refreshing network info cache for port d1d303d0-dc4b-40a7-a24c-ff98556e0968 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:26:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:26:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:26:13 user nova-compute[74342]: INFO nova.compute.manager [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Detaching volume 42e64add-cada-419f-a1bd-0e8cbc967c2c
Oct 16 10:26:13 user nova-compute[74342]: INFO nova.virt.block_device [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Attempting to driver detach volume 42e64add-cada-419f-a1bd-0e8cbc967c2c from mountpoint /dev/vdb
Oct 16 10:26:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Attempting to detach device vdb from instance 654c5596-c318-4ae5-9fc3-cb9c89b9edcc from the persistent domain config. {{(pid=74342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 10:26:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 10:26:13 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:26:13 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 10:26:13 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:26:13 user nova-compute[74342]:   <serial>42e64add-cada-419f-a1bd-0e8cbc967c2c</serial>
Oct 16 10:26:13 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 10:26:13 user nova-compute[74342]: </disk>
Oct 16 10:26:13 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 10:26:13 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Successfully detached device vdb from instance 654c5596-c318-4ae5-9fc3-cb9c89b9edcc from the persistent domain config.
Oct 16 10:26:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 654c5596-c318-4ae5-9fc3-cb9c89b9edcc from the live domain config. {{(pid=74342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 10:26:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 10:26:13 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:26:13 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 10:26:13 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:26:13 user nova-compute[74342]:   <serial>42e64add-cada-419f-a1bd-0e8cbc967c2c</serial>
Oct 16 10:26:13 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 10:26:13 user nova-compute[74342]: </disk>
Oct 16 10:26:13 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 10:26:13 user nova-compute[74342]: DEBUG nova.network.neutron [req-ebec44c0-4d89-4c55-9076-ce6994c8a859 req-4af9e831-8ecd-40a9-87f1-1b085886893f service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Updated VIF entry in instance network info cache for port d1d303d0-dc4b-40a7-a24c-ff98556e0968. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:26:13 user nova-compute[74342]: DEBUG nova.network.neutron [req-ebec44c0-4d89-4c55-9076-ce6994c8a859 req-4af9e831-8ecd-40a9-87f1-1b085886893f service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Updating instance_info_cache with network_info: [{"id": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "address": "fa:16:3e:b4:90:54", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d303d0-dc", "ovs_interfaceid": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:26:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ebec44c0-4d89-4c55-9076-ce6994c8a859 req-4af9e831-8ecd-40a9-87f1-1b085886893f service nova] Releasing lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:26:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:26:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 654c5596-c318-4ae5-9fc3-cb9c89b9edcc {{(pid=74342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 10:26:14 user nova-compute[74342]: DEBUG nova.compute.manager [req-6d6c2f26-7125-47a9-b358-8a4e38d0f084 req-2fc02c6c-9850-4fef-811c-cd02db2aa6c4 service nova] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Received event network-changed-ca5857a7-6360-4f25-8413-bfd5ff3427b2 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:26:14 user nova-compute[74342]: DEBUG nova.compute.manager [req-6d6c2f26-7125-47a9-b358-8a4e38d0f084 req-2fc02c6c-9850-4fef-811c-cd02db2aa6c4 service nova] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Refreshing instance network info cache due to event network-changed-ca5857a7-6360-4f25-8413-bfd5ff3427b2. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:26:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-6d6c2f26-7125-47a9-b358-8a4e38d0f084 req-2fc02c6c-9850-4fef-811c-cd02db2aa6c4 service nova] Acquiring lock "refresh_cache-c5b1b987-ae35-4005-96ad-04c3d556bba4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:26:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-6d6c2f26-7125-47a9-b358-8a4e38d0f084 req-2fc02c6c-9850-4fef-811c-cd02db2aa6c4 service nova] Acquired lock "refresh_cache-c5b1b987-ae35-4005-96ad-04c3d556bba4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:26:14 user nova-compute[74342]: DEBUG nova.network.neutron [req-6d6c2f26-7125-47a9-b358-8a4e38d0f084 req-2fc02c6c-9850-4fef-811c-cd02db2aa6c4 service nova] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Refreshing network info cache for port ca5857a7-6360-4f25-8413-bfd5ff3427b2 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:26:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:26:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:26:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:26:14 user nova-compute[74342]: DEBUG nova.network.neutron [req-6d6c2f26-7125-47a9-b358-8a4e38d0f084 req-2fc02c6c-9850-4fef-811c-cd02db2aa6c4 service nova] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Updated VIF entry in instance network info cache for port ca5857a7-6360-4f25-8413-bfd5ff3427b2. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:26:14 user nova-compute[74342]: DEBUG nova.network.neutron [req-6d6c2f26-7125-47a9-b358-8a4e38d0f084 req-2fc02c6c-9850-4fef-811c-cd02db2aa6c4 service nova] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Updating instance_info_cache with network_info: [{"id": "ca5857a7-6360-4f25-8413-bfd5ff3427b2", "address": "fa:16:3e:ad:23:8f", "network": {"id": "76430deb-8bfe-4c5e-9274-4d877837d10e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f16edca225a74e20981d0c557f45d33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5857a7-63", "ovs_interfaceid": "ca5857a7-6360-4f25-8413-bfd5ff3427b2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:26:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-6d6c2f26-7125-47a9-b358-8a4e38d0f084 req-2fc02c6c-9850-4fef-811c-cd02db2aa6c4 service nova] Releasing lock "refresh_cache-c5b1b987-ae35-4005-96ad-04c3d556bba4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:26:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-0386c91f-46fb-4277-878a-af39d1f4628c req-a3c2e857-4449-4ce7-bc5e-424d074b89d3 service nova] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Received event network-vif-plugged-ca5857a7-6360-4f25-8413-bfd5ff3427b2 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:26:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0386c91f-46fb-4277-878a-af39d1f4628c req-a3c2e857-4449-4ce7-bc5e-424d074b89d3 service nova] Acquiring lock "c5b1b987-ae35-4005-96ad-04c3d556bba4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:26:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0386c91f-46fb-4277-878a-af39d1f4628c req-a3c2e857-4449-4ce7-bc5e-424d074b89d3 service nova] Lock "c5b1b987-ae35-4005-96ad-04c3d556bba4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:26:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-0386c91f-46fb-4277-878a-af39d1f4628c req-a3c2e857-4449-4ce7-bc5e-424d074b89d3 service nova] Lock "c5b1b987-ae35-4005-96ad-04c3d556bba4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:26:15 user nova-compute[74342]: DEBUG nova.compute.manager [req-0386c91f-46fb-4277-878a-af39d1f4628c req-a3c2e857-4449-4ce7-bc5e-424d074b89d3 service nova] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] No waiting events found dispatching network-vif-plugged-ca5857a7-6360-4f25-8413-bfd5ff3427b2 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:26:15 user nova-compute[74342]: WARNING nova.compute.manager [req-0386c91f-46fb-4277-878a-af39d1f4628c req-a3c2e857-4449-4ce7-bc5e-424d074b89d3 service nova] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Received unexpected event network-vif-plugged-ca5857a7-6360-4f25-8413-bfd5ff3427b2 for instance with vm_state building and task_state spawning.
Oct 16 10:26:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:26:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:26:15 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:26:16 user nova-compute[74342]: DEBUG nova.compute.manager [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 10:26:16 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 10:26:16 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Instance spawned successfully.
Oct 16 10:26:16 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 10:26:16 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:26:16 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:26:16 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:26:16 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:26:16 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:26:16 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:26:16 user nova-compute[74342]: INFO nova.compute.manager [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Took 6.03 seconds to spawn the instance on the hypervisor.
Oct 16 10:26:16 user nova-compute[74342]: DEBUG nova.compute.manager [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:26:16 user nova-compute[74342]: INFO nova.compute.manager [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Took 6.67 seconds to build instance.
Oct 16 10:26:16 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-111467fe-d39b-4b88-9319-349c0a1afece tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Lock "c5b1b987-ae35-4005-96ad-04c3d556bba4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.773s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:26:17 user nova-compute[74342]: DEBUG nova.compute.manager [req-63a314dc-6cda-4c74-93df-eba7b8c349a6 req-2eff1e77-bf7c-4f48-9962-2a1e8c6fc6ec service nova] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Received event network-vif-plugged-ca5857a7-6360-4f25-8413-bfd5ff3427b2 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:26:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-63a314dc-6cda-4c74-93df-eba7b8c349a6 req-2eff1e77-bf7c-4f48-9962-2a1e8c6fc6ec service nova] Acquiring lock "c5b1b987-ae35-4005-96ad-04c3d556bba4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:26:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-63a314dc-6cda-4c74-93df-eba7b8c349a6 req-2eff1e77-bf7c-4f48-9962-2a1e8c6fc6ec service nova] Lock "c5b1b987-ae35-4005-96ad-04c3d556bba4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:26:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-63a314dc-6cda-4c74-93df-eba7b8c349a6 req-2eff1e77-bf7c-4f48-9962-2a1e8c6fc6ec service nova] Lock "c5b1b987-ae35-4005-96ad-04c3d556bba4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:26:17 user nova-compute[74342]: DEBUG nova.compute.manager [req-63a314dc-6cda-4c74-93df-eba7b8c349a6 req-2eff1e77-bf7c-4f48-9962-2a1e8c6fc6ec service nova] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] No waiting events found dispatching network-vif-plugged-ca5857a7-6360-4f25-8413-bfd5ff3427b2 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:26:17 user nova-compute[74342]: WARNING nova.compute.manager [req-63a314dc-6cda-4c74-93df-eba7b8c349a6 req-2eff1e77-bf7c-4f48-9962-2a1e8c6fc6ec service nova] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Received unexpected event network-vif-plugged-ca5857a7-6360-4f25-8413-bfd5ff3427b2 for instance with vm_state active and task_state None.
Oct 16 10:26:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:26:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:26:20 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:26:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:26:27 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:26:27 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:26:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:26:28 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:26:28 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:26:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:26:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:26:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:26:28 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:26:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b1b987-ae35-4005-96ad-04c3d556bba4/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:26:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b1b987-ae35-4005-96ad-04c3d556bba4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:26:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b1b987-ae35-4005-96ad-04c3d556bba4/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:26:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b1b987-ae35-4005-96ad-04c3d556bba4/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:26:28 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:26:29 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/disk --force-share --output=json" returned: 0 in 0.359s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:26:29 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:26:29 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:26:29 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:26:29 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:26:29 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8786MB free_disk=24.943767547607422GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:26:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:26:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:26:30 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 654c5596-c318-4ae5-9fc3-cb9c89b9edcc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:26:30 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance c5b1b987-ae35-4005-96ad-04c3d556bba4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:26:30 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:26:30 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:26:30 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Refreshing inventories for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 10:26:30 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Updating ProviderTree inventory for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 10:26:30 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Updating inventory in ProviderTree for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 10:26:30 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Refreshing aggregate associations for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca, aggregates: None {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 10:26:30 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Refreshing trait associations for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 10:26:30 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:26:30 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:26:30 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:26:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.504s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:26:31 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:26:31 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:26:31 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Rebuilding the list of instances to heal {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 10:26:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:26:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:26:31 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:26:31 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lazy-loading 'info_cache' on Instance uuid 654c5596-c318-4ae5-9fc3-cb9c89b9edcc {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:26:31 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Updating instance_info_cache with network_info: [{"id": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "address": "fa:16:3e:b4:90:54", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d303d0-dc", "ovs_interfaceid": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:26:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-654c5596-c318-4ae5-9fc3-cb9c89b9edcc" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:26:31 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:26:31 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:26:31 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:26:32 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:26:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:26:33 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:26:33 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:26:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:26:33 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 654c5596-c318-4ae5-9fc3-cb9c89b9edcc is timed out.
Oct 16 10:26:33 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Successfully detached device vdb from instance 654c5596-c318-4ae5-9fc3-cb9c89b9edcc from the live domain config.
Oct 16 10:26:33 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 10:26:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SQRUFilo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:26:33 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:26:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:26:33 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:26:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2385592-a057-4675-964f-6c5efefa1dc5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 10:26:34 user nova-compute[74342]: No targets found.
Oct 16 10:26:34 user nova-compute[74342]: iSNS:
Oct 16 10:26:34 user nova-compute[74342]: No targets found.
Oct 16 10:26:34 user nova-compute[74342]: STATIC:
Oct 16 10:26:34 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c
Oct 16 10:26:34 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:26:34 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:26:34 user nova-compute[74342]: FIRMWARE:
Oct 16 10:26:34 user nova-compute[74342]: No targets found.
Oct 16 10:26:34 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 10:26:34 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 10:26:34 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[681110bc-f619-4239-977d-ba031c9f156d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b714ac54-e0e6-40db-9a74-486840024bc6]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c (non-flash)
Oct 16 10:26:34 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c (non-flash)
Oct 16 10:26:34 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b83fd7760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c'): ({'sdb'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Removing single pathed devices sdb {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b266ce-0761-4383-b4eb-f184b4a936c1]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[62b6bcbc-892d-462a-8ab7-7ab9bd3bbe51]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Flushing IO for device /dev/sdb {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c86e2f-8ecb-4d5c-9990-f4d0f5968299]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.058s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f22ff8-b65e-47f4-b3d6-21eaedc5daec]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1475fb4-919f-4270-8cf0-95fda31c49c4]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3f730fd-4a10-4665-8e6d-0c7cfbf996c9]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c, portal: 172.16.0.220,3260]
Oct 16 10:26:34 user nova-compute[74342]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c, portal: 172.16.0.220,3260] successful.
Oct 16 10:26:34 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:42e64add-cada-419f-a1bd-0e8cbc967c2c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a4a8f6-55d0-491d-ac4e-959289822189]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.294s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] <== disconnect_volume: return (296ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:26:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 10:26:35 user nova-compute[74342]: DEBUG nova.objects.instance [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lazy-loading 'flavor' on Instance uuid 654c5596-c318-4ae5-9fc3-cb9c89b9edcc {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:26:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-4989bb9a-a928-4f70-bed4-a43903605225 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.796s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:26:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:26:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:26:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:26:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:26:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:26:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:26:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:26:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:26:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:27:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:27:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:27:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2075339a-f355-4c50-a775-2436752d7253 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:27:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2075339a-f355-4c50-a775-2436752d7253 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:27:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2075339a-f355-4c50-a775-2436752d7253 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:27:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2075339a-f355-4c50-a775-2436752d7253 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:27:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2075339a-f355-4c50-a775-2436752d7253 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:27:12 user nova-compute[74342]: INFO nova.compute.manager [None req-2075339a-f355-4c50-a775-2436752d7253 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Terminating instance
Oct 16 10:27:12 user nova-compute[74342]: DEBUG nova.compute.manager [None req-2075339a-f355-4c50-a775-2436752d7253 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 10:27:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:27:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:27:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:27:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:27:12 user nova-compute[74342]: DEBUG nova.compute.manager [req-edc24664-b7fa-4116-b012-3e3a2d1eb8d8 req-86bbeb1e-0633-4f1a-9237-28561e68c30d service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Received event network-vif-unplugged-d1d303d0-dc4b-40a7-a24c-ff98556e0968 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:27:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-edc24664-b7fa-4116-b012-3e3a2d1eb8d8 req-86bbeb1e-0633-4f1a-9237-28561e68c30d service nova] Acquiring lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:27:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-edc24664-b7fa-4116-b012-3e3a2d1eb8d8 req-86bbeb1e-0633-4f1a-9237-28561e68c30d service nova] Lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:27:12 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-edc24664-b7fa-4116-b012-3e3a2d1eb8d8 req-86bbeb1e-0633-4f1a-9237-28561e68c30d service nova] Lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:27:12 user nova-compute[74342]: DEBUG nova.compute.manager [req-edc24664-b7fa-4116-b012-3e3a2d1eb8d8 req-86bbeb1e-0633-4f1a-9237-28561e68c30d service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] No waiting events found dispatching network-vif-unplugged-d1d303d0-dc4b-40a7-a24c-ff98556e0968 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:27:12 user nova-compute[74342]: DEBUG nova.compute.manager [req-edc24664-b7fa-4116-b012-3e3a2d1eb8d8 req-86bbeb1e-0633-4f1a-9237-28561e68c30d service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Received event network-vif-unplugged-d1d303d0-dc4b-40a7-a24c-ff98556e0968 for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 10:27:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:27:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:27:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:27:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:27:13 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Instance destroyed successfully.
Oct 16 10:27:13 user nova-compute[74342]: DEBUG nova.objects.instance [None req-2075339a-f355-4c50-a775-2436752d7253 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lazy-loading 'resources' on Instance uuid 654c5596-c318-4ae5-9fc3-cb9c89b9edcc {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:27:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-2075339a-f355-4c50-a775-2436752d7253 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:21:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2114161969',display_name='tempest-TestMinimumBasicScenario-server-2114161969',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2114161969',id=48,image_ref='598f3b39-2a87-414f-ae51-be0203ba0420',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGMLdVxHP9DQfGaf7l/F8b8j9svdVOwmmAM8tfncm+EqiAdBPX+jagLOONOGBIGtSXa+sDo5cOBPScGB+C+nkbdpfnEZIvfsVoFBswcYmsVNB8Cc8vvALqnrxjgG7Gfldg==',key_name='tempest-TestMinimumBasicScenario-634640765',keypairs=<?>,launch_index=0,launched_at=2023-10-16T10:22:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d121feadb9b94fe09dd25b0d5adedb6e',ramdisk_id='',reservation_id='r-a9w1z4fr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='598f3b39-2a87-414f-ae51-be0203ba0420',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-643895215',owner_user_name='tempest-TestMinimumBasicScenario-643895215-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T10:24:27Z,user_data=None,user_id='fa5d15e5061141f798d8e0f58cae2c7f',uuid=654c5596-c318-4ae5-9fc3-cb9c89b9edcc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "address": "fa:16:3e:b4:90:54", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d303d0-dc", "ovs_interfaceid": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 10:27:13 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-2075339a-f355-4c50-a775-2436752d7253 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Converting VIF {"id": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "address": "fa:16:3e:b4:90:54", "network": {"id": "9adc3611-05c0-400f-99d4-a61f2c9e74d8", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1970859014-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d121feadb9b94fe09dd25b0d5adedb6e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd1d303d0-dc", "ovs_interfaceid": "d1d303d0-dc4b-40a7-a24c-ff98556e0968", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:27:13 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-2075339a-f355-4c50-a775-2436752d7253 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b4:90:54,bridge_name='br-int',has_traffic_filtering=True,id=d1d303d0-dc4b-40a7-a24c-ff98556e0968,network=Network(9adc3611-05c0-400f-99d4-a61f2c9e74d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d303d0-dc') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:27:13 user nova-compute[74342]: DEBUG os_vif [None req-2075339a-f355-4c50-a775-2436752d7253 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:90:54,bridge_name='br-int',has_traffic_filtering=True,id=d1d303d0-dc4b-40a7-a24c-ff98556e0968,network=Network(9adc3611-05c0-400f-99d4-a61f2c9e74d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d303d0-dc') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 10:27:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:27:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd1d303d0-dc, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:27:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:27:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:27:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:27:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9dfa4af6-652d-4a53-90b9-8957cc43544b) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:27:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:27:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:27:13 user nova-compute[74342]: INFO os_vif [None req-2075339a-f355-4c50-a775-2436752d7253 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b4:90:54,bridge_name='br-int',has_traffic_filtering=True,id=d1d303d0-dc4b-40a7-a24c-ff98556e0968,network=Network(9adc3611-05c0-400f-99d4-a61f2c9e74d8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd1d303d0-dc')
Oct 16 10:27:13 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-2075339a-f355-4c50-a775-2436752d7253 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Deleting instance files /opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc_del
Oct 16 10:27:13 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-2075339a-f355-4c50-a775-2436752d7253 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Deletion of /opt/stack/data/nova/instances/654c5596-c318-4ae5-9fc3-cb9c89b9edcc_del complete
Oct 16 10:27:13 user nova-compute[74342]: INFO nova.compute.manager [None req-2075339a-f355-4c50-a775-2436752d7253 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 16 10:27:13 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-2075339a-f355-4c50-a775-2436752d7253 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 10:27:13 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 10:27:13 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 10:27:13 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:27:13 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Took 0.50 seconds to deallocate network for instance.
Oct 16 10:27:13 user nova-compute[74342]: DEBUG nova.compute.manager [req-4b95fa49-2c3f-43ac-8053-aab14a09602b req-8020e3a4-d950-4f12-aab4-0723d2a3739a service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Received event network-vif-deleted-d1d303d0-dc4b-40a7-a24c-ff98556e0968 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:27:13 user nova-compute[74342]: INFO nova.compute.manager [req-4b95fa49-2c3f-43ac-8053-aab14a09602b req-8020e3a4-d950-4f12-aab4-0723d2a3739a service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Neutron deleted interface d1d303d0-dc4b-40a7-a24c-ff98556e0968; detaching it from the instance and deleting it from the info cache
Oct 16 10:27:13 user nova-compute[74342]: DEBUG nova.network.neutron [req-4b95fa49-2c3f-43ac-8053-aab14a09602b req-8020e3a4-d950-4f12-aab4-0723d2a3739a service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:27:13 user nova-compute[74342]: DEBUG nova.compute.manager [req-4b95fa49-2c3f-43ac-8053-aab14a09602b req-8020e3a4-d950-4f12-aab4-0723d2a3739a service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Detach interface failed, port_id=d1d303d0-dc4b-40a7-a24c-ff98556e0968, reason: Instance 654c5596-c318-4ae5-9fc3-cb9c89b9edcc could not be found. {{(pid=74342) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10945}}
Oct 16 10:27:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2075339a-f355-4c50-a775-2436752d7253 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:27:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2075339a-f355-4c50-a775-2436752d7253 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:27:13 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-2075339a-f355-4c50-a775-2436752d7253 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:27:13 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-2075339a-f355-4c50-a775-2436752d7253 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:27:13 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2075339a-f355-4c50-a775-2436752d7253 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.173s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:27:13 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-2075339a-f355-4c50-a775-2436752d7253 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Deleted allocations for instance 654c5596-c318-4ae5-9fc3-cb9c89b9edcc
Oct 16 10:27:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-2075339a-f355-4c50-a775-2436752d7253 tempest-TestMinimumBasicScenario-643895215 tempest-TestMinimumBasicScenario-643895215-project-member] Lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.753s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:27:14 user nova-compute[74342]: DEBUG nova.compute.manager [req-99dfde91-a987-4917-90fe-50913e119fa8 req-2df36424-5462-4803-979f-67a71e86c1a5 service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Received event network-vif-plugged-d1d303d0-dc4b-40a7-a24c-ff98556e0968 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:27:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-99dfde91-a987-4917-90fe-50913e119fa8 req-2df36424-5462-4803-979f-67a71e86c1a5 service nova] Acquiring lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:27:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-99dfde91-a987-4917-90fe-50913e119fa8 req-2df36424-5462-4803-979f-67a71e86c1a5 service nova] Lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:27:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-99dfde91-a987-4917-90fe-50913e119fa8 req-2df36424-5462-4803-979f-67a71e86c1a5 service nova] Lock "654c5596-c318-4ae5-9fc3-cb9c89b9edcc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:27:14 user nova-compute[74342]: DEBUG nova.compute.manager [req-99dfde91-a987-4917-90fe-50913e119fa8 req-2df36424-5462-4803-979f-67a71e86c1a5 service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] No waiting events found dispatching network-vif-plugged-d1d303d0-dc4b-40a7-a24c-ff98556e0968 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:27:14 user nova-compute[74342]: WARNING nova.compute.manager [req-99dfde91-a987-4917-90fe-50913e119fa8 req-2df36424-5462-4803-979f-67a71e86c1a5 service nova] [instance: 654c5596-c318-4ae5-9fc3-cb9c89b9edcc] Received unexpected event network-vif-plugged-d1d303d0-dc4b-40a7-a24c-ff98556e0968 for instance with vm_state deleted and task_state None.
Oct 16 10:27:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:27:22 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:27:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:27:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:27:28 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:27:29 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:27:29 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:27:29 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:27:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:27:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:27:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:27:29 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:27:29 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b1b987-ae35-4005-96ad-04c3d556bba4/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:27:29 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b1b987-ae35-4005-96ad-04c3d556bba4/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:27:29 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b1b987-ae35-4005-96ad-04c3d556bba4/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:27:29 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c5b1b987-ae35-4005-96ad-04c3d556bba4/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:27:30 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:27:30 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:27:30 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=9000MB free_disk=24.943214416503906GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:27:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:27:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:27:30 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance c5b1b987-ae35-4005-96ad-04c3d556bba4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:27:30 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:27:30 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:27:30 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:27:30 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:27:30 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:27:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.187s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:27:32 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:27:32 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:27:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-c5b1b987-ae35-4005-96ad-04c3d556bba4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:27:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-c5b1b987-ae35-4005-96ad-04c3d556bba4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:27:32 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:27:32 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Updating instance_info_cache with network_info: [{"id": "ca5857a7-6360-4f25-8413-bfd5ff3427b2", "address": "fa:16:3e:ad:23:8f", "network": {"id": "76430deb-8bfe-4c5e-9274-4d877837d10e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f16edca225a74e20981d0c557f45d33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5857a7-63", "ovs_interfaceid": "ca5857a7-6360-4f25-8413-bfd5ff3427b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:27:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-c5b1b987-ae35-4005-96ad-04c3d556bba4" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:27:32 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:27:32 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:27:32 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:27:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:27:35 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:27:35 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:27:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:27:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:27:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:27:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:27:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:27:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:27:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:27:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:27:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:27:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:28:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8c7f3e0f-6161-470c-b2c7-9f5dcf8cd528 tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Acquiring lock "c5b1b987-ae35-4005-96ad-04c3d556bba4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:28:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8c7f3e0f-6161-470c-b2c7-9f5dcf8cd528 tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Lock "c5b1b987-ae35-4005-96ad-04c3d556bba4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:28:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8c7f3e0f-6161-470c-b2c7-9f5dcf8cd528 tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Acquiring lock "c5b1b987-ae35-4005-96ad-04c3d556bba4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:28:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8c7f3e0f-6161-470c-b2c7-9f5dcf8cd528 tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Lock "c5b1b987-ae35-4005-96ad-04c3d556bba4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:28:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8c7f3e0f-6161-470c-b2c7-9f5dcf8cd528 tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Lock "c5b1b987-ae35-4005-96ad-04c3d556bba4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:28:00 user nova-compute[74342]: INFO nova.compute.manager [None req-8c7f3e0f-6161-470c-b2c7-9f5dcf8cd528 tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Terminating instance
Oct 16 10:28:00 user nova-compute[74342]: DEBUG nova.compute.manager [None req-8c7f3e0f-6161-470c-b2c7-9f5dcf8cd528 tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 10:28:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:00 user nova-compute[74342]: DEBUG nova.compute.manager [req-e71da1e7-26a6-4bc7-98d2-eb249f6f5eb7 req-e493dd17-020b-4efa-ab6c-6e82a3b92f0b service nova] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Received event network-vif-unplugged-ca5857a7-6360-4f25-8413-bfd5ff3427b2 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:28:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e71da1e7-26a6-4bc7-98d2-eb249f6f5eb7 req-e493dd17-020b-4efa-ab6c-6e82a3b92f0b service nova] Acquiring lock "c5b1b987-ae35-4005-96ad-04c3d556bba4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:28:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e71da1e7-26a6-4bc7-98d2-eb249f6f5eb7 req-e493dd17-020b-4efa-ab6c-6e82a3b92f0b service nova] Lock "c5b1b987-ae35-4005-96ad-04c3d556bba4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:28:00 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-e71da1e7-26a6-4bc7-98d2-eb249f6f5eb7 req-e493dd17-020b-4efa-ab6c-6e82a3b92f0b service nova] Lock "c5b1b987-ae35-4005-96ad-04c3d556bba4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:28:00 user nova-compute[74342]: DEBUG nova.compute.manager [req-e71da1e7-26a6-4bc7-98d2-eb249f6f5eb7 req-e493dd17-020b-4efa-ab6c-6e82a3b92f0b service nova] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] No waiting events found dispatching network-vif-unplugged-ca5857a7-6360-4f25-8413-bfd5ff3427b2 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:28:00 user nova-compute[74342]: DEBUG nova.compute.manager [req-e71da1e7-26a6-4bc7-98d2-eb249f6f5eb7 req-e493dd17-020b-4efa-ab6c-6e82a3b92f0b service nova] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Received event network-vif-unplugged-ca5857a7-6360-4f25-8413-bfd5ff3427b2 for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 10:28:00 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:01 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Instance destroyed successfully.
Oct 16 10:28:01 user nova-compute[74342]: DEBUG nova.objects.instance [None req-8c7f3e0f-6161-470c-b2c7-9f5dcf8cd528 tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Lazy-loading 'resources' on Instance uuid c5b1b987-ae35-4005-96ad-04c3d556bba4 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:28:01 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-8c7f3e0f-6161-470c-b2c7-9f5dcf8cd528 tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:26:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-459443100',display_name='tempest-VolumesNegativeTest-instance-459443100',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-459443100',id=49,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-10-16T10:26:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fd0094ef7a54433a8d34ce0054f94f87',ramdisk_id='',reservation_id='r-ib7jcxyr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-1449753714',owner_user_name='tempest-VolumesNegativeTest-1449753714-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T10:26:17Z,user_data=None,user_id='bcfe652a1980470286d174cfbc80ee93',uuid=c5b1b987-ae35-4005-96ad-04c3d556bba4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ca5857a7-6360-4f25-8413-bfd5ff3427b2", "address": "fa:16:3e:ad:23:8f", "network": {"id": "76430deb-8bfe-4c5e-9274-4d877837d10e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f16edca225a74e20981d0c557f45d33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5857a7-63", "ovs_interfaceid": "ca5857a7-6360-4f25-8413-bfd5ff3427b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 10:28:01 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-8c7f3e0f-6161-470c-b2c7-9f5dcf8cd528 tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Converting VIF {"id": "ca5857a7-6360-4f25-8413-bfd5ff3427b2", "address": "fa:16:3e:ad:23:8f", "network": {"id": "76430deb-8bfe-4c5e-9274-4d877837d10e", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.30", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "f16edca225a74e20981d0c557f45d33f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapca5857a7-63", "ovs_interfaceid": "ca5857a7-6360-4f25-8413-bfd5ff3427b2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:28:01 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-8c7f3e0f-6161-470c-b2c7-9f5dcf8cd528 tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:23:8f,bridge_name='br-int',has_traffic_filtering=True,id=ca5857a7-6360-4f25-8413-bfd5ff3427b2,network=Network(76430deb-8bfe-4c5e-9274-4d877837d10e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca5857a7-63') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:28:01 user nova-compute[74342]: DEBUG os_vif [None req-8c7f3e0f-6161-470c-b2c7-9f5dcf8cd528 tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:23:8f,bridge_name='br-int',has_traffic_filtering=True,id=ca5857a7-6360-4f25-8413-bfd5ff3427b2,network=Network(76430deb-8bfe-4c5e-9274-4d877837d10e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca5857a7-63') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 10:28:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapca5857a7-63, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:28:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:28:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9652773a-f033-445b-bdcb-516d983834d0) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:28:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:28:01 user nova-compute[74342]: INFO os_vif [None req-8c7f3e0f-6161-470c-b2c7-9f5dcf8cd528 tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:23:8f,bridge_name='br-int',has_traffic_filtering=True,id=ca5857a7-6360-4f25-8413-bfd5ff3427b2,network=Network(76430deb-8bfe-4c5e-9274-4d877837d10e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapca5857a7-63')
Oct 16 10:28:01 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-8c7f3e0f-6161-470c-b2c7-9f5dcf8cd528 tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Deleting instance files /opt/stack/data/nova/instances/c5b1b987-ae35-4005-96ad-04c3d556bba4_del
Oct 16 10:28:01 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-8c7f3e0f-6161-470c-b2c7-9f5dcf8cd528 tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Deletion of /opt/stack/data/nova/instances/c5b1b987-ae35-4005-96ad-04c3d556bba4_del complete
Oct 16 10:28:01 user nova-compute[74342]: INFO nova.compute.manager [None req-8c7f3e0f-6161-470c-b2c7-9f5dcf8cd528 tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Took 0.85 seconds to destroy the instance on the hypervisor.
Oct 16 10:28:01 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-8c7f3e0f-6161-470c-b2c7-9f5dcf8cd528 tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 10:28:01 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 10:28:01 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 10:28:02 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:28:02 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Took 0.99 seconds to deallocate network for instance.
Oct 16 10:28:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-c61672d2-77ec-4311-a352-bdb10580b132 req-1dd1eb8b-ef20-4636-97f4-afefd146e5e4 service nova] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Received event network-vif-deleted-ca5857a7-6360-4f25-8413-bfd5ff3427b2 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:28:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8c7f3e0f-6161-470c-b2c7-9f5dcf8cd528 tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:28:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8c7f3e0f-6161-470c-b2c7-9f5dcf8cd528 tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:28:02 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-8c7f3e0f-6161-470c-b2c7-9f5dcf8cd528 tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:28:02 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-8c7f3e0f-6161-470c-b2c7-9f5dcf8cd528 tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:28:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8c7f3e0f-6161-470c-b2c7-9f5dcf8cd528 tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.211s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:28:02 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-8c7f3e0f-6161-470c-b2c7-9f5dcf8cd528 tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Deleted allocations for instance c5b1b987-ae35-4005-96ad-04c3d556bba4
Oct 16 10:28:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8c7f3e0f-6161-470c-b2c7-9f5dcf8cd528 tempest-VolumesNegativeTest-1449753714 tempest-VolumesNegativeTest-1449753714-project-member] Lock "c5b1b987-ae35-4005-96ad-04c3d556bba4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.262s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:28:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-fdd8d483-885f-4ca3-ba6e-6f5306fbf2d3 req-a808242a-1dfa-4811-b09e-8ec37950914d service nova] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Received event network-vif-plugged-ca5857a7-6360-4f25-8413-bfd5ff3427b2 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:28:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-fdd8d483-885f-4ca3-ba6e-6f5306fbf2d3 req-a808242a-1dfa-4811-b09e-8ec37950914d service nova] Acquiring lock "c5b1b987-ae35-4005-96ad-04c3d556bba4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:28:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-fdd8d483-885f-4ca3-ba6e-6f5306fbf2d3 req-a808242a-1dfa-4811-b09e-8ec37950914d service nova] Lock "c5b1b987-ae35-4005-96ad-04c3d556bba4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:28:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-fdd8d483-885f-4ca3-ba6e-6f5306fbf2d3 req-a808242a-1dfa-4811-b09e-8ec37950914d service nova] Lock "c5b1b987-ae35-4005-96ad-04c3d556bba4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:28:02 user nova-compute[74342]: DEBUG nova.compute.manager [req-fdd8d483-885f-4ca3-ba6e-6f5306fbf2d3 req-a808242a-1dfa-4811-b09e-8ec37950914d service nova] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] No waiting events found dispatching network-vif-plugged-ca5857a7-6360-4f25-8413-bfd5ff3427b2 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:28:02 user nova-compute[74342]: WARNING nova.compute.manager [req-fdd8d483-885f-4ca3-ba6e-6f5306fbf2d3 req-a808242a-1dfa-4811-b09e-8ec37950914d service nova] [instance: c5b1b987-ae35-4005-96ad-04c3d556bba4] Received unexpected event network-vif-plugged-ca5857a7-6360-4f25-8413-bfd5ff3427b2 for instance with vm_state deleted and task_state None.
Oct 16 10:28:05 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:23 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:28:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:28:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:28:25 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 10:28:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:28:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:28:25 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 10:28:25 user nova-compute[74342]: INFO nova.compute.claims [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Claim successful on node user
Oct 16 10:28:25 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:28:25 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:28:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.218s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:28:26 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 10:28:26 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 10:28:26 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 10:28:26 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 10:28:26 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 10:28:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:26 user nova-compute[74342]: DEBUG nova.policy [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5c28bea56bdf44d8b485e09faa6f6f08', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'de9fb210571447cdb6214d66f66a4d73', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 10:28:26 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 10:28:26 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 10:28:26 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Creating image(s)
Oct 16 10:28:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "/opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:28:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "/opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:28:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "/opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:28:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:28:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.183s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:28:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:28:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:28:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:28:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.186s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:28:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:28:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk 1073741824" returned: 0 in 0.047s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:28:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:28:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:28:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.175s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:28:26 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 10:28:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:28:26 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Successfully created port: e8604c7a-955c-4392-9516-9d857e0b853c {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Cannot resize image /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Ensure instance console log exists: /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Successfully updated port: e8604c7a-955c-4392-9516-9d857e0b853c {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "refresh_cache-7fa98a0b-38b5-4414-a91a-825638eb22d5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquired lock "refresh_cache-7fa98a0b-38b5-4414-a91a-825638eb22d5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.compute.manager [req-a619e757-3b13-4e6d-80ce-cd1905fe197d req-f8cb885f-f56c-4c56-876c-6b6681b312ac service nova] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Received event network-changed-e8604c7a-955c-4392-9516-9d857e0b853c {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.compute.manager [req-a619e757-3b13-4e6d-80ce-cd1905fe197d req-f8cb885f-f56c-4c56-876c-6b6681b312ac service nova] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Refreshing instance network info cache due to event network-changed-e8604c7a-955c-4392-9516-9d857e0b853c. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a619e757-3b13-4e6d-80ce-cd1905fe197d req-f8cb885f-f56c-4c56-876c-6b6681b312ac service nova] Acquiring lock "refresh_cache-7fa98a0b-38b5-4414-a91a-825638eb22d5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Updating instance_info_cache with network_info: [{"id": "e8604c7a-955c-4392-9516-9d857e0b853c", "address": "fa:16:3e:2b:c3:c5", "network": {"id": "8e5b686c-cd9a-4ac1-866b-24bdde0a8f6f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-307409530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de9fb210571447cdb6214d66f66a4d73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8604c7a-95", "ovs_interfaceid": "e8604c7a-955c-4392-9516-9d857e0b853c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Releasing lock "refresh_cache-7fa98a0b-38b5-4414-a91a-825638eb22d5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Instance network_info: |[{"id": "e8604c7a-955c-4392-9516-9d857e0b853c", "address": "fa:16:3e:2b:c3:c5", "network": {"id": "8e5b686c-cd9a-4ac1-866b-24bdde0a8f6f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-307409530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de9fb210571447cdb6214d66f66a4d73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8604c7a-95", "ovs_interfaceid": "e8604c7a-955c-4392-9516-9d857e0b853c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a619e757-3b13-4e6d-80ce-cd1905fe197d req-f8cb885f-f56c-4c56-876c-6b6681b312ac service nova] Acquired lock "refresh_cache-7fa98a0b-38b5-4414-a91a-825638eb22d5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.network.neutron [req-a619e757-3b13-4e6d-80ce-cd1905fe197d req-f8cb885f-f56c-4c56-876c-6b6681b312ac service nova] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Refreshing network info cache for port e8604c7a-955c-4392-9516-9d857e0b853c {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Start _get_guest_xml network_info=[{"id": "e8604c7a-955c-4392-9516-9d857e0b853c", "address": "fa:16:3e:2b:c3:c5", "network": {"id": "8e5b686c-cd9a-4ac1-866b-24bdde0a8f6f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-307409530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de9fb210571447cdb6214d66f66a4d73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8604c7a-95", "ovs_interfaceid": "e8604c7a-955c-4392-9516-9d857e0b853c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 10:28:27 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:28:27 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:28:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-234596148',display_name='tempest-SnapshotDataIntegrityTests-server-234596148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-234596148',id=50,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECbWVudvJkfaq41Zuv1ODsOv99vUkO98pATFseINH94V1uNDF3kjirNBJCPxc4Hr7dtEiCIXynnmDNEHI/wegS73Bmhe4dzz8a/mdBfYJsHkmaV+ZOGdNnWzHyHTFc21w==',key_name='tempest-keypair-1374655736',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de9fb210571447cdb6214d66f66a4d73',ramdisk_id='',reservation_id='r-826rs0g0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1094472811',owner_user_name='tempest-SnapshotDataIntegrityTests-1094472811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:28:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c28bea56bdf44d8b485e09faa6f6f08',uuid=7fa98a0b-38b5-4414-a91a-825638eb22d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8604c7a-955c-4392-9516-9d857e0b853c", "address": "fa:16:3e:2b:c3:c5", "network": {"id": "8e5b686c-cd9a-4ac1-866b-24bdde0a8f6f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-307409530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de9fb210571447cdb6214d66f66a4d73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8604c7a-95", "ovs_interfaceid": "e8604c7a-955c-4392-9516-9d857e0b853c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Converting VIF {"id": "e8604c7a-955c-4392-9516-9d857e0b853c", "address": "fa:16:3e:2b:c3:c5", "network": {"id": "8e5b686c-cd9a-4ac1-866b-24bdde0a8f6f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-307409530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de9fb210571447cdb6214d66f66a4d73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8604c7a-95", "ovs_interfaceid": "e8604c7a-955c-4392-9516-9d857e0b853c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:c3:c5,bridge_name='br-int',has_traffic_filtering=True,id=e8604c7a-955c-4392-9516-9d857e0b853c,network=Network(8e5b686c-cd9a-4ac1-866b-24bdde0a8f6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8604c7a-95') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lazy-loading 'pci_devices' on Instance uuid 7fa98a0b-38b5-4414-a91a-825638eb22d5 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] End _get_guest_xml xml=<domain type="kvm">
Oct 16 10:28:27 user nova-compute[74342]:   <uuid>7fa98a0b-38b5-4414-a91a-825638eb22d5</uuid>
Oct 16 10:28:27 user nova-compute[74342]:   <name>instance-00000032</name>
Oct 16 10:28:27 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 10:28:27 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 10:28:27 user nova-compute[74342]:   <metadata>
Oct 16 10:28:27 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 10:28:27 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 10:28:27 user nova-compute[74342]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-234596148</nova:name>
Oct 16 10:28:27 user nova-compute[74342]:       <nova:creationTime>2023-10-16 10:28:27</nova:creationTime>
Oct 16 10:28:27 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 10:28:27 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 10:28:27 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 10:28:27 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 10:28:27 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 10:28:27 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 10:28:27 user nova-compute[74342]:       </nova:flavor>
Oct 16 10:28:27 user nova-compute[74342]:       <nova:owner>
Oct 16 10:28:27 user nova-compute[74342]:         <nova:user uuid="5c28bea56bdf44d8b485e09faa6f6f08">tempest-SnapshotDataIntegrityTests-1094472811-project-member</nova:user>
Oct 16 10:28:27 user nova-compute[74342]:         <nova:project uuid="de9fb210571447cdb6214d66f66a4d73">tempest-SnapshotDataIntegrityTests-1094472811</nova:project>
Oct 16 10:28:27 user nova-compute[74342]:       </nova:owner>
Oct 16 10:28:27 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 10:28:27 user nova-compute[74342]:       <nova:ports>
Oct 16 10:28:27 user nova-compute[74342]:         <nova:port uuid="e8604c7a-955c-4392-9516-9d857e0b853c">
Oct 16 10:28:27 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Oct 16 10:28:27 user nova-compute[74342]:         </nova:port>
Oct 16 10:28:27 user nova-compute[74342]:       </nova:ports>
Oct 16 10:28:27 user nova-compute[74342]:     </nova:instance>
Oct 16 10:28:27 user nova-compute[74342]:   </metadata>
Oct 16 10:28:27 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 10:28:27 user nova-compute[74342]:     <system>
Oct 16 10:28:27 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 10:28:27 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 10:28:27 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 10:28:27 user nova-compute[74342]:       <entry name="serial">7fa98a0b-38b5-4414-a91a-825638eb22d5</entry>
Oct 16 10:28:27 user nova-compute[74342]:       <entry name="uuid">7fa98a0b-38b5-4414-a91a-825638eb22d5</entry>
Oct 16 10:28:27 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 10:28:27 user nova-compute[74342]:     </system>
Oct 16 10:28:27 user nova-compute[74342]:   </sysinfo>
Oct 16 10:28:27 user nova-compute[74342]:   <os>
Oct 16 10:28:27 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 10:28:27 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 10:28:27 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 10:28:27 user nova-compute[74342]:   </os>
Oct 16 10:28:27 user nova-compute[74342]:   <features>
Oct 16 10:28:27 user nova-compute[74342]:     <acpi/>
Oct 16 10:28:27 user nova-compute[74342]:     <apic/>
Oct 16 10:28:27 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 10:28:27 user nova-compute[74342]:   </features>
Oct 16 10:28:27 user nova-compute[74342]:   <clock offset="utc">
Oct 16 10:28:27 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 10:28:27 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 10:28:27 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 10:28:27 user nova-compute[74342]:   </clock>
Oct 16 10:28:27 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 10:28:27 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 10:28:27 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 10:28:27 user nova-compute[74342]:   </cpu>
Oct 16 10:28:27 user nova-compute[74342]:   <devices>
Oct 16 10:28:27 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 10:28:27 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 10:28:27 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk"/>
Oct 16 10:28:27 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 10:28:27 user nova-compute[74342]:     </disk>
Oct 16 10:28:27 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 10:28:27 user nova-compute[74342]:       <mac address="fa:16:3e:2b:c3:c5"/>
Oct 16 10:28:27 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:28:27 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 10:28:27 user nova-compute[74342]:       <target dev="tape8604c7a-95"/>
Oct 16 10:28:27 user nova-compute[74342]:     </interface>
Oct 16 10:28:27 user nova-compute[74342]:     <serial type="pty">
Oct 16 10:28:27 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/console.log" append="off"/>
Oct 16 10:28:27 user nova-compute[74342]:     </serial>
Oct 16 10:28:27 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 10:28:27 user nova-compute[74342]:     <video>
Oct 16 10:28:27 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:28:27 user nova-compute[74342]:     </video>
Oct 16 10:28:27 user nova-compute[74342]:     <rng model="virtio">
Oct 16 10:28:27 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 10:28:27 user nova-compute[74342]:     </rng>
Oct 16 10:28:27 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 10:28:27 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 10:28:27 user nova-compute[74342]:       <stats period="10"/>
Oct 16 10:28:27 user nova-compute[74342]:     </memballoon>
Oct 16 10:28:27 user nova-compute[74342]:   </devices>
Oct 16 10:28:27 user nova-compute[74342]: </domain>
Oct 16 10:28:27 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:28:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-234596148',display_name='tempest-SnapshotDataIntegrityTests-server-234596148',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-234596148',id=50,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECbWVudvJkfaq41Zuv1ODsOv99vUkO98pATFseINH94V1uNDF3kjirNBJCPxc4Hr7dtEiCIXynnmDNEHI/wegS73Bmhe4dzz8a/mdBfYJsHkmaV+ZOGdNnWzHyHTFc21w==',key_name='tempest-keypair-1374655736',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='de9fb210571447cdb6214d66f66a4d73',ramdisk_id='',reservation_id='r-826rs0g0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1094472811',owner_user_name='tempest-SnapshotDataIntegrityTests-1094472811-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:28:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c28bea56bdf44d8b485e09faa6f6f08',uuid=7fa98a0b-38b5-4414-a91a-825638eb22d5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e8604c7a-955c-4392-9516-9d857e0b853c", "address": "fa:16:3e:2b:c3:c5", "network": {"id": "8e5b686c-cd9a-4ac1-866b-24bdde0a8f6f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-307409530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de9fb210571447cdb6214d66f66a4d73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8604c7a-95", "ovs_interfaceid": "e8604c7a-955c-4392-9516-9d857e0b853c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Converting VIF {"id": "e8604c7a-955c-4392-9516-9d857e0b853c", "address": "fa:16:3e:2b:c3:c5", "network": {"id": "8e5b686c-cd9a-4ac1-866b-24bdde0a8f6f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-307409530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de9fb210571447cdb6214d66f66a4d73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8604c7a-95", "ovs_interfaceid": "e8604c7a-955c-4392-9516-9d857e0b853c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2b:c3:c5,bridge_name='br-int',has_traffic_filtering=True,id=e8604c7a-955c-4392-9516-9d857e0b853c,network=Network(8e5b686c-cd9a-4ac1-866b-24bdde0a8f6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8604c7a-95') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG os_vif [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:c3:c5,bridge_name='br-int',has_traffic_filtering=True,id=e8604c7a-955c-4392-9516-9d857e0b853c,network=Network(8e5b686c-cd9a-4ac1-866b-24bdde0a8f6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8604c7a-95') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8b509555-dd26-5786-8e28-f0075c85735e', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape8604c7a-95, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape8604c7a-95, col_values=(('qos', UUID('343e80ed-e36c-4a71-b9bf-6f69e9d7e82a')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape8604c7a-95, col_values=(('external_ids', {'iface-id': 'e8604c7a-955c-4392-9516-9d857e0b853c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2b:c3:c5', 'vm-uuid': '7fa98a0b-38b5-4414-a91a-825638eb22d5'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:27 user nova-compute[74342]: INFO os_vif [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2b:c3:c5,bridge_name='br-int',has_traffic_filtering=True,id=e8604c7a-955c-4392-9516-9d857e0b853c,network=Network(8e5b686c-cd9a-4ac1-866b-24bdde0a8f6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8604c7a-95')
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:28:27 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] No VIF found with MAC fa:16:3e:2b:c3:c5, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:28:28 user nova-compute[74342]: DEBUG nova.network.neutron [req-a619e757-3b13-4e6d-80ce-cd1905fe197d req-f8cb885f-f56c-4c56-876c-6b6681b312ac service nova] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Updated VIF entry in instance network info cache for port e8604c7a-955c-4392-9516-9d857e0b853c. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:28:28 user nova-compute[74342]: DEBUG nova.network.neutron [req-a619e757-3b13-4e6d-80ce-cd1905fe197d req-f8cb885f-f56c-4c56-876c-6b6681b312ac service nova] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Updating instance_info_cache with network_info: [{"id": "e8604c7a-955c-4392-9516-9d857e0b853c", "address": "fa:16:3e:2b:c3:c5", "network": {"id": "8e5b686c-cd9a-4ac1-866b-24bdde0a8f6f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-307409530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de9fb210571447cdb6214d66f66a4d73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8604c7a-95", "ovs_interfaceid": "e8604c7a-955c-4392-9516-9d857e0b853c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:28:28 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a619e757-3b13-4e6d-80ce-cd1905fe197d req-f8cb885f-f56c-4c56-876c-6b6681b312ac service nova] Releasing lock "refresh_cache-7fa98a0b-38b5-4414-a91a-825638eb22d5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:28:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:29 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:28:29 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:28:29 user nova-compute[74342]: DEBUG nova.compute.manager [req-980cc56f-6e55-4361-9415-6841c5c75c4e req-e4c87f40-1a47-41cd-ac05-fe2c6c8475c3 service nova] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Received event network-vif-plugged-e8604c7a-955c-4392-9516-9d857e0b853c {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:28:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-980cc56f-6e55-4361-9415-6841c5c75c4e req-e4c87f40-1a47-41cd-ac05-fe2c6c8475c3 service nova] Acquiring lock "7fa98a0b-38b5-4414-a91a-825638eb22d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:28:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-980cc56f-6e55-4361-9415-6841c5c75c4e req-e4c87f40-1a47-41cd-ac05-fe2c6c8475c3 service nova] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:28:29 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-980cc56f-6e55-4361-9415-6841c5c75c4e req-e4c87f40-1a47-41cd-ac05-fe2c6c8475c3 service nova] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:28:29 user nova-compute[74342]: DEBUG nova.compute.manager [req-980cc56f-6e55-4361-9415-6841c5c75c4e req-e4c87f40-1a47-41cd-ac05-fe2c6c8475c3 service nova] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] No waiting events found dispatching network-vif-plugged-e8604c7a-955c-4392-9516-9d857e0b853c {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:28:29 user nova-compute[74342]: WARNING nova.compute.manager [req-980cc56f-6e55-4361-9415-6841c5c75c4e req-e4c87f40-1a47-41cd-ac05-fe2c6c8475c3 service nova] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Received unexpected event network-vif-plugged-e8604c7a-955c-4392-9516-9d857e0b853c for instance with vm_state building and task_state spawning.
Oct 16 10:28:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:30 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:28:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:28:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:28:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:28:30 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:28:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:28:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:28:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:28:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:28:31 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:28:31 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:28:31 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=9065MB free_disk=25.000144958496094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:28:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:28:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:28:31 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:28:31 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:28:31 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:28:31 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:28:31 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:28:31 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:28:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:28:31 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 10:28:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 10:28:31 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Instance spawned successfully.
Oct 16 10:28:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 10:28:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:28:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:28:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:28:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:28:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:28:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:28:31 user nova-compute[74342]: DEBUG nova.compute.manager [req-c953f83f-bfad-4a0e-b9b4-e48985925434 req-fb214901-0e00-4cfe-a79e-2f02f9dac49d service nova] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Received event network-vif-plugged-e8604c7a-955c-4392-9516-9d857e0b853c {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:28:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c953f83f-bfad-4a0e-b9b4-e48985925434 req-fb214901-0e00-4cfe-a79e-2f02f9dac49d service nova] Acquiring lock "7fa98a0b-38b5-4414-a91a-825638eb22d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:28:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c953f83f-bfad-4a0e-b9b4-e48985925434 req-fb214901-0e00-4cfe-a79e-2f02f9dac49d service nova] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:28:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-c953f83f-bfad-4a0e-b9b4-e48985925434 req-fb214901-0e00-4cfe-a79e-2f02f9dac49d service nova] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:28:31 user nova-compute[74342]: DEBUG nova.compute.manager [req-c953f83f-bfad-4a0e-b9b4-e48985925434 req-fb214901-0e00-4cfe-a79e-2f02f9dac49d service nova] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] No waiting events found dispatching network-vif-plugged-e8604c7a-955c-4392-9516-9d857e0b853c {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:28:31 user nova-compute[74342]: WARNING nova.compute.manager [req-c953f83f-bfad-4a0e-b9b4-e48985925434 req-fb214901-0e00-4cfe-a79e-2f02f9dac49d service nova] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Received unexpected event network-vif-plugged-e8604c7a-955c-4392-9516-9d857e0b853c for instance with vm_state building and task_state spawning.
Oct 16 10:28:31 user nova-compute[74342]: INFO nova.compute.manager [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Took 5.38 seconds to spawn the instance on the hypervisor.
Oct 16 10:28:31 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:28:31 user nova-compute[74342]: INFO nova.compute.manager [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Took 5.97 seconds to build instance.
Oct 16 10:28:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fbd2fdeb-4c25-4908-8c27-a1098bfcc2b2 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.062s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:28:32 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:28:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:33 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:28:33 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:28:33 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Rebuilding the list of instances to heal {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 10:28:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-7fa98a0b-38b5-4414-a91a-825638eb22d5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:28:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-7fa98a0b-38b5-4414-a91a-825638eb22d5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:28:33 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:28:33 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lazy-loading 'info_cache' on Instance uuid 7fa98a0b-38b5-4414-a91a-825638eb22d5 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:28:33 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Updating instance_info_cache with network_info: [{"id": "e8604c7a-955c-4392-9516-9d857e0b853c", "address": "fa:16:3e:2b:c3:c5", "network": {"id": "8e5b686c-cd9a-4ac1-866b-24bdde0a8f6f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-307409530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de9fb210571447cdb6214d66f66a4d73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8604c7a-95", "ovs_interfaceid": "e8604c7a-955c-4392-9516-9d857e0b853c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:28:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-7fa98a0b-38b5-4414-a91a-825638eb22d5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:28:33 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:28:33 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:28:33 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:28:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:35 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:28:35 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:28:36 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:28:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:28:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:28:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:23 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:29:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:29:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:29:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:29:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:29:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:29 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:29:30 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:29:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:29:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:29:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:29:30 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:29:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:29:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:29:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:29:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:29:31 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:29:31 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:29:31 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8994MB free_disk=24.97011947631836GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:29:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:29:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:29:31 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:29:31 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:29:31 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:29:31 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:29:31 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:29:31 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:29:31 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.253s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:29:32 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:29:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:33 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:29:33 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:29:33 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Rebuilding the list of instances to heal {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 10:29:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-7fa98a0b-38b5-4414-a91a-825638eb22d5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:29:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-7fa98a0b-38b5-4414-a91a-825638eb22d5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:29:33 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:29:33 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lazy-loading 'info_cache' on Instance uuid 7fa98a0b-38b5-4414-a91a-825638eb22d5 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:29:33 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Updating instance_info_cache with network_info: [{"id": "e8604c7a-955c-4392-9516-9d857e0b853c", "address": "fa:16:3e:2b:c3:c5", "network": {"id": "8e5b686c-cd9a-4ac1-866b-24bdde0a8f6f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-307409530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de9fb210571447cdb6214d66f66a4d73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8604c7a-95", "ovs_interfaceid": "e8604c7a-955c-4392-9516-9d857e0b853c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:29:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-7fa98a0b-38b5-4414-a91a-825638eb22d5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:29:33 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:29:33 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:29:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "2ccac63c-d004-4063-b65a-b792edc79d06" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:29:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "2ccac63c-d004-4063-b65a-b792edc79d06" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:29:34 user nova-compute[74342]: DEBUG nova.compute.manager [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 10:29:34 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:29:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:29:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:29:34 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 10:29:34 user nova-compute[74342]: INFO nova.compute.claims [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Claim successful on node user
Oct 16 10:29:34 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:29:34 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:29:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.207s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:29:34 user nova-compute[74342]: DEBUG nova.compute.manager [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 10:29:34 user nova-compute[74342]: DEBUG nova.compute.manager [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 10:29:34 user nova-compute[74342]: DEBUG nova.network.neutron [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 10:29:34 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 10:29:34 user nova-compute[74342]: DEBUG nova.compute.manager [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 10:29:34 user nova-compute[74342]: DEBUG nova.policy [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b08b694b7ec45ab9f208b01ef1c833a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496a10bc096b4983bb728512bb41ac45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 10:29:34 user nova-compute[74342]: DEBUG nova.compute.manager [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 10:29:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 10:29:34 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Creating image(s)
Oct 16 10:29:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "/opt/stack/data/nova/instances/2ccac63c-d004-4063-b65a-b792edc79d06/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:29:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "/opt/stack/data/nova/instances/2ccac63c-d004-4063-b65a-b792edc79d06/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:29:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "/opt/stack/data/nova/instances/2ccac63c-d004-4063-b65a-b792edc79d06/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:29:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:29:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.174s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:29:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:29:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:29:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:29:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.171s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:29:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/2ccac63c-d004-4063-b65a-b792edc79d06/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:29:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/2ccac63c-d004-4063-b65a-b792edc79d06/disk 1073741824" returned: 0 in 0.046s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:29:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.224s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:29:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:29:35 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:29:35 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:29:35 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:29:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.171s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:29:35 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2ccac63c-d004-4063-b65a-b792edc79d06/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 10:29:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccac63c-d004-4063-b65a-b792edc79d06/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:29:35 user nova-compute[74342]: DEBUG nova.network.neutron [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Successfully created port: 62f01d95-791e-4e38-a05f-5edddc89e86d {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 10:29:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccac63c-d004-4063-b65a-b792edc79d06/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:29:35 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Cannot resize image /opt/stack/data/nova/instances/2ccac63c-d004-4063-b65a-b792edc79d06/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 10:29:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 10:29:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Ensure instance console log exists: /opt/stack/data/nova/instances/2ccac63c-d004-4063-b65a-b792edc79d06/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 10:29:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:29:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:29:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.network.neutron [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Successfully updated port: 62f01d95-791e-4e38-a05f-5edddc89e86d {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "refresh_cache-2ccac63c-d004-4063-b65a-b792edc79d06" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquired lock "refresh_cache-2ccac63c-d004-4063-b65a-b792edc79d06" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.network.neutron [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.network.neutron [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.compute.manager [req-d329803c-b8c9-4f45-9d1e-8f90208b8231 req-53a99956-3784-4f02-9713-38a934b9c888 service nova] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Received event network-changed-62f01d95-791e-4e38-a05f-5edddc89e86d {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.compute.manager [req-d329803c-b8c9-4f45-9d1e-8f90208b8231 req-53a99956-3784-4f02-9713-38a934b9c888 service nova] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Refreshing instance network info cache due to event network-changed-62f01d95-791e-4e38-a05f-5edddc89e86d. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d329803c-b8c9-4f45-9d1e-8f90208b8231 req-53a99956-3784-4f02-9713-38a934b9c888 service nova] Acquiring lock "refresh_cache-2ccac63c-d004-4063-b65a-b792edc79d06" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.network.neutron [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Updating instance_info_cache with network_info: [{"id": "62f01d95-791e-4e38-a05f-5edddc89e86d", "address": "fa:16:3e:d3:3b:e5", "network": {"id": "f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1742429158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496a10bc096b4983bb728512bb41ac45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f01d95-79", "ovs_interfaceid": "62f01d95-791e-4e38-a05f-5edddc89e86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Releasing lock "refresh_cache-2ccac63c-d004-4063-b65a-b792edc79d06" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.compute.manager [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Instance network_info: |[{"id": "62f01d95-791e-4e38-a05f-5edddc89e86d", "address": "fa:16:3e:d3:3b:e5", "network": {"id": "f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1742429158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496a10bc096b4983bb728512bb41ac45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f01d95-79", "ovs_interfaceid": "62f01d95-791e-4e38-a05f-5edddc89e86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d329803c-b8c9-4f45-9d1e-8f90208b8231 req-53a99956-3784-4f02-9713-38a934b9c888 service nova] Acquired lock "refresh_cache-2ccac63c-d004-4063-b65a-b792edc79d06" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.network.neutron [req-d329803c-b8c9-4f45-9d1e-8f90208b8231 req-53a99956-3784-4f02-9713-38a934b9c888 service nova] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Refreshing network info cache for port 62f01d95-791e-4e38-a05f-5edddc89e86d {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Start _get_guest_xml network_info=[{"id": "62f01d95-791e-4e38-a05f-5edddc89e86d", "address": "fa:16:3e:d3:3b:e5", "network": {"id": "f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1742429158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496a10bc096b4983bb728512bb41ac45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f01d95-79", "ovs_interfaceid": "62f01d95-791e-4e38-a05f-5edddc89e86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 10:29:36 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:29:36 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:29:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1446564129',display_name='tempest-VolumesSnapshotTestJSON-instance-1446564129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1446564129',id=51,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxCAHNR8/0c1K78QNBuboPBXMUTipSzucscplF+8JCj0Q7OtjuihSzS69ODGSOqrGw5qg5pda3E3gLBvruJ/FRMllnfRgPYtxWUVzrxQrjmch6WWbdRPy2MqwmfCWp+MA==',key_name='tempest-keypair-2043871561',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='496a10bc096b4983bb728512bb41ac45',ramdisk_id='',reservation_id='r-h2c026t3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1850096802',owner_user_name='tempest-VolumesSnapshotTestJSON-1850096802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:29:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b08b694b7ec45ab9f208b01ef1c833a',uuid=2ccac63c-d004-4063-b65a-b792edc79d06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62f01d95-791e-4e38-a05f-5edddc89e86d", "address": "fa:16:3e:d3:3b:e5", "network": {"id": "f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1742429158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496a10bc096b4983bb728512bb41ac45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f01d95-79", "ovs_interfaceid": "62f01d95-791e-4e38-a05f-5edddc89e86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Converting VIF {"id": "62f01d95-791e-4e38-a05f-5edddc89e86d", "address": "fa:16:3e:d3:3b:e5", "network": {"id": "f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1742429158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496a10bc096b4983bb728512bb41ac45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f01d95-79", "ovs_interfaceid": "62f01d95-791e-4e38-a05f-5edddc89e86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:3b:e5,bridge_name='br-int',has_traffic_filtering=True,id=62f01d95-791e-4e38-a05f-5edddc89e86d,network=Network(f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62f01d95-79') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.objects.instance [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lazy-loading 'pci_devices' on Instance uuid 2ccac63c-d004-4063-b65a-b792edc79d06 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] End _get_guest_xml xml=<domain type="kvm">
Oct 16 10:29:36 user nova-compute[74342]:   <uuid>2ccac63c-d004-4063-b65a-b792edc79d06</uuid>
Oct 16 10:29:36 user nova-compute[74342]:   <name>instance-00000033</name>
Oct 16 10:29:36 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 10:29:36 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 10:29:36 user nova-compute[74342]:   <metadata>
Oct 16 10:29:36 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 10:29:36 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 10:29:36 user nova-compute[74342]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1446564129</nova:name>
Oct 16 10:29:36 user nova-compute[74342]:       <nova:creationTime>2023-10-16 10:29:36</nova:creationTime>
Oct 16 10:29:36 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 10:29:36 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 10:29:36 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 10:29:36 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 10:29:36 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 10:29:36 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 10:29:36 user nova-compute[74342]:       </nova:flavor>
Oct 16 10:29:36 user nova-compute[74342]:       <nova:owner>
Oct 16 10:29:36 user nova-compute[74342]:         <nova:user uuid="3b08b694b7ec45ab9f208b01ef1c833a">tempest-VolumesSnapshotTestJSON-1850096802-project-member</nova:user>
Oct 16 10:29:36 user nova-compute[74342]:         <nova:project uuid="496a10bc096b4983bb728512bb41ac45">tempest-VolumesSnapshotTestJSON-1850096802</nova:project>
Oct 16 10:29:36 user nova-compute[74342]:       </nova:owner>
Oct 16 10:29:36 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 10:29:36 user nova-compute[74342]:       <nova:ports>
Oct 16 10:29:36 user nova-compute[74342]:         <nova:port uuid="62f01d95-791e-4e38-a05f-5edddc89e86d">
Oct 16 10:29:36 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Oct 16 10:29:36 user nova-compute[74342]:         </nova:port>
Oct 16 10:29:36 user nova-compute[74342]:       </nova:ports>
Oct 16 10:29:36 user nova-compute[74342]:     </nova:instance>
Oct 16 10:29:36 user nova-compute[74342]:   </metadata>
Oct 16 10:29:36 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 10:29:36 user nova-compute[74342]:     <system>
Oct 16 10:29:36 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 10:29:36 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 10:29:36 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 10:29:36 user nova-compute[74342]:       <entry name="serial">2ccac63c-d004-4063-b65a-b792edc79d06</entry>
Oct 16 10:29:36 user nova-compute[74342]:       <entry name="uuid">2ccac63c-d004-4063-b65a-b792edc79d06</entry>
Oct 16 10:29:36 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 10:29:36 user nova-compute[74342]:     </system>
Oct 16 10:29:36 user nova-compute[74342]:   </sysinfo>
Oct 16 10:29:36 user nova-compute[74342]:   <os>
Oct 16 10:29:36 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 10:29:36 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 10:29:36 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 10:29:36 user nova-compute[74342]:   </os>
Oct 16 10:29:36 user nova-compute[74342]:   <features>
Oct 16 10:29:36 user nova-compute[74342]:     <acpi/>
Oct 16 10:29:36 user nova-compute[74342]:     <apic/>
Oct 16 10:29:36 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 10:29:36 user nova-compute[74342]:   </features>
Oct 16 10:29:36 user nova-compute[74342]:   <clock offset="utc">
Oct 16 10:29:36 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 10:29:36 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 10:29:36 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 10:29:36 user nova-compute[74342]:   </clock>
Oct 16 10:29:36 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 10:29:36 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 10:29:36 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 10:29:36 user nova-compute[74342]:   </cpu>
Oct 16 10:29:36 user nova-compute[74342]:   <devices>
Oct 16 10:29:36 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 10:29:36 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 10:29:36 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/2ccac63c-d004-4063-b65a-b792edc79d06/disk"/>
Oct 16 10:29:36 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 10:29:36 user nova-compute[74342]:     </disk>
Oct 16 10:29:36 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 10:29:36 user nova-compute[74342]:       <mac address="fa:16:3e:d3:3b:e5"/>
Oct 16 10:29:36 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:29:36 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 10:29:36 user nova-compute[74342]:       <target dev="tap62f01d95-79"/>
Oct 16 10:29:36 user nova-compute[74342]:     </interface>
Oct 16 10:29:36 user nova-compute[74342]:     <serial type="pty">
Oct 16 10:29:36 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/2ccac63c-d004-4063-b65a-b792edc79d06/console.log" append="off"/>
Oct 16 10:29:36 user nova-compute[74342]:     </serial>
Oct 16 10:29:36 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 10:29:36 user nova-compute[74342]:     <video>
Oct 16 10:29:36 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:29:36 user nova-compute[74342]:     </video>
Oct 16 10:29:36 user nova-compute[74342]:     <rng model="virtio">
Oct 16 10:29:36 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 10:29:36 user nova-compute[74342]:     </rng>
Oct 16 10:29:36 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 10:29:36 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 10:29:36 user nova-compute[74342]:       <stats period="10"/>
Oct 16 10:29:36 user nova-compute[74342]:     </memballoon>
Oct 16 10:29:36 user nova-compute[74342]:   </devices>
Oct 16 10:29:36 user nova-compute[74342]: </domain>
Oct 16 10:29:36 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:29:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1446564129',display_name='tempest-VolumesSnapshotTestJSON-instance-1446564129',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1446564129',id=51,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxCAHNR8/0c1K78QNBuboPBXMUTipSzucscplF+8JCj0Q7OtjuihSzS69ODGSOqrGw5qg5pda3E3gLBvruJ/FRMllnfRgPYtxWUVzrxQrjmch6WWbdRPy2MqwmfCWp+MA==',key_name='tempest-keypair-2043871561',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='496a10bc096b4983bb728512bb41ac45',ramdisk_id='',reservation_id='r-h2c026t3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1850096802',owner_user_name='tempest-VolumesSnapshotTestJSON-1850096802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:29:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b08b694b7ec45ab9f208b01ef1c833a',uuid=2ccac63c-d004-4063-b65a-b792edc79d06,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "62f01d95-791e-4e38-a05f-5edddc89e86d", "address": "fa:16:3e:d3:3b:e5", "network": {"id": "f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1742429158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496a10bc096b4983bb728512bb41ac45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f01d95-79", "ovs_interfaceid": "62f01d95-791e-4e38-a05f-5edddc89e86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Converting VIF {"id": "62f01d95-791e-4e38-a05f-5edddc89e86d", "address": "fa:16:3e:d3:3b:e5", "network": {"id": "f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1742429158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496a10bc096b4983bb728512bb41ac45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f01d95-79", "ovs_interfaceid": "62f01d95-791e-4e38-a05f-5edddc89e86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:3b:e5,bridge_name='br-int',has_traffic_filtering=True,id=62f01d95-791e-4e38-a05f-5edddc89e86d,network=Network(f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62f01d95-79') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG os_vif [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:3b:e5,bridge_name='br-int',has_traffic_filtering=True,id=62f01d95-791e-4e38-a05f-5edddc89e86d,network=Network(f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62f01d95-79') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '72c76a88-74b6-5233-b012-cc45e0c3eba0', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap62f01d95-79, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap62f01d95-79, col_values=(('qos', UUID('00b4e08c-e9b4-4463-939a-22aee9599202')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap62f01d95-79, col_values=(('external_ids', {'iface-id': '62f01d95-791e-4e38-a05f-5edddc89e86d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:3b:e5', 'vm-uuid': '2ccac63c-d004-4063-b65a-b792edc79d06'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:36 user nova-compute[74342]: INFO os_vif [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:3b:e5,bridge_name='br-int',has_traffic_filtering=True,id=62f01d95-791e-4e38-a05f-5edddc89e86d,network=Network(f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62f01d95-79')
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] No VIF found with MAC fa:16:3e:d3:3b:e5, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.network.neutron [req-d329803c-b8c9-4f45-9d1e-8f90208b8231 req-53a99956-3784-4f02-9713-38a934b9c888 service nova] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Updated VIF entry in instance network info cache for port 62f01d95-791e-4e38-a05f-5edddc89e86d. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG nova.network.neutron [req-d329803c-b8c9-4f45-9d1e-8f90208b8231 req-53a99956-3784-4f02-9713-38a934b9c888 service nova] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Updating instance_info_cache with network_info: [{"id": "62f01d95-791e-4e38-a05f-5edddc89e86d", "address": "fa:16:3e:d3:3b:e5", "network": {"id": "f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1742429158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496a10bc096b4983bb728512bb41ac45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f01d95-79", "ovs_interfaceid": "62f01d95-791e-4e38-a05f-5edddc89e86d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:29:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d329803c-b8c9-4f45-9d1e-8f90208b8231 req-53a99956-3784-4f02-9713-38a934b9c888 service nova] Releasing lock "refresh_cache-2ccac63c-d004-4063-b65a-b792edc79d06" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:29:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:38 user nova-compute[74342]: DEBUG nova.compute.manager [req-a1c6150f-b48d-497f-ab70-8085d95e34b6 req-d0e7a7f5-4fed-44f2-9394-d0eb60e11600 service nova] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Received event network-vif-plugged-62f01d95-791e-4e38-a05f-5edddc89e86d {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:29:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a1c6150f-b48d-497f-ab70-8085d95e34b6 req-d0e7a7f5-4fed-44f2-9394-d0eb60e11600 service nova] Acquiring lock "2ccac63c-d004-4063-b65a-b792edc79d06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:29:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a1c6150f-b48d-497f-ab70-8085d95e34b6 req-d0e7a7f5-4fed-44f2-9394-d0eb60e11600 service nova] Lock "2ccac63c-d004-4063-b65a-b792edc79d06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:29:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-a1c6150f-b48d-497f-ab70-8085d95e34b6 req-d0e7a7f5-4fed-44f2-9394-d0eb60e11600 service nova] Lock "2ccac63c-d004-4063-b65a-b792edc79d06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:29:38 user nova-compute[74342]: DEBUG nova.compute.manager [req-a1c6150f-b48d-497f-ab70-8085d95e34b6 req-d0e7a7f5-4fed-44f2-9394-d0eb60e11600 service nova] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] No waiting events found dispatching network-vif-plugged-62f01d95-791e-4e38-a05f-5edddc89e86d {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:29:38 user nova-compute[74342]: WARNING nova.compute.manager [req-a1c6150f-b48d-497f-ab70-8085d95e34b6 req-d0e7a7f5-4fed-44f2-9394-d0eb60e11600 service nova] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Received unexpected event network-vif-plugged-62f01d95-791e-4e38-a05f-5edddc89e86d for instance with vm_state building and task_state spawning.
Oct 16 10:29:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:39 user nova-compute[74342]: DEBUG nova.compute.manager [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 10:29:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 10:29:39 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Instance spawned successfully.
Oct 16 10:29:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 10:29:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:29:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:29:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:29:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:29:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:29:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:29:40 user nova-compute[74342]: INFO nova.compute.manager [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Took 5.23 seconds to spawn the instance on the hypervisor.
Oct 16 10:29:40 user nova-compute[74342]: DEBUG nova.compute.manager [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:29:40 user nova-compute[74342]: INFO nova.compute.manager [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Took 5.79 seconds to build instance.
Oct 16 10:29:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-43285966-e3f5-4321-8419-d904bc3e0a2b tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "2ccac63c-d004-4063-b65a-b792edc79d06" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.949s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:29:40 user nova-compute[74342]: DEBUG nova.compute.manager [req-ad4d5afd-c349-45c9-a29a-fcab928bb672 req-01d6d489-2e0c-4eb0-bedf-64839f3b7cd9 service nova] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Received event network-vif-plugged-62f01d95-791e-4e38-a05f-5edddc89e86d {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:29:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ad4d5afd-c349-45c9-a29a-fcab928bb672 req-01d6d489-2e0c-4eb0-bedf-64839f3b7cd9 service nova] Acquiring lock "2ccac63c-d004-4063-b65a-b792edc79d06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:29:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ad4d5afd-c349-45c9-a29a-fcab928bb672 req-01d6d489-2e0c-4eb0-bedf-64839f3b7cd9 service nova] Lock "2ccac63c-d004-4063-b65a-b792edc79d06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:29:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-ad4d5afd-c349-45c9-a29a-fcab928bb672 req-01d6d489-2e0c-4eb0-bedf-64839f3b7cd9 service nova] Lock "2ccac63c-d004-4063-b65a-b792edc79d06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:29:40 user nova-compute[74342]: DEBUG nova.compute.manager [req-ad4d5afd-c349-45c9-a29a-fcab928bb672 req-01d6d489-2e0c-4eb0-bedf-64839f3b7cd9 service nova] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] No waiting events found dispatching network-vif-plugged-62f01d95-791e-4e38-a05f-5edddc89e86d {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:29:40 user nova-compute[74342]: WARNING nova.compute.manager [req-ad4d5afd-c349-45c9-a29a-fcab928bb672 req-01d6d489-2e0c-4eb0-bedf-64839f3b7cd9 service nova] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Received unexpected event network-vif-plugged-62f01d95-791e-4e38-a05f-5edddc89e86d for instance with vm_state active and task_state None.
Oct 16 10:29:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:29:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:30:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:30:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:30:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:30:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:30:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:30:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:30:17 user nova-compute[74342]: DEBUG nova.compute.manager [req-f6202b84-ff51-4762-8029-194f05886b00 req-cfb1886d-dccc-4b87-9756-80469b82d2d5 service nova] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Received event network-changed-e8604c7a-955c-4392-9516-9d857e0b853c {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:30:17 user nova-compute[74342]: DEBUG nova.compute.manager [req-f6202b84-ff51-4762-8029-194f05886b00 req-cfb1886d-dccc-4b87-9756-80469b82d2d5 service nova] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Refreshing instance network info cache due to event network-changed-e8604c7a-955c-4392-9516-9d857e0b853c. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:30:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f6202b84-ff51-4762-8029-194f05886b00 req-cfb1886d-dccc-4b87-9756-80469b82d2d5 service nova] Acquiring lock "refresh_cache-7fa98a0b-38b5-4414-a91a-825638eb22d5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:30:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f6202b84-ff51-4762-8029-194f05886b00 req-cfb1886d-dccc-4b87-9756-80469b82d2d5 service nova] Acquired lock "refresh_cache-7fa98a0b-38b5-4414-a91a-825638eb22d5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:30:17 user nova-compute[74342]: DEBUG nova.network.neutron [req-f6202b84-ff51-4762-8029-194f05886b00 req-cfb1886d-dccc-4b87-9756-80469b82d2d5 service nova] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Refreshing network info cache for port e8604c7a-955c-4392-9516-9d857e0b853c {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:30:17 user nova-compute[74342]: DEBUG nova.network.neutron [req-f6202b84-ff51-4762-8029-194f05886b00 req-cfb1886d-dccc-4b87-9756-80469b82d2d5 service nova] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Updated VIF entry in instance network info cache for port e8604c7a-955c-4392-9516-9d857e0b853c. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:30:17 user nova-compute[74342]: DEBUG nova.network.neutron [req-f6202b84-ff51-4762-8029-194f05886b00 req-cfb1886d-dccc-4b87-9756-80469b82d2d5 service nova] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Updating instance_info_cache with network_info: [{"id": "e8604c7a-955c-4392-9516-9d857e0b853c", "address": "fa:16:3e:2b:c3:c5", "network": {"id": "8e5b686c-cd9a-4ac1-866b-24bdde0a8f6f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-307409530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de9fb210571447cdb6214d66f66a4d73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8604c7a-95", "ovs_interfaceid": "e8604c7a-955c-4392-9516-9d857e0b853c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:30:17 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f6202b84-ff51-4762-8029-194f05886b00 req-cfb1886d-dccc-4b87-9756-80469b82d2d5 service nova] Releasing lock "refresh_cache-7fa98a0b-38b5-4414-a91a-825638eb22d5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:30:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:30:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:30:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:30:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:30:23 user nova-compute[74342]: DEBUG nova.objects.instance [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lazy-loading 'flavor' on Instance uuid 7fa98a0b-38b5-4414-a91a-825638eb22d5 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:30:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:30:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:30:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:30:23 user nova-compute[74342]: INFO nova.compute.manager [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Attaching volume b5f56dca-aea1-4954-8cf9-a7a802478d91 to /dev/vdb
Oct 16 10:30:23 user nova-compute[74342]: DEBUG os_brick.utils [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:30:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:30:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:30:23 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a404f94-5267-4584-924d-c31a63ab4dd4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:30:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:30:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:30:23 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4916fd0-f0de-460d-b2a2-712c4d145061]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:30:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:30:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:30:23 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a4511f0-cb79-4550-9490-5d107fd052bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:30:23 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[083d1981-607d-40a0-bb99-8a117245ec3a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:30:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:30:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:30:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 10:30:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:30:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:30:23 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 10:30:23 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba67ba4-4647-4a45-b57b-974a346b3bce]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:30:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 10:30:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 10:30:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 10:30:23 user nova-compute[74342]: DEBUG os_brick.utils [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:30:23 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Updating existing volume attachment record: 82d104d0-de04-43d1-a876-67c1c27afa82 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 10:30:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:30:25 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:30:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:30:31 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:30:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:30:32 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:30:32 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:30:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:30:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:30:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:30:32 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:30:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:30:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:30:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:30:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:30:32 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccac63c-d004-4063-b65a-b792edc79d06/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:30:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccac63c-d004-4063-b65a-b792edc79d06/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:30:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccac63c-d004-4063-b65a-b792edc79d06/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:30:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccac63c-d004-4063-b65a-b792edc79d06/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:30:33 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:30:33 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:30:33 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8873MB free_disk=24.940250396728516GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:30:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:30:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:30:33 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:30:33 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 2ccac63c-d004-4063-b65a-b792edc79d06 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:30:33 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:30:33 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:30:33 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:30:33 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:30:33 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:30:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.255s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:30:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:30:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:30:36 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:30:36 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:30:36 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Rebuilding the list of instances to heal {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 10:30:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-7fa98a0b-38b5-4414-a91a-825638eb22d5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:30:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-7fa98a0b-38b5-4414-a91a-825638eb22d5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:30:37 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:30:37 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lazy-loading 'info_cache' on Instance uuid 7fa98a0b-38b5-4414-a91a-825638eb22d5 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:30:37 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Updating instance_info_cache with network_info: [{"id": "e8604c7a-955c-4392-9516-9d857e0b853c", "address": "fa:16:3e:2b:c3:c5", "network": {"id": "8e5b686c-cd9a-4ac1-866b-24bdde0a8f6f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-307409530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de9fb210571447cdb6214d66f66a4d73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8604c7a-95", "ovs_interfaceid": "e8604c7a-955c-4392-9516-9d857e0b853c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:30:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-7fa98a0b-38b5-4414-a91a-825638eb22d5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:30:37 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:30:37 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:30:37 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:30:37 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:30:37 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:30:37 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:30:37 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:30:37 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74342) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 10:30:37 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:30:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:30:41 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Cleaning up deleted instances {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 10:30:41 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] There are 1 instances to clean {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 10:30:41 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Instance has had 5 of 5 cleanup attempts {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 16 10:30:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:30:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:30:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:30:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:30:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:30:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:30:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:30:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwIDZASx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:30:47 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:30:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:30:47 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:30:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:30:47 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91 -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cb19e2-5b34-4ed8-9c17-c8f0443ea780]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 10:30:47 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91 -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0aa23a5-e790-4de9-8c94-fe1c30ff9c1d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91] added
Oct 16 10:30:47 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfb9bda8-b680-4389-b5f7-7e0ada74c5d0]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[60c45724-edec-447e-8bec-2d153220ef14]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iwIDZASx {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iwIDZASx" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b50e057-2407-4fea-bde3-5df7f8d5088c]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iwIDZASx'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f282d860-08ce-4627-b877-5ec4bee3315d]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e77cfb5-6957-456b-9e12-596a8cafdfea]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 10:30:47 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 10:30:47 user nova-compute[74342]:  {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:30:47 user nova-compute[74342]: WARNING os_brick.initiator.connectors.iscsi [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 10:30:47 user nova-compute[74342]: 
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91 -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91 -p 172.16.0.220:3260 --login" returned: 0 in 0.041s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[db79aef9-b631-4003-9da9-4b24cd34cfc3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91, portal: 172.16.0.220,3260]
Oct 16 10:30:47 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91, portal: 172.16.0.220,3260] successful.
Oct 16 10:30:47 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[78bfb299-8de7-4aa7-a62d-fac0664b89ae]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fccd43d-5c24-403c-b021-db6dacc4936f]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91 (non-flash)
Oct 16 10:30:47 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91 (non-flash)
Oct 16 10:30:47 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.242s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] HCTL ('33', '-', '-', 0) found on session 44 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d3e2031-c364-44e3-b3b9-19b7d2f11a49]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Searching for a device in session 44 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 10:30:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwIDZASx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 10:30:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.274s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:30:48 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] <== connect_volume: return (1276ms) {'type': 'block', 'scsi_wwn': '23537623430623565', 'path': '/dev/sdb'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:30:48 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23537623430623565', 'path': '/dev/sdb'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 10:30:48 user nova-compute[74342]: DEBUG nova.objects.instance [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lazy-loading 'flavor' on Instance uuid 7fa98a0b-38b5-4414-a91a-825638eb22d5 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:30:48 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 10:30:48 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:30:48 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 10:30:48 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:30:48 user nova-compute[74342]:   <serial>b5f56dca-aea1-4954-8cf9-a7a802478d91</serial>
Oct 16 10:30:48 user nova-compute[74342]: </disk>
Oct 16 10:30:48 user nova-compute[74342]:  {{(pid=74342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 10:30:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:30:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:30:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:30:49 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] No VIF found with MAC fa:16:3e:2b:c3:c5, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:30:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-afe63cd4-3fb9-4d07-b219-b41771cb1074 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.024s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:30:50 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_power_states {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:30:50 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Triggering sync for uuid 7fa98a0b-38b5-4414-a91a-825638eb22d5 {{(pid=74342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 10:30:50 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Triggering sync for uuid 2ccac63c-d004-4063-b65a-b792edc79d06 {{(pid=74342) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10331}}
Oct 16 10:30:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:30:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:30:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "2ccac63c-d004-4063-b65a-b792edc79d06" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:30:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "2ccac63c-d004-4063-b65a-b792edc79d06" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:30:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "2ccac63c-d004-4063-b65a-b792edc79d06" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.027s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:30:50 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:30:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:30:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:30:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:31:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:31:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:31:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:31:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:31:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:31:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:31:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:31:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:31:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:31:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:31:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:31:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:31:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:31:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:31:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:31:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:31:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:31:19 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:31:19 user nova-compute[74342]: INFO nova.compute.manager [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Detaching volume b5f56dca-aea1-4954-8cf9-a7a802478d91
Oct 16 10:31:19 user nova-compute[74342]: INFO nova.virt.block_device [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Attempting to driver detach volume b5f56dca-aea1-4954-8cf9-a7a802478d91 from mountpoint /dev/vdb
Oct 16 10:31:19 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Attempting to detach device vdb from instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 from the persistent domain config. {{(pid=74342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 10:31:19 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 10:31:19 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:31:19 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 10:31:19 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:31:19 user nova-compute[74342]:   <serial>b5f56dca-aea1-4954-8cf9-a7a802478d91</serial>
Oct 16 10:31:19 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 10:31:19 user nova-compute[74342]: </disk>
Oct 16 10:31:19 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 10:31:19 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Successfully detached device vdb from instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 from the persistent domain config.
Oct 16 10:31:19 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 from the live domain config. {{(pid=74342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 10:31:19 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 10:31:19 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:31:19 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 10:31:19 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:31:19 user nova-compute[74342]:   <serial>b5f56dca-aea1-4954-8cf9-a7a802478d91</serial>
Oct 16 10:31:19 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 10:31:19 user nova-compute[74342]: </disk>
Oct 16 10:31:19 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 10:31:19 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 {{(pid=74342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 10:31:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:31:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:31:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:31:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:31:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:31:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG nova.compute.manager [req-4bdbfad4-197d-412f-a3aa-566269b5affb req-720f578b-ecfd-4afc-9823-9a46aff5d810 service nova] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Received event network-changed-62f01d95-791e-4e38-a05f-5edddc89e86d {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG nova.compute.manager [req-4bdbfad4-197d-412f-a3aa-566269b5affb req-720f578b-ecfd-4afc-9823-9a46aff5d810 service nova] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Refreshing instance network info cache due to event network-changed-62f01d95-791e-4e38-a05f-5edddc89e86d. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4bdbfad4-197d-412f-a3aa-566269b5affb req-720f578b-ecfd-4afc-9823-9a46aff5d810 service nova] Acquiring lock "refresh_cache-2ccac63c-d004-4063-b65a-b792edc79d06" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4bdbfad4-197d-412f-a3aa-566269b5affb req-720f578b-ecfd-4afc-9823-9a46aff5d810 service nova] Acquired lock "refresh_cache-2ccac63c-d004-4063-b65a-b792edc79d06" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG nova.network.neutron [req-4bdbfad4-197d-412f-a3aa-566269b5affb req-720f578b-ecfd-4afc-9823-9a46aff5d810 service nova] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Refreshing network info cache for port 62f01d95-791e-4e38-a05f-5edddc89e86d {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "2ccac63c-d004-4063-b65a-b792edc79d06" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "2ccac63c-d004-4063-b65a-b792edc79d06" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG nova.objects.instance [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lazy-loading 'flavor' on Instance uuid 2ccac63c-d004-4063-b65a-b792edc79d06 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:31:25 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Ignoring supplied device name: /dev/vdb
Oct 16 10:31:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "2ccac63c-d004-4063-b65a-b792edc79d06" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG nova.network.neutron [req-4bdbfad4-197d-412f-a3aa-566269b5affb req-720f578b-ecfd-4afc-9823-9a46aff5d810 service nova] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Updated VIF entry in instance network info cache for port 62f01d95-791e-4e38-a05f-5edddc89e86d. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG nova.network.neutron [req-4bdbfad4-197d-412f-a3aa-566269b5affb req-720f578b-ecfd-4afc-9823-9a46aff5d810 service nova] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Updating instance_info_cache with network_info: [{"id": "62f01d95-791e-4e38-a05f-5edddc89e86d", "address": "fa:16:3e:d3:3b:e5", "network": {"id": "f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1742429158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496a10bc096b4983bb728512bb41ac45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f01d95-79", "ovs_interfaceid": "62f01d95-791e-4e38-a05f-5edddc89e86d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-4bdbfad4-197d-412f-a3aa-566269b5affb req-720f578b-ecfd-4afc-9823-9a46aff5d810 service nova] Releasing lock "refresh_cache-2ccac63c-d004-4063-b65a-b792edc79d06" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "2ccac63c-d004-4063-b65a-b792edc79d06" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "2ccac63c-d004-4063-b65a-b792edc79d06" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:31:25 user nova-compute[74342]: INFO nova.compute.manager [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Attaching volume db9e6cd6-f39a-40f6-be68-13e8270bc876 to /dev/vdb
Oct 16 10:31:25 user nova-compute[74342]: DEBUG os_brick.utils [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d4ea5b-9368-433d-b97c-baba68c5f33d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f09ed1-1350-4b6b-84fc-ad3f95154742]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[086bdb0d-c41a-459b-a3ce-335cf132f482]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e126b7b-4d9b-4f66-b88e-02f0461db70d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:31:25 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 10:31:25 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[db18a80f-d40b-4359-8dc7-5efc1bc196b7]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG os_brick.utils [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:31:25 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Updating existing volume attachment record: 7ae96eea-16dd-422b-bed7-ec37df4438bb {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 10:31:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:31:27 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:31:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:31:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:31:32 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:31:33 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:31:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:31:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:31:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:31:33 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:31:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:31:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:31:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:31:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:31:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccac63c-d004-4063-b65a-b792edc79d06/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:31:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:31:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccac63c-d004-4063-b65a-b792edc79d06/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:31:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccac63c-d004-4063-b65a-b792edc79d06/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:31:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccac63c-d004-4063-b65a-b792edc79d06/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:31:34 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:31:34 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:31:34 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8900MB free_disk=24.938838958740234GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:31:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:31:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:31:34 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:31:34 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 2ccac63c-d004-4063-b65a-b792edc79d06 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:31:34 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:31:34 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:31:34 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Refreshing inventories for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 10:31:34 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Updating ProviderTree inventory for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 10:31:34 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Updating inventory in ProviderTree for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 10:31:34 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Refreshing aggregate associations for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca, aggregates: None {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 10:31:35 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Refreshing trait associations for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 10:31:35 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:31:35 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:31:35 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:31:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.467s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:31:36 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:31:36 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:31:36 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:31:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-2ccac63c-d004-4063-b65a-b792edc79d06" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:31:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-2ccac63c-d004-4063-b65a-b792edc79d06" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:31:36 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:31:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:31:37 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Updating instance_info_cache with network_info: [{"id": "62f01d95-791e-4e38-a05f-5edddc89e86d", "address": "fa:16:3e:d3:3b:e5", "network": {"id": "f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1742429158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496a10bc096b4983bb728512bb41ac45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f01d95-79", "ovs_interfaceid": "62f01d95-791e-4e38-a05f-5edddc89e86d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:31:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-2ccac63c-d004-4063-b65a-b792edc79d06" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:31:37 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:31:37 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:31:37 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:31:37 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:31:37 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:31:37 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:31:39 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 is timed out.
Oct 16 10:31:39 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Successfully detached device vdb from instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 from the live domain config.
Oct 16 10:31:39 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 10:31:39 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iwIDZASx', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:31:39 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:31:39 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:31:39 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:31:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:31:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:31:39 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[456fb4c0-60f9-4f82-8988-22968f8b33dd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:31:39 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 10:31:39 user nova-compute[74342]: No targets found.
Oct 16 10:31:39 user nova-compute[74342]: iSNS:
Oct 16 10:31:39 user nova-compute[74342]: No targets found.
Oct 16 10:31:39 user nova-compute[74342]: STATIC:
Oct 16 10:31:39 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91
Oct 16 10:31:39 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:31:39 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:31:39 user nova-compute[74342]: FIRMWARE:
Oct 16 10:31:39 user nova-compute[74342]: No targets found.
Oct 16 10:31:39 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:31:39 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 10:31:39 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 10:31:39 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 10:31:39 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 10:31:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:31:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:31:39 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdc82a2e-c5ba-4baf-9733-d08cb562a8c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:31:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:31:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:31:39 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9826224-30bf-47b7-8372-6b299e6e116e]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:31:39 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91 (non-flash)
Oct 16 10:31:39 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:31:39 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91 (non-flash)
Oct 16 10:31:39 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:31:39 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b83fd7370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91'): ({'sdb'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 10:31:39 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Removing single pathed devices sdb {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 10:31:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:31:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:31:39 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[81475aa0-96f1-4775-bd96-9d5df74a87ad]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:31:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:31:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:31:39 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e85379-e255-4826-9199-224791298f10]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:31:39 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Flushing IO for device /dev/sdb {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 10:31:39 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[215df6c8-f101-4933-97c9-4803ac9c5a71]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.048s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f74cab-9678-4c55-9c7f-92b908750c68]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7290a655-6bc2-469b-b43b-9b6f87a1ac9f]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91 -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1bb1ffd-cdc0-4150-9601-c50fdd249e9c]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91, portal: 172.16.0.220,3260]
Oct 16 10:31:40 user nova-compute[74342]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91, portal: 172.16.0.220,3260] successful.
Oct 16 10:31:40 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91 -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b5f56dca-aea1-4954-8cf9-a7a802478d91 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7940d5-cd9e-466c-8e02-c09f566e6972]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.289s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] <== disconnect_volume: return (291ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PvDKLzdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:31:40 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:31:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:31:40 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:31:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:31:40 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 10:31:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89d374d-d708-483a-af31-b321a75527b9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 10:31:40 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG nova.objects.instance [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lazy-loading 'flavor' on Instance uuid 7fa98a0b-38b5-4414-a91a-825638eb22d5 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfcd196-6b79-4e77-8039-ed2ec5004821]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876] added
Oct 16 10:31:40 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e78fc2b-ee45-43bb-a04a-3e6186f664ad]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-650faff9-06ef-4ae0-988b-e8bc8397e3df tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.653s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[37cc723f-34d4-4dd3-b1a8-e406e6e8ab9f]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:31:40 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PvDKLzdg {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PvDKLzdg" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec2e6e4-ba33-4eaa-816a-319df2e98615]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PvDKLzdg'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[600eb078-81b8-48de-b391-f4de1b88baa2]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc5adf9d-55c0-4cff-bd54-60520d587af8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 10:31:41 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 10:31:41 user nova-compute[74342]:  {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:31:41 user nova-compute[74342]: WARNING os_brick.initiator.connectors.iscsi [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 10:31:41 user nova-compute[74342]: 
Oct 16 10:31:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ece1ae0b-2a26-4df4-bc57-43bd328d65d8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876, portal: 172.16.0.220,3260]
Oct 16 10:31:41 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876, portal: 172.16.0.220,3260] successful.
Oct 16 10:31:41 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5f6872-f7c1-4e65-adae-7d6acb63b0fb]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[faefa023-6606-45eb-820c-3cdfe3aa1669]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 (non-flash)
Oct 16 10:31:41 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 (non-flash)
Oct 16 10:31:41 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8a1282-90e6-498b-8304-95d6c05202ac]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: None {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:31:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:31:42 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 10:31:42 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PvDKLzdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 10:31:42 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:31:42 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23765626163303134', 'path': '/dev/sdb'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:31:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23765626163303134', 'path': '/dev/sdb'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 10:31:42 user nova-compute[74342]: DEBUG nova.objects.instance [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lazy-loading 'flavor' on Instance uuid 2ccac63c-d004-4063-b65a-b792edc79d06 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:31:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 10:31:42 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:31:42 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 10:31:42 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:31:42 user nova-compute[74342]:   <serial>db9e6cd6-f39a-40f6-be68-13e8270bc876</serial>
Oct 16 10:31:42 user nova-compute[74342]: </disk>
Oct 16 10:31:42 user nova-compute[74342]:  {{(pid=74342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 10:31:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:31:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:31:42 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] No VIF found with MAC fa:16:3e:d3:3b:e5, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:31:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-8bd8fe82-a914-455b-8675-882ef039b040 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "2ccac63c-d004-4063-b65a-b792edc79d06" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 16.966s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:31:43 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:31:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:31:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:31:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:31:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:31:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:31:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:31:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:31:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:31:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:31:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:31:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:31:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:31:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:31:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:32:01 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:32:06 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:32:11 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:32:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:32:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:32:14 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lazy-loading 'flavor' on Instance uuid 7fa98a0b-38b5-4414-a91a-825638eb22d5 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:32:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:32:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:32:14 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:32:14 user nova-compute[74342]: INFO nova.compute.manager [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Attaching volume 9c2ae6e4-0b1f-4694-99ea-4533c77ff83d to /dev/vdb
Oct 16 10:32:14 user nova-compute[74342]: DEBUG os_brick.utils [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:32:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:14 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b5824b-3cb4-4ce5-a198-82e0f45e94ee]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:14 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1fcd40d-c027-4c1b-9f66-20a22ba30cbc]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c5a2e2-3fed-426b-a149-b364ee56b161]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f149c128-e9e9-402a-9c2c-99e96170fd2e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:32:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 10:32:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:15 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:32:15 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 10:32:15 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11101f9-d99a-4748-bdf5-e3b3c4f7bdff]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 10:32:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 10:32:15 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 10:32:15 user nova-compute[74342]: DEBUG os_brick.utils [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:32:15 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Updating existing volume attachment record: fa95ed78-2727-4d0c-9fd7-36599b3aa5a8 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 10:32:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:32:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:32:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:32:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:32:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:32:16 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:32:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:32:21 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:32:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:32:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:32:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:32:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:32:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:32:26 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:32:29 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VCWscBKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:32:30 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:32:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:32:30 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:32:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:32:30 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b878fed-8f75-4c0b-b2a0-8de05ee893d5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 10:32:30 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d98f0202-e3af-4c2d-a975-6e428a317f85]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d] added
Oct 16 10:32:30 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d70739-8241-4ebd-a84c-4d5858866fbe]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b1f3d5a-784b-432e-a5df-0943e80479f2]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VCWscBKQ {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VCWscBKQ" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7277b82-c45e-40e5-8e1e-2f49a1be363d]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VCWscBKQ'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ff3450-dd05-44a1-894a-c710f12e059f]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9dabb8b-e321-498f-92e7-ad5e4091477f]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 (non-flash)
Oct 16 10:32:30 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 (non-flash)
Oct 16 10:32:30 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[11030cc9-01be-46d4-aab5-42f7fd292916]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d, portal: 172.16.0.220,3260]
Oct 16 10:32:30 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d, portal: 172.16.0.220,3260] successful.
Oct 16 10:32:30 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3703ad05-0867-4f2a-b4a5-62a3a07b7ed2]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3faa6398-af9f-4c52-83b5-8eb9d59cf142]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 (non-flash)
Oct 16 10:32:30 user nova-compute[74342]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d (non-flash)
Oct 16 10:32:30 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 (non-flash)
Oct 16 10:32:30 user nova-compute[74342]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d (non-flash)
Oct 16 10:32:30 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.253s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] HCTL ('34', '-', '-', 0) found on session 46 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5198594f-3e7a-4d2b-9c59-f3f5735455da]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:30 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: None {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 10:32:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:32:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:32:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:32:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:32:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:32:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:32:31 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Searching for a device in session 46 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 10:32:31 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VCWscBKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 10:32:31 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:32:31 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23665323861366164', 'path': '/dev/sdc'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:32:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23665323861366164', 'path': '/dev/sdc'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 10:32:31 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lazy-loading 'flavor' on Instance uuid 7fa98a0b-38b5-4414-a91a-825638eb22d5 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:32:31 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 10:32:31 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:32:31 user nova-compute[74342]:   <source dev="/dev/sdc"/>
Oct 16 10:32:31 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:32:31 user nova-compute[74342]:   <serial>9c2ae6e4-0b1f-4694-99ea-4533c77ff83d</serial>
Oct 16 10:32:31 user nova-compute[74342]: </disk>
Oct 16 10:32:31 user nova-compute[74342]:  {{(pid=74342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 10:32:32 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:32:32 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:32:32 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] No VIF found with MAC fa:16:3e:2b:c3:c5, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:32:32 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fa007050-00f8-4420-9555-b54409e03bae tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.368s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:32:33 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:32:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:32:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:32:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:32:33 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:32:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:33 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 10:32:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccac63c-d004-4063-b65a-b792edc79d06/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:32:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccac63c-d004-4063-b65a-b792edc79d06/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccac63c-d004-4063-b65a-b792edc79d06/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:34 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2ccac63c-d004-4063-b65a-b792edc79d06/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 10:32:34 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:32:34 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:32:34 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8906MB free_disk=24.93732452392578GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:32:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:32:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:32:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:32:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:32:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "2ccac63c-d004-4063-b65a-b792edc79d06" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:32:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "2ccac63c-d004-4063-b65a-b792edc79d06" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:32:34 user nova-compute[74342]: INFO nova.compute.manager [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Detaching volume 9c2ae6e4-0b1f-4694-99ea-4533c77ff83d
Oct 16 10:32:34 user nova-compute[74342]: INFO nova.compute.manager [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Detaching volume db9e6cd6-f39a-40f6-be68-13e8270bc876
Oct 16 10:32:34 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:32:34 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 2ccac63c-d004-4063-b65a-b792edc79d06 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:32:34 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:32:34 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:32:34 user nova-compute[74342]: INFO nova.virt.block_device [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Attempting to driver detach volume 9c2ae6e4-0b1f-4694-99ea-4533c77ff83d from mountpoint /dev/vdb
Oct 16 10:32:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "2ccac63c-d004-4063-b65a-b792edc79d06" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:32:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Attempting to detach device vdb from instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 from the persistent domain config. {{(pid=74342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 10:32:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 10:32:34 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:32:34 user nova-compute[74342]:   <source dev="/dev/sdc"/>
Oct 16 10:32:34 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:32:34 user nova-compute[74342]:   <serial>9c2ae6e4-0b1f-4694-99ea-4533c77ff83d</serial>
Oct 16 10:32:34 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 10:32:34 user nova-compute[74342]: </disk>
Oct 16 10:32:34 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 10:32:34 user nova-compute[74342]: INFO nova.virt.block_device [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Attempting to driver detach volume db9e6cd6-f39a-40f6-be68-13e8270bc876 from mountpoint /dev/vdb
Oct 16 10:32:34 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Successfully detached device vdb from instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 from the persistent domain config.
Oct 16 10:32:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 from the live domain config. {{(pid=74342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 10:32:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 10:32:34 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:32:34 user nova-compute[74342]:   <source dev="/dev/sdc"/>
Oct 16 10:32:34 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:32:34 user nova-compute[74342]:   <serial>9c2ae6e4-0b1f-4694-99ea-4533c77ff83d</serial>
Oct 16 10:32:34 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 10:32:34 user nova-compute[74342]: </disk>
Oct 16 10:32:34 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 10:32:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Attempting to detach device vdb from instance 2ccac63c-d004-4063-b65a-b792edc79d06 from the persistent domain config. {{(pid=74342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 10:32:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 10:32:34 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:32:34 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 10:32:34 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:32:34 user nova-compute[74342]:   <serial>db9e6cd6-f39a-40f6-be68-13e8270bc876</serial>
Oct 16 10:32:34 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 10:32:34 user nova-compute[74342]: </disk>
Oct 16 10:32:34 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 10:32:34 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Successfully detached device vdb from instance 2ccac63c-d004-4063-b65a-b792edc79d06 from the persistent domain config.
Oct 16 10:32:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2ccac63c-d004-4063-b65a-b792edc79d06 from the live domain config. {{(pid=74342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 10:32:34 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 10:32:34 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:32:34 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 10:32:34 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:32:34 user nova-compute[74342]:   <serial>db9e6cd6-f39a-40f6-be68-13e8270bc876</serial>
Oct 16 10:32:34 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 10:32:34 user nova-compute[74342]: </disk>
Oct 16 10:32:34 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 10:32:34 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:32:34 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:32:34 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:32:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.236s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:32:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 {{(pid=74342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 10:32:35 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2ccac63c-d004-4063-b65a-b792edc79d06 {{(pid=74342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 10:32:35 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:32:35 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:32:36 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:32:36 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:32:36 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Rebuilding the list of instances to heal {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 10:32:36 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Skipping network cache update for instance because it is being deleted. {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9938}}
Oct 16 10:32:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-7fa98a0b-38b5-4414-a91a-825638eb22d5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:32:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-7fa98a0b-38b5-4414-a91a-825638eb22d5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:32:36 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:32:36 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lazy-loading 'info_cache' on Instance uuid 7fa98a0b-38b5-4414-a91a-825638eb22d5 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:32:36 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:32:36 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Updating instance_info_cache with network_info: [{"id": "e8604c7a-955c-4392-9516-9d857e0b853c", "address": "fa:16:3e:2b:c3:c5", "network": {"id": "8e5b686c-cd9a-4ac1-866b-24bdde0a8f6f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-307409530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de9fb210571447cdb6214d66f66a4d73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8604c7a-95", "ovs_interfaceid": "e8604c7a-955c-4392-9516-9d857e0b853c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:32:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-7fa98a0b-38b5-4414-a91a-825638eb22d5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:32:36 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:32:36 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:32:38 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:32:38 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:32:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:32:39 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:32:39 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:32:39 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:32:41 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:32:46 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:32:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:32:55 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 is timed out.
Oct 16 10:32:55 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Successfully detached device vdb from instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 from the live domain config.
Oct 16 10:32:55 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VCWscBKQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:32:55 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee1c80c-0f62-4ba1-9723-d8740beb958e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 10:32:55 user nova-compute[74342]: No targets found.
Oct 16 10:32:55 user nova-compute[74342]: iSNS:
Oct 16 10:32:55 user nova-compute[74342]: No targets found.
Oct 16 10:32:55 user nova-compute[74342]: STATIC:
Oct 16 10:32:55 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d
Oct 16 10:32:55 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:32:55 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:32:55 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876
Oct 16 10:32:55 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:32:55 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:32:55 user nova-compute[74342]: FIRMWARE:
Oct 16 10:32:55 user nova-compute[74342]: No targets found.
Oct 16 10:32:55 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 10:32:55 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 10:32:55 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49f0fc1-e178-435d-908e-5c564c471a3f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a33659c-b512-4a7a-9991-b32a537bca4f]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 (non-flash)
Oct 16 10:32:55 user nova-compute[74342]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d (non-flash)
Oct 16 10:32:55 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 (non-flash)
Oct 16 10:32:55 user nova-compute[74342]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d (non-flash)
Oct 16 10:32:55 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b601cb490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d'): ({'sdc'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Removing single pathed devices sdc {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5ace32-084b-4fdd-b0d1-a6eb8eabd1b6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc1d559-1d75-49e6-947d-c5138bc0df2f]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Flushing IO for device /dev/sdc {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf8f9c8-28b6-4704-833c-a72e23761094]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.044s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd87a49-601a-4f92-82d4-c55d7736e7f2]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] SCSI volumes sdc have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac1129e-a5c7-4639-a9be-276f3867cb79]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e6f9134-a50a-4097-a5b4-26c2708672fb]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d, portal: 172.16.0.220,3260]
Oct 16 10:32:55 user nova-compute[74342]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d, portal: 172.16.0.220,3260] successful.
Oct 16 10:32:55 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:55 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2ccac63c-d004-4063-b65a-b792edc79d06 is timed out.
Oct 16 10:32:55 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Successfully detached device vdb from instance 2ccac63c-d004-4063-b65a-b792edc79d06 from the live domain config.
Oct 16 10:32:55 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PvDKLzdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:32:55 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9c2ae6e4-0b1f-4694-99ea-4533c77ff83d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[670abc58-9708-4de2-beb8-54c854908be0]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] <== disconnect_volume: return (300ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.013s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4de21db8-04b3-44e3-b805-b112d4f50dd8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 10:32:55 user nova-compute[74342]: No targets found.
Oct 16 10:32:55 user nova-compute[74342]: iSNS:
Oct 16 10:32:55 user nova-compute[74342]: No targets found.
Oct 16 10:32:55 user nova-compute[74342]: STATIC:
Oct 16 10:32:55 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876
Oct 16 10:32:55 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:32:55 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:32:55 user nova-compute[74342]: FIRMWARE:
Oct 16 10:32:55 user nova-compute[74342]: No targets found.
Oct 16 10:32:55 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 10:32:55 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 10:32:55 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[028b49a5-1562-4d68-a87c-e9fa1838974e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e18c6042-cdc2-4ad0-b987-c45e9e659fda]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 (non-flash)
Oct 16 10:32:55 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 (non-flash)
Oct 16 10:32:55 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b601ca3b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876'): ({'sdb'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Removing single pathed devices sdb {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b08bd6-9de9-4788-8656-3bf83b83aa73]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7e87aeb-10b6-4e74-8873-62d76e737464]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Flushing IO for device /dev/sdb {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[88180357-2ead-4c01-b3b2-c964888636c0]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.054s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be65676-7ba5-47b0-9b3d-37f881b858f8]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5e6d09-9c1c-475e-bb1b-048e4bfc3d5d]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3629f144-f05a-45eb-bb47-d04a9b50d764]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876, portal: 172.16.0.220,3260]
Oct 16 10:32:55 user nova-compute[74342]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876, portal: 172.16.0.220,3260] successful.
Oct 16 10:32:55 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[705996a4-0e33-4a19-9838-ce7039aa10dd]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] <== disconnect_volume: return (294ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:32:55 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 10:32:56 user nova-compute[74342]: DEBUG nova.objects.instance [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lazy-loading 'flavor' on Instance uuid 7fa98a0b-38b5-4414-a91a-825638eb22d5 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:32:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5b922dd0-2893-442f-a3f4-fdc81bc0b099 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.694s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:32:56 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lazy-loading 'flavor' on Instance uuid 2ccac63c-d004-4063-b65a-b792edc79d06 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:32:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fabf9b6f-3863-49b7-9e6c-cd6adf0aaa43 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "2ccac63c-d004-4063-b65a-b792edc79d06" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.945s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:32:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "2ccac63c-d004-4063-b65a-b792edc79d06" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.832s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:32:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "2ccac63c-d004-4063-b65a-b792edc79d06-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:32:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "2ccac63c-d004-4063-b65a-b792edc79d06-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:32:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "2ccac63c-d004-4063-b65a-b792edc79d06-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:32:56 user nova-compute[74342]: INFO nova.compute.manager [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Terminating instance
Oct 16 10:32:56 user nova-compute[74342]: DEBUG nova.compute.manager [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 10:32:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:32:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:32:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:32:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:32:56 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG nova.compute.manager [req-fb0b5947-9789-41d9-8d6b-8e538d284c69 req-2251f996-3ead-4bea-bf98-38f7567c414d service nova] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Received event network-vif-unplugged-62f01d95-791e-4e38-a05f-5edddc89e86d {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-fb0b5947-9789-41d9-8d6b-8e538d284c69 req-2251f996-3ead-4bea-bf98-38f7567c414d service nova] Acquiring lock "2ccac63c-d004-4063-b65a-b792edc79d06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-fb0b5947-9789-41d9-8d6b-8e538d284c69 req-2251f996-3ead-4bea-bf98-38f7567c414d service nova] Lock "2ccac63c-d004-4063-b65a-b792edc79d06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-fb0b5947-9789-41d9-8d6b-8e538d284c69 req-2251f996-3ead-4bea-bf98-38f7567c414d service nova] Lock "2ccac63c-d004-4063-b65a-b792edc79d06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG nova.compute.manager [req-fb0b5947-9789-41d9-8d6b-8e538d284c69 req-2251f996-3ead-4bea-bf98-38f7567c414d service nova] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] No waiting events found dispatching network-vif-unplugged-62f01d95-791e-4e38-a05f-5edddc89e86d {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG nova.compute.manager [req-fb0b5947-9789-41d9-8d6b-8e538d284c69 req-2251f996-3ead-4bea-bf98-38f7567c414d service nova] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Received event network-vif-unplugged-62f01d95-791e-4e38-a05f-5edddc89e86d for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:32:57 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Instance destroyed successfully.
Oct 16 10:32:57 user nova-compute[74342]: DEBUG nova.objects.instance [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lazy-loading 'resources' on Instance uuid 2ccac63c-d004-4063-b65a-b792edc79d06 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:29:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1446564129',display_name='tempest-VolumesSnapshotTestJSON-instance-1446564129',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1446564129',id=51,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIxCAHNR8/0c1K78QNBuboPBXMUTipSzucscplF+8JCj0Q7OtjuihSzS69ODGSOqrGw5qg5pda3E3gLBvruJ/FRMllnfRgPYtxWUVzrxQrjmch6WWbdRPy2MqwmfCWp+MA==',key_name='tempest-keypair-2043871561',keypairs=<?>,launch_index=0,launched_at=2023-10-16T10:29:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='496a10bc096b4983bb728512bb41ac45',ramdisk_id='',reservation_id='r-h2c026t3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1850096802',owner_user_name='tempest-VolumesSnapshotTestJSON-1850096802-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T10:29:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b08b694b7ec45ab9f208b01ef1c833a',uuid=2ccac63c-d004-4063-b65a-b792edc79d06,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "62f01d95-791e-4e38-a05f-5edddc89e86d", "address": "fa:16:3e:d3:3b:e5", "network": {"id": "f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1742429158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496a10bc096b4983bb728512bb41ac45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f01d95-79", "ovs_interfaceid": "62f01d95-791e-4e38-a05f-5edddc89e86d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Converting VIF {"id": "62f01d95-791e-4e38-a05f-5edddc89e86d", "address": "fa:16:3e:d3:3b:e5", "network": {"id": "f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1742429158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496a10bc096b4983bb728512bb41ac45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap62f01d95-79", "ovs_interfaceid": "62f01d95-791e-4e38-a05f-5edddc89e86d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:3b:e5,bridge_name='br-int',has_traffic_filtering=True,id=62f01d95-791e-4e38-a05f-5edddc89e86d,network=Network(f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62f01d95-79') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG os_vif [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:3b:e5,bridge_name='br-int',has_traffic_filtering=True,id=62f01d95-791e-4e38-a05f-5edddc89e86d,network=Network(f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62f01d95-79') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap62f01d95-79, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=00b4e08c-e9b4-4463-939a-22aee9599202) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:32:57 user nova-compute[74342]: INFO os_vif [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:3b:e5,bridge_name='br-int',has_traffic_filtering=True,id=62f01d95-791e-4e38-a05f-5edddc89e86d,network=Network(f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap62f01d95-79')
Oct 16 10:32:57 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:db9e6cd6-f39a-40f6-be68-13e8270bc876', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PvDKLzdg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:32:57 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:32:57 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[a1d92db3-b480-4695-85d8-6a3450742344]: Unexpected error while running command.
Oct 16 10:32:57 user nova-compute[74342]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 16 10:32:57 user nova-compute[74342]: Exit code: 21
Oct 16 10:32:57 user nova-compute[74342]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 16 10:32:57 user nova-compute[74342]: Stderr: '' {{(pid=85400) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Oct 16 10:32:57 user nova-compute[74342]: Traceback (most recent call last):
Oct 16 10:32:57 user nova-compute[74342]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Oct 16 10:32:57 user nova-compute[74342]:     ret = func(*f_args, **f_kwargs)
Oct 16 10:32:57 user nova-compute[74342]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Oct 16 10:32:57 user nova-compute[74342]:     return func(*args, **kwargs)
Oct 16 10:32:57 user nova-compute[74342]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Oct 16 10:32:57 user nova-compute[74342]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Oct 16 10:32:57 user nova-compute[74342]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Oct 16 10:32:57 user nova-compute[74342]:     return putils.execute(on_execute=on_execute,
Oct 16 10:32:57 user nova-compute[74342]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Oct 16 10:32:57 user nova-compute[74342]:     raise ProcessExecutionError(exit_code=_returncode,
Oct 16 10:32:57 user nova-compute[74342]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 16 10:32:57 user nova-compute[74342]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 16 10:32:57 user nova-compute[74342]: Exit code: 21
Oct 16 10:32:57 user nova-compute[74342]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 16 10:32:57 user nova-compute[74342]: Stderr: ''
Oct 16 10:32:57 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d92db3-b480-4695-85d8-6a3450742344]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:32:57 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 16 10:32:57 user nova-compute[74342]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 16 10:32:57 user nova-compute[74342]: Exit code: 21
Oct 16 10:32:57 user nova-compute[74342]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 16 10:32:57 user nova-compute[74342]: Stderr: ''
Oct 16 10:32:57 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Oct 16 10:32:57 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Oct 16 10:32:57 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Oct 16 10:32:57 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Oct 16 10:32:57 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Oct 16 10:32:57 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Oct 16 10:32:57 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Oct 16 10:32:57 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Oct 16 10:32:57 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Oct 16 10:32:57 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Oct 16 10:32:57 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Oct 16 10:32:57 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Oct 16 10:32:57 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Oct 16 10:32:57 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Oct 16 10:32:57 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Oct 16 10:32:57 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 16 10:32:57 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Oct 16 10:32:57 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Oct 16 10:32:57 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 16 10:32:57 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Oct 16 10:32:57 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi 
Oct 16 10:32:57 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74342) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.034s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] <== disconnect_volume: return (35ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 10:32:57 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Deleting instance files /opt/stack/data/nova/instances/2ccac63c-d004-4063-b65a-b792edc79d06_del
Oct 16 10:32:57 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Deletion of /opt/stack/data/nova/instances/2ccac63c-d004-4063-b65a-b792edc79d06_del complete
Oct 16 10:32:57 user nova-compute[74342]: INFO nova.compute.manager [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 16 10:32:57 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 10:32:57 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 10:32:58 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:32:58 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Took 1.06 seconds to deallocate network for instance.
Oct 16 10:32:58 user nova-compute[74342]: WARNING nova.volume.cinder [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Attachment 7ae96eea-16dd-422b-bed7-ec37df4438bb does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 7ae96eea-16dd-422b-bed7-ec37df4438bb. (HTTP 404) (Request-ID: req-a892471a-548c-4bf0-9362-21163839ea6d)
Oct 16 10:32:58 user nova-compute[74342]: INFO nova.compute.manager [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Took 0.02 seconds to detach 1 volumes for instance.
Oct 16 10:32:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:32:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:32:58 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:32:58 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:32:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.151s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:32:58 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Deleted allocations for instance 2ccac63c-d004-4063-b65a-b792edc79d06
Oct 16 10:32:58 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-85557e28-6eea-4bb3-9703-8c132b3be5e5 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "2ccac63c-d004-4063-b65a-b792edc79d06" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.311s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:32:59 user nova-compute[74342]: DEBUG nova.compute.manager [req-bc72a9ba-5772-4186-a920-da8d0b23af31 req-920dc234-4b15-4c7d-8db3-fb3ee305d1ad service nova] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Received event network-vif-plugged-62f01d95-791e-4e38-a05f-5edddc89e86d {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:32:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-bc72a9ba-5772-4186-a920-da8d0b23af31 req-920dc234-4b15-4c7d-8db3-fb3ee305d1ad service nova] Acquiring lock "2ccac63c-d004-4063-b65a-b792edc79d06-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:32:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-bc72a9ba-5772-4186-a920-da8d0b23af31 req-920dc234-4b15-4c7d-8db3-fb3ee305d1ad service nova] Lock "2ccac63c-d004-4063-b65a-b792edc79d06-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:32:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-bc72a9ba-5772-4186-a920-da8d0b23af31 req-920dc234-4b15-4c7d-8db3-fb3ee305d1ad service nova] Lock "2ccac63c-d004-4063-b65a-b792edc79d06-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:32:59 user nova-compute[74342]: DEBUG nova.compute.manager [req-bc72a9ba-5772-4186-a920-da8d0b23af31 req-920dc234-4b15-4c7d-8db3-fb3ee305d1ad service nova] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] No waiting events found dispatching network-vif-plugged-62f01d95-791e-4e38-a05f-5edddc89e86d {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:32:59 user nova-compute[74342]: WARNING nova.compute.manager [req-bc72a9ba-5772-4186-a920-da8d0b23af31 req-920dc234-4b15-4c7d-8db3-fb3ee305d1ad service nova] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Received unexpected event network-vif-plugged-62f01d95-791e-4e38-a05f-5edddc89e86d for instance with vm_state deleted and task_state None.
Oct 16 10:32:59 user nova-compute[74342]: DEBUG nova.compute.manager [req-bc72a9ba-5772-4186-a920-da8d0b23af31 req-920dc234-4b15-4c7d-8db3-fb3ee305d1ad service nova] [instance: 2ccac63c-d004-4063-b65a-b792edc79d06] Received event network-vif-deleted-62f01d95-791e-4e38-a05f-5edddc89e86d {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:33:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:33:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:33:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:33:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:33:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:33:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:33:29 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:33:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:33:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:33:30 user nova-compute[74342]: DEBUG nova.objects.instance [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lazy-loading 'flavor' on Instance uuid 7fa98a0b-38b5-4414-a91a-825638eb22d5 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:33:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:33:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:33:30 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:33:30 user nova-compute[74342]: INFO nova.compute.manager [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Attaching volume 33046bb7-7e75-4efe-8883-006f758b8e4d to /dev/vdb
Oct 16 10:33:30 user nova-compute[74342]: DEBUG os_brick.utils [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:33:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:33:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:33:30 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d66ae7-0501-4483-957e-539b694daafc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:33:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:33:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:33:30 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c09e1d7-d396-4ca4-bc9a-974352c335ea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:33:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:33:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:33:30 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad74047-a9c8-4174-a837-9e8891746cd3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:33:30 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff2660f-224b-4a5f-9b57-220237c05927]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:33:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:33:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:33:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 10:33:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:33:30 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:33:30 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 10:33:30 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4c17e7-1996-43f8-81be-5acda8b18872]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:33:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 10:33:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 10:33:30 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 10:33:30 user nova-compute[74342]: DEBUG os_brick.utils [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:33:30 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Updating existing volume attachment record: 9038f2b3-399e-4b41-b4d4-0a0730b3b112 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 10:33:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:33:33 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:33:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:33:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:33:33 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:33:33 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:33:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:33:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:33:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:33:33 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:33:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:33:34 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:33:34 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:33:34 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8994MB free_disk=24.956138610839844GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:33:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:33:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:33:34 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:33:34 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:33:34 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:33:34 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:33:34 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:33:34 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:33:34 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.207s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:33:36 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:33:36 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:33:37 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:33:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:33:38 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:33:38 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:33:38 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Rebuilding the list of instances to heal {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 10:33:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-7fa98a0b-38b5-4414-a91a-825638eb22d5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:33:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-7fa98a0b-38b5-4414-a91a-825638eb22d5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:33:38 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:33:38 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lazy-loading 'info_cache' on Instance uuid 7fa98a0b-38b5-4414-a91a-825638eb22d5 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:33:38 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Updating instance_info_cache with network_info: [{"id": "e8604c7a-955c-4392-9516-9d857e0b853c", "address": "fa:16:3e:2b:c3:c5", "network": {"id": "8e5b686c-cd9a-4ac1-866b-24bdde0a8f6f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-307409530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de9fb210571447cdb6214d66f66a4d73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8604c7a-95", "ovs_interfaceid": "e8604c7a-955c-4392-9516-9d857e0b853c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:33:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-7fa98a0b-38b5-4414-a91a-825638eb22d5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:33:39 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:33:39 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:33:39 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:33:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:33:41 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:33:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'leBqTkyc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:33:46 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:33:46 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:33:46 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:33:46 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:33:46 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a34a20-401e-4f98-9d30-3b038e89c832]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 10:33:46 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7880fd9d-3be9-48db-bf12-452b5bdb82dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d] added
Oct 16 10:33:46 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5465ecf1-00f9-4381-9afd-453a4e982e59]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[16066170-8e59-4f58-b1cf-79743d163c8c]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v leBqTkyc {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v leBqTkyc" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae355c1-b185-499e-bc63-b383fe912515]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'leBqTkyc'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef122af-eaab-422b-9dae-4b618777ff90]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[94382732-04c5-4eb5-83c5-73213110cc47]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 10:33:46 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 10:33:46 user nova-compute[74342]:  {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:33:46 user nova-compute[74342]: WARNING os_brick.initiator.connectors.iscsi [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 10:33:46 user nova-compute[74342]: 
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17daf90-5bb3-4d41-a06f-b2c6c3762274]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d, portal: 172.16.0.220,3260]
Oct 16 10:33:46 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d, portal: 172.16.0.220,3260] successful.
Oct 16 10:33:46 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[446ae973-1717-4111-aad3-b5aa34cbcdf4]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[4682f662-4491-41f7-85d1-d3d23465f2fd]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d (non-flash)
Oct 16 10:33:46 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d (non-flash)
Oct 16 10:33:46 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] HCTL ('33', '-', '-', 0) found on session 47 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6268d2-25f7-4f25-b83c-67446a1c2197]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Searching for a device in session 47 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 10:33:46 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'leBqTkyc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 10:33:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.297s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:33:47 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] <== connect_volume: return (1300ms) {'type': 'block', 'scsi_wwn': '23037336438336239', 'path': '/dev/sdb'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:33:47 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23037336438336239', 'path': '/dev/sdb'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 10:33:47 user nova-compute[74342]: DEBUG nova.objects.instance [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lazy-loading 'flavor' on Instance uuid 7fa98a0b-38b5-4414-a91a-825638eb22d5 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:33:47 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 10:33:47 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:33:47 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 10:33:47 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:33:47 user nova-compute[74342]:   <serial>33046bb7-7e75-4efe-8883-006f758b8e4d</serial>
Oct 16 10:33:47 user nova-compute[74342]: </disk>
Oct 16 10:33:47 user nova-compute[74342]:  {{(pid=74342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 10:33:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:33:47 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:33:47 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:33:47 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] No VIF found with MAC fa:16:3e:2b:c3:c5, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:33:48 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-313d7b19-8886-4a09-a775-0046d2311cb3 tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.780s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:33:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:33:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:33:49 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:33:50 user nova-compute[74342]: INFO nova.compute.manager [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Detaching volume 33046bb7-7e75-4efe-8883-006f758b8e4d
Oct 16 10:33:50 user nova-compute[74342]: INFO nova.virt.block_device [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Attempting to driver detach volume 33046bb7-7e75-4efe-8883-006f758b8e4d from mountpoint /dev/vdb
Oct 16 10:33:50 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Attempting to detach device vdb from instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 from the persistent domain config. {{(pid=74342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 10:33:50 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 10:33:50 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:33:50 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 10:33:50 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:33:50 user nova-compute[74342]:   <serial>33046bb7-7e75-4efe-8883-006f758b8e4d</serial>
Oct 16 10:33:50 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 10:33:50 user nova-compute[74342]: </disk>
Oct 16 10:33:50 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 10:33:50 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Successfully detached device vdb from instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 from the persistent domain config.
Oct 16 10:33:50 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 from the live domain config. {{(pid=74342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 10:33:50 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 10:33:50 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:33:50 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 10:33:50 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:33:50 user nova-compute[74342]:   <serial>33046bb7-7e75-4efe-8883-006f758b8e4d</serial>
Oct 16 10:33:50 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 10:33:50 user nova-compute[74342]: </disk>
Oct 16 10:33:50 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 10:33:50 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 {{(pid=74342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 10:33:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:33:53 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:33:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:34:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:34:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:34:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "8b602175-5dca-4c27-9944-307cafd0ab98" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:34:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "8b602175-5dca-4c27-9944-307cafd0ab98" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:34:04 user nova-compute[74342]: DEBUG nova.compute.manager [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Starting instance... {{(pid=74342) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Oct 16 10:34:04 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:34:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:34:05 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=74342) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Oct 16 10:34:05 user nova-compute[74342]: INFO nova.compute.claims [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Claim successful on node user
Oct 16 10:34:05 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:34:05 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:34:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.214s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:34:05 user nova-compute[74342]: DEBUG nova.compute.manager [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Start building networks asynchronously for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Oct 16 10:34:05 user nova-compute[74342]: DEBUG nova.compute.manager [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Allocating IP information in the background. {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Oct 16 10:34:05 user nova-compute[74342]: DEBUG nova.network.neutron [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] allocate_for_instance() {{(pid=74342) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Oct 16 10:34:05 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Oct 16 10:34:05 user nova-compute[74342]: DEBUG nova.compute.manager [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Start building block device mappings for instance. {{(pid=74342) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Oct 16 10:34:05 user nova-compute[74342]: DEBUG nova.policy [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3b08b694b7ec45ab9f208b01ef1c833a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '496a10bc096b4983bb728512bb41ac45', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=74342) authorize /opt/stack/nova/nova/policy.py:203}}
Oct 16 10:34:05 user nova-compute[74342]: DEBUG nova.compute.manager [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Start spawning the instance on the hypervisor. {{(pid=74342) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Oct 16 10:34:05 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Creating instance directory {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Oct 16 10:34:05 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Creating image(s)
Oct 16 10:34:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "/opt/stack/data/nova/instances/8b602175-5dca-4c27-9944-307cafd0ab98/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:34:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "/opt/stack/data/nova/instances/8b602175-5dca-4c27-9944-307cafd0ab98/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:34:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "/opt/stack/data/nova/instances/8b602175-5dca-4c27-9944-307cafd0ab98/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:34:05 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:34:05 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.172s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:34:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:34:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:34:05 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:34:05 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.175s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:34:05 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/8b602175-5dca-4c27-9944-307cafd0ab98/disk 1073741824 {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:34:05 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd,backing_fmt=raw /opt/stack/data/nova/instances/8b602175-5dca-4c27-9944-307cafd0ab98/disk 1073741824" returned: 0 in 0.046s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:34:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "e0ab47bb7e7263acaed522a0a70e99f7614494dd" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:34:05 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:34:05 user nova-compute[74342]: DEBUG nova.network.neutron [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Successfully created port: 5b33d5ef-9594-4f0c-a3ae-55ffc442ded5 {{(pid=74342) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e0ab47bb7e7263acaed522a0a70e99f7614494dd --force-share --output=json" returned: 0 in 0.174s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8b602175-5dca-4c27-9944-307cafd0ab98/disk. size=1073741824 {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b602175-5dca-4c27-9944-307cafd0ab98/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b602175-5dca-4c27-9944-307cafd0ab98/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.virt.disk.api [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Cannot resize image /opt/stack/data/nova/instances/8b602175-5dca-4c27-9944-307cafd0ab98/disk to a smaller size. {{(pid=74342) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Created local disks {{(pid=74342) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Ensure instance console log exists: /opt/stack/data/nova/instances/8b602175-5dca-4c27-9944-307cafd0ab98/console.log {{(pid=74342) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.network.neutron [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Successfully updated port: 5b33d5ef-9594-4f0c-a3ae-55ffc442ded5 {{(pid=74342) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "refresh_cache-8b602175-5dca-4c27-9944-307cafd0ab98" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquired lock "refresh_cache-8b602175-5dca-4c27-9944-307cafd0ab98" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.network.neutron [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Building network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.compute.manager [req-d035ba25-f0f8-4f66-b9ff-75b1e4091346 req-dffc7d5a-b09c-4555-b195-b3f6030a9eb9 service nova] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Received event network-changed-5b33d5ef-9594-4f0c-a3ae-55ffc442ded5 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.compute.manager [req-d035ba25-f0f8-4f66-b9ff-75b1e4091346 req-dffc7d5a-b09c-4555-b195-b3f6030a9eb9 service nova] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Refreshing instance network info cache due to event network-changed-5b33d5ef-9594-4f0c-a3ae-55ffc442ded5. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d035ba25-f0f8-4f66-b9ff-75b1e4091346 req-dffc7d5a-b09c-4555-b195-b3f6030a9eb9 service nova] Acquiring lock "refresh_cache-8b602175-5dca-4c27-9944-307cafd0ab98" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.network.neutron [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Instance cache missing network info. {{(pid=74342) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.network.neutron [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Updating instance_info_cache with network_info: [{"id": "5b33d5ef-9594-4f0c-a3ae-55ffc442ded5", "address": "fa:16:3e:98:b5:61", "network": {"id": "f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1742429158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496a10bc096b4983bb728512bb41ac45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b33d5ef-95", "ovs_interfaceid": "5b33d5ef-9594-4f0c-a3ae-55ffc442ded5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Releasing lock "refresh_cache-8b602175-5dca-4c27-9944-307cafd0ab98" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.compute.manager [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Instance network_info: |[{"id": "5b33d5ef-9594-4f0c-a3ae-55ffc442ded5", "address": "fa:16:3e:98:b5:61", "network": {"id": "f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1742429158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496a10bc096b4983bb728512bb41ac45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b33d5ef-95", "ovs_interfaceid": "5b33d5ef-9594-4f0c-a3ae-55ffc442ded5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=74342) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d035ba25-f0f8-4f66-b9ff-75b1e4091346 req-dffc7d5a-b09c-4555-b195-b3f6030a9eb9 service nova] Acquired lock "refresh_cache-8b602175-5dca-4c27-9944-307cafd0ab98" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.network.neutron [req-d035ba25-f0f8-4f66-b9ff-75b1e4091346 req-dffc7d5a-b09c-4555-b195-b3f6030a9eb9 service nova] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Refreshing network info cache for port 5b33d5ef-9594-4f0c-a3ae-55ffc442ded5 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Start _get_guest_xml network_info=[{"id": "5b33d5ef-9594-4f0c-a3ae-55ffc442ded5", "address": "fa:16:3e:98:b5:61", "network": {"id": "f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1742429158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496a10bc096b4983bb728512bb41ac45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b33d5ef-95", "ovs_interfaceid": "5b33d5ef-9594-4f0c-a3ae-55ffc442ded5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'size': 0, 'encryption_options': None, 'boot_index': 0, 'guest_format': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'disk_bus': 'virtio', 'encryption_secret_uuid': None, 'image_id': '01fbac29-34fa-4a9a-a2f8-2f304b74a717'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Oct 16 10:34:06 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:34:06 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] CPU controller missing on host. {{(pid=74342) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.host [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] CPU controller found on host. {{(pid=74342) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=74342) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-10-16T09:39:59Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-10-16T09:40:10Z,direct_url=<?>,disk_format='qcow2',id=01fbac29-34fa-4a9a-a2f8-2f304b74a717,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='f16edca225a74e20981d0c557f45d33f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-10-16T09:40:12Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Flavor limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Image limits 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Flavor pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Image pref 0:0:0 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=74342) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Got 1 possible topologies {{(pid=74342) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.virt.hardware [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=74342) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:34:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1705417551',display_name='tempest-VolumesSnapshotTestJSON-instance-1705417551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1705417551',id=52,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaU2cSlGw96OItYnzBITChNecsD76gapatQ9/IWI7zpUGcO1I1w493iohg1nfdwHNTj+2CvgkGKwWa3k6eewWmsvZqyPhxvgMeTKbELooRvz5mDCBZo2jY4mCkZNUn+XQ==',key_name='tempest-keypair-1596973313',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='496a10bc096b4983bb728512bb41ac45',ramdisk_id='',reservation_id='r-waag98nn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1850096802',owner_user_name='tempest-VolumesSnapshotTestJSON-1850096802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:34:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b08b694b7ec45ab9f208b01ef1c833a',uuid=8b602175-5dca-4c27-9944-307cafd0ab98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b33d5ef-9594-4f0c-a3ae-55ffc442ded5", "address": "fa:16:3e:98:b5:61", "network": {"id": "f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1742429158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496a10bc096b4983bb728512bb41ac45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b33d5ef-95", "ovs_interfaceid": "5b33d5ef-9594-4f0c-a3ae-55ffc442ded5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=74342) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Converting VIF {"id": "5b33d5ef-9594-4f0c-a3ae-55ffc442ded5", "address": "fa:16:3e:98:b5:61", "network": {"id": "f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1742429158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496a10bc096b4983bb728512bb41ac45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b33d5ef-95", "ovs_interfaceid": "5b33d5ef-9594-4f0c-a3ae-55ffc442ded5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:b5:61,bridge_name='br-int',has_traffic_filtering=True,id=5b33d5ef-9594-4f0c-a3ae-55ffc442ded5,network=Network(f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b33d5ef-95') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:34:06 user nova-compute[74342]: DEBUG nova.objects.instance [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lazy-loading 'pci_devices' on Instance uuid 8b602175-5dca-4c27-9944-307cafd0ab98 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:34:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] End _get_guest_xml xml=<domain type="kvm">
Oct 16 10:34:07 user nova-compute[74342]:   <uuid>8b602175-5dca-4c27-9944-307cafd0ab98</uuid>
Oct 16 10:34:07 user nova-compute[74342]:   <name>instance-00000034</name>
Oct 16 10:34:07 user nova-compute[74342]:   <memory>524288</memory>
Oct 16 10:34:07 user nova-compute[74342]:   <vcpu>1</vcpu>
Oct 16 10:34:07 user nova-compute[74342]:   <metadata>
Oct 16 10:34:07 user nova-compute[74342]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Oct 16 10:34:07 user nova-compute[74342]:       <nova:package version="0.0.0"/>
Oct 16 10:34:07 user nova-compute[74342]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1705417551</nova:name>
Oct 16 10:34:07 user nova-compute[74342]:       <nova:creationTime>2023-10-16 10:34:06</nova:creationTime>
Oct 16 10:34:07 user nova-compute[74342]:       <nova:flavor name="m1.tiny">
Oct 16 10:34:07 user nova-compute[74342]:         <nova:memory>512</nova:memory>
Oct 16 10:34:07 user nova-compute[74342]:         <nova:disk>1</nova:disk>
Oct 16 10:34:07 user nova-compute[74342]:         <nova:swap>0</nova:swap>
Oct 16 10:34:07 user nova-compute[74342]:         <nova:ephemeral>0</nova:ephemeral>
Oct 16 10:34:07 user nova-compute[74342]:         <nova:vcpus>1</nova:vcpus>
Oct 16 10:34:07 user nova-compute[74342]:       </nova:flavor>
Oct 16 10:34:07 user nova-compute[74342]:       <nova:owner>
Oct 16 10:34:07 user nova-compute[74342]:         <nova:user uuid="3b08b694b7ec45ab9f208b01ef1c833a">tempest-VolumesSnapshotTestJSON-1850096802-project-member</nova:user>
Oct 16 10:34:07 user nova-compute[74342]:         <nova:project uuid="496a10bc096b4983bb728512bb41ac45">tempest-VolumesSnapshotTestJSON-1850096802</nova:project>
Oct 16 10:34:07 user nova-compute[74342]:       </nova:owner>
Oct 16 10:34:07 user nova-compute[74342]:       <nova:root type="image" uuid="01fbac29-34fa-4a9a-a2f8-2f304b74a717"/>
Oct 16 10:34:07 user nova-compute[74342]:       <nova:ports>
Oct 16 10:34:07 user nova-compute[74342]:         <nova:port uuid="5b33d5ef-9594-4f0c-a3ae-55ffc442ded5">
Oct 16 10:34:07 user nova-compute[74342]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Oct 16 10:34:07 user nova-compute[74342]:         </nova:port>
Oct 16 10:34:07 user nova-compute[74342]:       </nova:ports>
Oct 16 10:34:07 user nova-compute[74342]:     </nova:instance>
Oct 16 10:34:07 user nova-compute[74342]:   </metadata>
Oct 16 10:34:07 user nova-compute[74342]:   <sysinfo type="smbios">
Oct 16 10:34:07 user nova-compute[74342]:     <system>
Oct 16 10:34:07 user nova-compute[74342]:       <entry name="manufacturer">OpenStack Foundation</entry>
Oct 16 10:34:07 user nova-compute[74342]:       <entry name="product">OpenStack Nova</entry>
Oct 16 10:34:07 user nova-compute[74342]:       <entry name="version">0.0.0</entry>
Oct 16 10:34:07 user nova-compute[74342]:       <entry name="serial">8b602175-5dca-4c27-9944-307cafd0ab98</entry>
Oct 16 10:34:07 user nova-compute[74342]:       <entry name="uuid">8b602175-5dca-4c27-9944-307cafd0ab98</entry>
Oct 16 10:34:07 user nova-compute[74342]:       <entry name="family">Virtual Machine</entry>
Oct 16 10:34:07 user nova-compute[74342]:     </system>
Oct 16 10:34:07 user nova-compute[74342]:   </sysinfo>
Oct 16 10:34:07 user nova-compute[74342]:   <os>
Oct 16 10:34:07 user nova-compute[74342]:     <type arch="x86_64" machine="pc">hvm</type>
Oct 16 10:34:07 user nova-compute[74342]:     <boot dev="hd"/>
Oct 16 10:34:07 user nova-compute[74342]:     <smbios mode="sysinfo"/>
Oct 16 10:34:07 user nova-compute[74342]:   </os>
Oct 16 10:34:07 user nova-compute[74342]:   <features>
Oct 16 10:34:07 user nova-compute[74342]:     <acpi/>
Oct 16 10:34:07 user nova-compute[74342]:     <apic/>
Oct 16 10:34:07 user nova-compute[74342]:     <vmcoreinfo/>
Oct 16 10:34:07 user nova-compute[74342]:   </features>
Oct 16 10:34:07 user nova-compute[74342]:   <clock offset="utc">
Oct 16 10:34:07 user nova-compute[74342]:     <timer name="pit" tickpolicy="delay"/>
Oct 16 10:34:07 user nova-compute[74342]:     <timer name="rtc" tickpolicy="catchup"/>
Oct 16 10:34:07 user nova-compute[74342]:     <timer name="hpet" present="no"/>
Oct 16 10:34:07 user nova-compute[74342]:   </clock>
Oct 16 10:34:07 user nova-compute[74342]:   <cpu mode="custom" match="exact">
Oct 16 10:34:07 user nova-compute[74342]:     <model>Nehalem</model>
Oct 16 10:34:07 user nova-compute[74342]:     <topology sockets="1" cores="1" threads="1"/>
Oct 16 10:34:07 user nova-compute[74342]:   </cpu>
Oct 16 10:34:07 user nova-compute[74342]:   <devices>
Oct 16 10:34:07 user nova-compute[74342]:     <disk type="file" device="disk">
Oct 16 10:34:07 user nova-compute[74342]:       <driver name="qemu" type="qcow2" cache="none"/>
Oct 16 10:34:07 user nova-compute[74342]:       <source file="/opt/stack/data/nova/instances/8b602175-5dca-4c27-9944-307cafd0ab98/disk"/>
Oct 16 10:34:07 user nova-compute[74342]:       <target dev="vda" bus="virtio"/>
Oct 16 10:34:07 user nova-compute[74342]:     </disk>
Oct 16 10:34:07 user nova-compute[74342]:     <interface type="ethernet">
Oct 16 10:34:07 user nova-compute[74342]:       <mac address="fa:16:3e:98:b5:61"/>
Oct 16 10:34:07 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:34:07 user nova-compute[74342]:       <mtu size="1442"/>
Oct 16 10:34:07 user nova-compute[74342]:       <target dev="tap5b33d5ef-95"/>
Oct 16 10:34:07 user nova-compute[74342]:     </interface>
Oct 16 10:34:07 user nova-compute[74342]:     <serial type="pty">
Oct 16 10:34:07 user nova-compute[74342]:       <log file="/opt/stack/data/nova/instances/8b602175-5dca-4c27-9944-307cafd0ab98/console.log" append="off"/>
Oct 16 10:34:07 user nova-compute[74342]:     </serial>
Oct 16 10:34:07 user nova-compute[74342]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Oct 16 10:34:07 user nova-compute[74342]:     <video>
Oct 16 10:34:07 user nova-compute[74342]:       <model type="virtio"/>
Oct 16 10:34:07 user nova-compute[74342]:     </video>
Oct 16 10:34:07 user nova-compute[74342]:     <rng model="virtio">
Oct 16 10:34:07 user nova-compute[74342]:       <backend model="random">/dev/urandom</backend>
Oct 16 10:34:07 user nova-compute[74342]:     </rng>
Oct 16 10:34:07 user nova-compute[74342]:     <controller type="usb" index="0" model="none"/>
Oct 16 10:34:07 user nova-compute[74342]:     <memballoon model="virtio">
Oct 16 10:34:07 user nova-compute[74342]:       <stats period="10"/>
Oct 16 10:34:07 user nova-compute[74342]:     </memballoon>
Oct 16 10:34:07 user nova-compute[74342]:   </devices>
Oct 16 10:34:07 user nova-compute[74342]: </domain>
Oct 16 10:34:07 user nova-compute[74342]:  {{(pid=74342) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Oct 16 10:34:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:34:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1705417551',display_name='tempest-VolumesSnapshotTestJSON-instance-1705417551',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1705417551',id=52,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaU2cSlGw96OItYnzBITChNecsD76gapatQ9/IWI7zpUGcO1I1w493iohg1nfdwHNTj+2CvgkGKwWa3k6eewWmsvZqyPhxvgMeTKbELooRvz5mDCBZo2jY4mCkZNUn+XQ==',key_name='tempest-keypair-1596973313',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='496a10bc096b4983bb728512bb41ac45',ramdisk_id='',reservation_id='r-waag98nn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1850096802',owner_user_name='tempest-VolumesSnapshotTestJSON-1850096802-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-10-16T10:34:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b08b694b7ec45ab9f208b01ef1c833a',uuid=8b602175-5dca-4c27-9944-307cafd0ab98,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5b33d5ef-9594-4f0c-a3ae-55ffc442ded5", "address": "fa:16:3e:98:b5:61", "network": {"id": "f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1742429158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496a10bc096b4983bb728512bb41ac45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b33d5ef-95", "ovs_interfaceid": "5b33d5ef-9594-4f0c-a3ae-55ffc442ded5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Oct 16 10:34:07 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Converting VIF {"id": "5b33d5ef-9594-4f0c-a3ae-55ffc442ded5", "address": "fa:16:3e:98:b5:61", "network": {"id": "f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1742429158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496a10bc096b4983bb728512bb41ac45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b33d5ef-95", "ovs_interfaceid": "5b33d5ef-9594-4f0c-a3ae-55ffc442ded5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:34:07 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:b5:61,bridge_name='br-int',has_traffic_filtering=True,id=5b33d5ef-9594-4f0c-a3ae-55ffc442ded5,network=Network(f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b33d5ef-95') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:34:07 user nova-compute[74342]: DEBUG os_vif [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:b5:61,bridge_name='br-int',has_traffic_filtering=True,id=5b33d5ef-9594-4f0c-a3ae-55ffc442ded5,network=Network(f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b33d5ef-95') {{(pid=74342) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Oct 16 10:34:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:34:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:34:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Oct 16 10:34:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:34:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6432ad08-770d-5820-8ebf-421765a01e8d', '_type': 'linux-noop'}}, row=False) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:34:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:34:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:34:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:34:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5b33d5ef-95, may_exist=True, interface_attrs={}) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:34:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap5b33d5ef-95, col_values=(('qos', UUID('299e4e04-637d-4f42-b2a5-f41050c40ce0')),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:34:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap5b33d5ef-95, col_values=(('external_ids', {'iface-id': '5b33d5ef-9594-4f0c-a3ae-55ffc442ded5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:b5:61', 'vm-uuid': '8b602175-5dca-4c27-9944-307cafd0ab98'}),), if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:34:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:34:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:34:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:34:07 user nova-compute[74342]: INFO os_vif [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:b5:61,bridge_name='br-int',has_traffic_filtering=True,id=5b33d5ef-9594-4f0c-a3ae-55ffc442ded5,network=Network(f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b33d5ef-95')
Oct 16 10:34:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:34:07 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] No VIF found with MAC fa:16:3e:98:b5:61, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:34:07 user nova-compute[74342]: DEBUG nova.network.neutron [req-d035ba25-f0f8-4f66-b9ff-75b1e4091346 req-dffc7d5a-b09c-4555-b195-b3f6030a9eb9 service nova] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Updated VIF entry in instance network info cache for port 5b33d5ef-9594-4f0c-a3ae-55ffc442ded5. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:34:07 user nova-compute[74342]: DEBUG nova.network.neutron [req-d035ba25-f0f8-4f66-b9ff-75b1e4091346 req-dffc7d5a-b09c-4555-b195-b3f6030a9eb9 service nova] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Updating instance_info_cache with network_info: [{"id": "5b33d5ef-9594-4f0c-a3ae-55ffc442ded5", "address": "fa:16:3e:98:b5:61", "network": {"id": "f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1742429158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496a10bc096b4983bb728512bb41ac45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b33d5ef-95", "ovs_interfaceid": "5b33d5ef-9594-4f0c-a3ae-55ffc442ded5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:34:07 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-d035ba25-f0f8-4f66-b9ff-75b1e4091346 req-dffc7d5a-b09c-4555-b195-b3f6030a9eb9 service nova] Releasing lock "refresh_cache-8b602175-5dca-4c27-9944-307cafd0ab98" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:34:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:34:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:34:08 user nova-compute[74342]: DEBUG nova.compute.manager [req-3eadc6f9-af16-4dec-98d0-6006d6b18020 req-5b9a27b7-912b-42ba-8c24-bdb943016229 service nova] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Received event network-vif-plugged-5b33d5ef-9594-4f0c-a3ae-55ffc442ded5 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:34:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-3eadc6f9-af16-4dec-98d0-6006d6b18020 req-5b9a27b7-912b-42ba-8c24-bdb943016229 service nova] Acquiring lock "8b602175-5dca-4c27-9944-307cafd0ab98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:34:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-3eadc6f9-af16-4dec-98d0-6006d6b18020 req-5b9a27b7-912b-42ba-8c24-bdb943016229 service nova] Lock "8b602175-5dca-4c27-9944-307cafd0ab98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:34:08 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-3eadc6f9-af16-4dec-98d0-6006d6b18020 req-5b9a27b7-912b-42ba-8c24-bdb943016229 service nova] Lock "8b602175-5dca-4c27-9944-307cafd0ab98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:34:08 user nova-compute[74342]: DEBUG nova.compute.manager [req-3eadc6f9-af16-4dec-98d0-6006d6b18020 req-5b9a27b7-912b-42ba-8c24-bdb943016229 service nova] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] No waiting events found dispatching network-vif-plugged-5b33d5ef-9594-4f0c-a3ae-55ffc442ded5 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:34:08 user nova-compute[74342]: WARNING nova.compute.manager [req-3eadc6f9-af16-4dec-98d0-6006d6b18020 req-5b9a27b7-912b-42ba-8c24-bdb943016229 service nova] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Received unexpected event network-vif-plugged-5b33d5ef-9594-4f0c-a3ae-55ffc442ded5 for instance with vm_state building and task_state spawning.
Oct 16 10:34:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:34:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:34:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:34:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:34:10 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 is timed out.
Oct 16 10:34:10 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Successfully detached device vdb from instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 from the live domain config.
Oct 16 10:34:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'leBqTkyc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:34:10 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:34:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60bb6dc-3cd0-481b-9d31-156e7bcf2d0b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 10:34:10 user nova-compute[74342]: No targets found.
Oct 16 10:34:10 user nova-compute[74342]: iSNS:
Oct 16 10:34:10 user nova-compute[74342]: No targets found.
Oct 16 10:34:10 user nova-compute[74342]: STATIC:
Oct 16 10:34:10 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d
Oct 16 10:34:10 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:34:10 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:34:10 user nova-compute[74342]: FIRMWARE:
Oct 16 10:34:10 user nova-compute[74342]: No targets found.
Oct 16 10:34:10 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 10:34:10 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 10:34:10 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbdfeef4-4a8c-4db5-9a18-e19a0a54c9ae]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG nova.compute.manager [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Instance event wait completed in 0 seconds for  {{(pid=74342) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Guest created on hypervisor {{(pid=74342) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Oct 16 10:34:10 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Instance spawned successfully.
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8da444-4e84-4f80-8b79-19be02504677]: (4, ('tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d (non-flash)
Oct 16 10:34:10 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsi session list stdout=tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d (non-flash)
Oct 16 10:34:10 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b40733490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d'): ({'sdb'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Removing single pathed devices sdb {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[963a53d6-c0cb-4572-ba9d-9ec2eaedb332]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Found default for hw_cdrom_bus of ide {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Found default for hw_disk_bus of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Found default for hw_input_bus of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Found default for hw_pointer_model of None {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Found default for hw_video_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Found default for hw_vif_model of virtio {{(pid=74342) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.023s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58a80c0-f88a-4a65-858f-bf58a1075c2c]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Flushing IO for device /dev/sdb {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6db6469-9457-4da9-8744-f79b772241f7]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aca49b6-9500-48d7-9050-4da0f5e5b7ed]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:34:10 user nova-compute[74342]: INFO nova.compute.manager [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Took 5.31 seconds to spawn the instance on the hypervisor.
Oct 16 10:34:10 user nova-compute[74342]: DEBUG nova.compute.manager [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Checking state {{(pid=74342) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8921e5e5-1b0e-4f24-a108-970612a29409]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG nova.compute.manager [req-9472ddae-8a53-4795-95df-1809c96186a1 req-f121cb23-51ba-40dd-9350-f5c102305165 service nova] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Received event network-vif-plugged-5b33d5ef-9594-4f0c-a3ae-55ffc442ded5 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9472ddae-8a53-4795-95df-1809c96186a1 req-f121cb23-51ba-40dd-9350-f5c102305165 service nova] Acquiring lock "8b602175-5dca-4c27-9944-307cafd0ab98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9472ddae-8a53-4795-95df-1809c96186a1 req-f121cb23-51ba-40dd-9350-f5c102305165 service nova] Lock "8b602175-5dca-4c27-9944-307cafd0ab98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-9472ddae-8a53-4795-95df-1809c96186a1 req-f121cb23-51ba-40dd-9350-f5c102305165 service nova] Lock "8b602175-5dca-4c27-9944-307cafd0ab98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG nova.compute.manager [req-9472ddae-8a53-4795-95df-1809c96186a1 req-f121cb23-51ba-40dd-9350-f5c102305165 service nova] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] No waiting events found dispatching network-vif-plugged-5b33d5ef-9594-4f0c-a3ae-55ffc442ded5 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:34:10 user nova-compute[74342]: WARNING nova.compute.manager [req-9472ddae-8a53-4795-95df-1809c96186a1 req-f121cb23-51ba-40dd-9350-f5c102305165 service nova] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Received unexpected event network-vif-plugged-5b33d5ef-9594-4f0c-a3ae-55ffc442ded5 for instance with vm_state building and task_state spawning.
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39820b4-9d98-4b05-b649-2b5ebf7f62cf]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d, portal: 172.16.0.220,3260]
Oct 16 10:34:10 user nova-compute[74342]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d, portal: 172.16.0.220,3260] successful.
Oct 16 10:34:10 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:34:10 user nova-compute[74342]: INFO nova.compute.manager [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Took 5.89 seconds to build instance.
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:33046bb7-7e75-4efe-8883-006f758b8e4d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5072459-703f-445e-9ef5-f8690e5a85d1]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] <== disconnect_volume: return (299ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 10:34:10 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-7a2c9014-1c51-4b6b-89a2-c37b83f10136 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "8b602175-5dca-4c27-9944-307cafd0ab98" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.989s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:34:11 user nova-compute[74342]: DEBUG nova.objects.instance [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lazy-loading 'flavor' on Instance uuid 7fa98a0b-38b5-4414-a91a-825638eb22d5 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:34:11 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b6a5d501-b338-454c-ad82-37506915a75b tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.726s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:34:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:34:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:34:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:34:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:34:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:34:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:34:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:34:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:34:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:34:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:34:28 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:34:29 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:34:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:34:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:34:35 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:34:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:34:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:34:35 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:34:35 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:34:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:34:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:34:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:34:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:34:35 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b602175-5dca-4c27-9944-307cafd0ab98/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:34:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b602175-5dca-4c27-9944-307cafd0ab98/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:34:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b602175-5dca-4c27-9944-307cafd0ab98/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:34:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b602175-5dca-4c27-9944-307cafd0ab98/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:34:36 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:34:36 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:34:36 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8837MB free_disk=24.925865173339844GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:34:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:34:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:34:36 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:34:36 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 8b602175-5dca-4c27-9944-307cafd0ab98 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:34:36 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:34:36 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:34:36 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:34:36 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:34:36 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:34:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:34:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:34:37 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:34:37 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:34:38 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:34:38 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:34:38 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:34:39 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:34:40 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:34:40 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:34:40 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Rebuilding the list of instances to heal {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 10:34:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-7fa98a0b-38b5-4414-a91a-825638eb22d5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:34:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-7fa98a0b-38b5-4414-a91a-825638eb22d5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:34:40 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:34:40 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lazy-loading 'info_cache' on Instance uuid 7fa98a0b-38b5-4414-a91a-825638eb22d5 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:34:40 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Updating instance_info_cache with network_info: [{"id": "e8604c7a-955c-4392-9516-9d857e0b853c", "address": "fa:16:3e:2b:c3:c5", "network": {"id": "8e5b686c-cd9a-4ac1-866b-24bdde0a8f6f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-307409530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de9fb210571447cdb6214d66f66a4d73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8604c7a-95", "ovs_interfaceid": "e8604c7a-955c-4392-9516-9d857e0b853c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:34:40 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-7fa98a0b-38b5-4414-a91a-825638eb22d5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:34:40 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:34:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:34:41 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:34:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:34:43 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:34:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:34:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:34:45 user nova-compute[74342]: DEBUG nova.objects.instance [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lazy-loading 'flavor' on Instance uuid 7fa98a0b-38b5-4414-a91a-825638eb22d5 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:34:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:34:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:34:45 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:34:45 user nova-compute[74342]: INFO nova.compute.manager [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Attaching volume fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3 to /dev/vdb
Oct 16 10:34:45 user nova-compute[74342]: DEBUG os_brick.utils [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:34:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:34:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:34:45 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0833690-8cb0-4429-9cb1-5412504b772d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:34:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:34:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:34:45 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[64e9079b-a8bd-43f8-9db0-edba85ec5ddb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:34:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:34:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:34:45 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4de97e6-5ecc-46da-a5f7-3919457c90ad]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:34:45 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e6b6955-0570-4c50-88e3-08f8cb77e9be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:34:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:34:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:34:45 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 10:34:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:34:45 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:34:45 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 10:34:45 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[343b39c2-6de1-4ada-9c11-b1ff7ced2e08]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:34:45 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 10:34:45 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 10:34:45 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 10:34:45 user nova-compute[74342]: DEBUG os_brick.utils [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:34:45 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Updating existing volume attachment record: b2569409-5deb-44ac-a8e8-63a9f27bef7e {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 10:34:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:34:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:34:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:34:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:34:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:34:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:34:48 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:34:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:34:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:34:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:34:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:34:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:34:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:34:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WXtFlKcJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:35:00 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:35:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:35:00 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:35:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:35:00 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 10:35:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3 -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[99cf3b66-0c21-4612-acc4-9ce515b6b554]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 10:35:00 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f93648d5-ea56-4fd7-929d-5151251dd2a4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3] added
Oct 16 10:35:00 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab710fa-7897-4ebc-841f-9dde6a1e7bf3]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbad5559-ab50-4012-9d96-60326e6f53e2]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WXtFlKcJ {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WXtFlKcJ" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2aa8cd7-9533-4c21-a064-827b7acb8ae7]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WXtFlKcJ'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b121422a-d704-411c-b4a2-8be23d884da9]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eeba1c5-ca35-405e-a6e6-ecc0f5000720]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 10:35:00 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:35:00 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 10:35:00 user nova-compute[74342]:  {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:35:00 user nova-compute[74342]: WARNING os_brick.initiator.connectors.iscsi [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 10:35:00 user nova-compute[74342]: 
Oct 16 10:35:00 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3 -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:35:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:35:01 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7e131b-1036-4a95-bc46-20e43f90d5be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:35:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3, portal: 172.16.0.220,3260]
Oct 16 10:35:01 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3, portal: 172.16.0.220,3260] successful.
Oct 16 10:35:01 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:35:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:35:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:35:01 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f597e5-2855-4a2f-bfc8-0b6fcc38a867]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:35:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:35:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:35:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:35:01 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a0cf87-67c8-4d59-9cf6-93a626db9a2a]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:35:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3 (non-flash)
Oct 16 10:35:01 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:35:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3 (non-flash)
Oct 16 10:35:01 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:35:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.238s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:35:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 10:35:01 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] HCTL ('33', '-', '-', 0) found on session 48 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 10:35:01 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 10:35:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:35:01 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:35:01 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6af6aab-93c0-49f9-9a16-35f97054b031]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:35:01 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Searching for a device in session 48 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 10:35:01 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WXtFlKcJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 10:35:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:35:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:35:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:35:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:35:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:35:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:35:02 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.268s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:35:02 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] <== connect_volume: return (1270ms) {'type': 'block', 'scsi_wwn': '26630333065633738', 'path': '/dev/sdb'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:35:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26630333065633738', 'path': '/dev/sdb'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 10:35:02 user nova-compute[74342]: DEBUG nova.objects.instance [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lazy-loading 'flavor' on Instance uuid 7fa98a0b-38b5-4414-a91a-825638eb22d5 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:35:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 10:35:02 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:35:02 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 10:35:02 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:35:02 user nova-compute[74342]:   <serial>fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3</serial>
Oct 16 10:35:02 user nova-compute[74342]: </disk>
Oct 16 10:35:02 user nova-compute[74342]:  {{(pid=74342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 10:35:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:35:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:35:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] No VIF found with MAC fa:16:3e:2b:c3:c5, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:35:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-b2739996-734b-472c-b231-c49cfbe2114a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.264s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:35:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:35:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:35:05 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:35:05 user nova-compute[74342]: INFO nova.compute.manager [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Detaching volume fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3
Oct 16 10:35:05 user nova-compute[74342]: INFO nova.virt.block_device [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Attempting to driver detach volume fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3 from mountpoint /dev/vdb
Oct 16 10:35:05 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Attempting to detach device vdb from instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 from the persistent domain config. {{(pid=74342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 10:35:05 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 10:35:05 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:35:05 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 10:35:05 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:35:05 user nova-compute[74342]:   <serial>fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3</serial>
Oct 16 10:35:05 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 10:35:05 user nova-compute[74342]: </disk>
Oct 16 10:35:05 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 10:35:05 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Successfully detached device vdb from instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 from the persistent domain config.
Oct 16 10:35:05 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 from the live domain config. {{(pid=74342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 10:35:05 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 10:35:05 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:35:05 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 10:35:05 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:35:05 user nova-compute[74342]:   <serial>fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3</serial>
Oct 16 10:35:05 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 10:35:05 user nova-compute[74342]: </disk>
Oct 16 10:35:05 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 10:35:05 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 {{(pid=74342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 10:35:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:35:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:35:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:35:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:35:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:35:25 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 is timed out.
Oct 16 10:35:25 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Successfully detached device vdb from instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 from the live domain config.
Oct 16 10:35:25 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 10:35:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WXtFlKcJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:35:25 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:35:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:35:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:35:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:35:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:35:25 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[856bc2de-914b-4622-9d71-daf9729f7a70]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:35:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 10:35:25 user nova-compute[74342]: No targets found.
Oct 16 10:35:25 user nova-compute[74342]: iSNS:
Oct 16 10:35:25 user nova-compute[74342]: No targets found.
Oct 16 10:35:25 user nova-compute[74342]: STATIC:
Oct 16 10:35:25 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3
Oct 16 10:35:25 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:35:25 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:35:25 user nova-compute[74342]: FIRMWARE:
Oct 16 10:35:25 user nova-compute[74342]: No targets found.
Oct 16 10:35:25 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:35:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 10:35:25 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 10:35:25 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 10:35:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 10:35:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:35:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:35:25 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b56391a-9586-41ab-8ebd-55faeaa21c08]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:35:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:35:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:35:25 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5864d2ee-6afc-4fff-92a8-83f94d721eff]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:35:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3 (non-flash)
Oct 16 10:35:25 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:35:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3 (non-flash)
Oct 16 10:35:25 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:35:25 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b601955a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3'): ({'sdb'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 10:35:25 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Removing single pathed devices sdb {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 10:35:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:35:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:35:25 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[faac32de-edf9-4268-af1a-5788c4109aba]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:35:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:35:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:35:25 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[451211c9-877f-4548-b83d-ee72c42e6355]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:35:25 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Flushing IO for device /dev/sdb {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 10:35:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:35:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:35:25 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[96593f17-be93-438e-ac48-d879e5a0978f]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:35:25 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 10:35:25 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:35:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:35:26 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b29bcee-73c9-4bb4-8fc2-53d09ce30c3f]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:35:26 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 10:35:26 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 10:35:26 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 10:35:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:35:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:35:26 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e41efc-ab5d-426c-bf09-008d04463c22]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:35:26 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:35:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3 -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:35:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:35:26 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[16379d5b-5c89-4ba8-ae5a-375339eb374f]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:35:26 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3, portal: 172.16.0.220,3260]
Oct 16 10:35:26 user nova-compute[74342]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3, portal: 172.16.0.220,3260] successful.
Oct 16 10:35:26 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:35:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3 -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:35:26 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb43e18d-3d32-40b6-a4e4-ad05fad6c5f3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:35:26 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe231cb-af77-4dbe-ad63-5f7573e96c39]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:35:26 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:35:26 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.281s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:35:26 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] <== disconnect_volume: return (283ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:35:26 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 10:35:26 user nova-compute[74342]: DEBUG nova.objects.instance [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lazy-loading 'flavor' on Instance uuid 7fa98a0b-38b5-4414-a91a-825638eb22d5 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:35:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-45a07ece-259e-4cee-a941-743439d5854a tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.770s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:35:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:35:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:35:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:35:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:35:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:35:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:35:31 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:35:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:35:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:35:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:35:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:35:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:35:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:35:36 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:35:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:35:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:35:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:35:36 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:35:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:35:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:35:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:35:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:35:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b602175-5dca-4c27-9944-307cafd0ab98/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:35:37 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b602175-5dca-4c27-9944-307cafd0ab98/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:35:37 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b602175-5dca-4c27-9944-307cafd0ab98/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:35:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:35:37 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b602175-5dca-4c27-9944-307cafd0ab98/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:35:37 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:35:37 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:35:37 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8891MB free_disk=24.924606323242188GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:35:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:35:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:35:37 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:35:37 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 8b602175-5dca-4c27-9944-307cafd0ab98 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:35:37 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:35:37 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:35:37 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:35:37 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:35:37 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:35:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:35:38 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:35:38 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:35:38 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:35:39 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:35:39 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:35:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:35:41 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:35:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-8b602175-5dca-4c27-9944-307cafd0ab98" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:35:41 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-8b602175-5dca-4c27-9944-307cafd0ab98" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:35:41 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:35:42 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Updating instance_info_cache with network_info: [{"id": "5b33d5ef-9594-4f0c-a3ae-55ffc442ded5", "address": "fa:16:3e:98:b5:61", "network": {"id": "f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1742429158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496a10bc096b4983bb728512bb41ac45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b33d5ef-95", "ovs_interfaceid": "5b33d5ef-9594-4f0c-a3ae-55ffc442ded5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:35:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-8b602175-5dca-4c27-9944-307cafd0ab98" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:35:42 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:35:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:35:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:35:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:35:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:35:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:35:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:35:42 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:35:42 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:35:46 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:35:46 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Cleaning up deleted instances with incomplete migration  {{(pid=74342) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11246}}
Oct 16 10:35:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:35:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:35:54 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:35:54 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Cleaning up deleted instances {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11208}}
Oct 16 10:35:54 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] There are 1 instances to clean {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11217}}
Oct 16 10:35:54 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: c5e44d3b-ed41-4920-825f-e1d283caecfd] Instance has had 5 of 5 cleanup attempts {{(pid=74342) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11221}}
Oct 16 10:35:55 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:35:55 user nova-compute[74342]: DEBUG nova.compute.manager [req-b8036997-f649-4546-8a32-405777aca251 req-1f9d0590-a9e1-46e8-868e-893f68f20872 service nova] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Received event network-changed-5b33d5ef-9594-4f0c-a3ae-55ffc442ded5 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:35:55 user nova-compute[74342]: DEBUG nova.compute.manager [req-b8036997-f649-4546-8a32-405777aca251 req-1f9d0590-a9e1-46e8-868e-893f68f20872 service nova] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Refreshing instance network info cache due to event network-changed-5b33d5ef-9594-4f0c-a3ae-55ffc442ded5. {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11116}}
Oct 16 10:35:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b8036997-f649-4546-8a32-405777aca251 req-1f9d0590-a9e1-46e8-868e-893f68f20872 service nova] Acquiring lock "refresh_cache-8b602175-5dca-4c27-9944-307cafd0ab98" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:35:55 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b8036997-f649-4546-8a32-405777aca251 req-1f9d0590-a9e1-46e8-868e-893f68f20872 service nova] Acquired lock "refresh_cache-8b602175-5dca-4c27-9944-307cafd0ab98" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:35:55 user nova-compute[74342]: DEBUG nova.network.neutron [req-b8036997-f649-4546-8a32-405777aca251 req-1f9d0590-a9e1-46e8-868e-893f68f20872 service nova] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Refreshing network info cache for port 5b33d5ef-9594-4f0c-a3ae-55ffc442ded5 {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Oct 16 10:35:56 user nova-compute[74342]: DEBUG nova.network.neutron [req-b8036997-f649-4546-8a32-405777aca251 req-1f9d0590-a9e1-46e8-868e-893f68f20872 service nova] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Updated VIF entry in instance network info cache for port 5b33d5ef-9594-4f0c-a3ae-55ffc442ded5. {{(pid=74342) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Oct 16 10:35:56 user nova-compute[74342]: DEBUG nova.network.neutron [req-b8036997-f649-4546-8a32-405777aca251 req-1f9d0590-a9e1-46e8-868e-893f68f20872 service nova] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Updating instance_info_cache with network_info: [{"id": "5b33d5ef-9594-4f0c-a3ae-55ffc442ded5", "address": "fa:16:3e:98:b5:61", "network": {"id": "f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1742429158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496a10bc096b4983bb728512bb41ac45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b33d5ef-95", "ovs_interfaceid": "5b33d5ef-9594-4f0c-a3ae-55ffc442ded5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:35:56 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-b8036997-f649-4546-8a32-405777aca251 req-1f9d0590-a9e1-46e8-868e-893f68f20872 service nova] Releasing lock "refresh_cache-8b602175-5dca-4c27-9944-307cafd0ab98" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "8b602175-5dca-4c27-9944-307cafd0ab98" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "8b602175-5dca-4c27-9944-307cafd0ab98" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG nova.objects.instance [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lazy-loading 'flavor' on Instance uuid 8b602175-5dca-4c27-9944-307cafd0ab98 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:35:57 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Ignoring supplied device name: /dev/vdb
Oct 16 10:35:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "8b602175-5dca-4c27-9944-307cafd0ab98" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "8b602175-5dca-4c27-9944-307cafd0ab98" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "8b602175-5dca-4c27-9944-307cafd0ab98" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:35:57 user nova-compute[74342]: INFO nova.compute.manager [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Attaching volume c3e38539-9625-4cc9-8ef5-90eec6a72cc3 to /dev/vdb
Oct 16 10:35:57 user nova-compute[74342]: DEBUG os_brick.utils [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9708e3-f82a-4767-8c91-6005e2d0fbac]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:c686296c3e90\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a046f9b-38b8-445c-bd7e-433313e90bc4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[11eca4b2-876d-4fac-b176-7a7948b07253]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b02284a0-58f6-4d2a-94a3-05b5fedda632]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Running cmd (subprocess): nvme version {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] 'nvme version' failed. Not Retrying. {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] nvme not present on system {{(pid=74342) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:35:57 user nova-compute[74342]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Oct 16 10:35:57 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e429166-8d9f-4aa2-b5d6-7321cd51ac3d]: (4, '') {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=74342) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.lightos [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] LIGHTOS: no hostnqn found. {{(pid=74342) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG os_brick.utils [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:c686296c3e90', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:35:57 user nova-compute[74342]: DEBUG nova.virt.block_device [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Updating existing volume attachment record: 48d2f050-6576-407b-8bf6-54f258699f56 {{(pid=74342) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Oct 16 10:35:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:36:02 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:36:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:36:07 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:36:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:36:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:36:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:36:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:36:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:36:12 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Calling os-brick to attach iSCSI Volume {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sCPHfMhK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:36:13 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:36:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:36:13 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:36:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:36:13 user nova-compute[74342]: INFO os_brick.initiator.connectors.iscsi [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3 -p 172.16.0.220:3260 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bf76d6-7e17-4a85-bc45-981d791dc07b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Oct 16 10:36:13 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3 -p 172.16.0.220:3260 --interface default --op new {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[3791058d-73ce-4733-8349-ee70f2a0ebb3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3] added\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3] added
Oct 16 10:36:13 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d1325c-a20e-451c-bc9d-c15b602aca16]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62b85e6-effd-4917-925d-e9d0fe8ecf36]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sCPHfMhK {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sCPHfMhK" returned: 0 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a1e4f1-f8bb-4807-a6f7-c7b401db2e5a]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sCPHfMhK'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f6ac7e0-4708-4289-9c21-673663abc93a]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b4e1800-d032-4589-8d82-e4b71eeebf37]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Oct 16 10:36:13 user nova-compute[74342]:  {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Oct 16 10:36:13 user nova-compute[74342]:  {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:36:13 user nova-compute[74342]: WARNING os_brick.initiator.connectors.iscsi [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Oct 16 10:36:13 user nova-compute[74342]: 
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3 -p 172.16.0.220:3260 --login {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3 -p 172.16.0.220:3260 --login" returned: 0 in 0.044s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a02fe2-5e88-49e7-aa1f-c22e604d26e7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3, portal: 172.16.0.220,3260]
Oct 16 10:36:13 user nova-compute[74342]: Login to [iface: default, target: iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3, portal: 172.16.0.220,3260] successful.
Oct 16 10:36:13 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5e6924-8f1e-4283-b66c-69821aed8d27]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b4354f-a3a6-4edc-8d52-efe1bee97f0d]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3 (non-flash)
Oct 16 10:36:13 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3 (non-flash)
Oct 16 10:36:13 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Connected to 172.16.0.220:3260 {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=74342) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=74342) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[0362bd45-334b-4f32-8055-403b6c4b42b5]: (4, ('- - 0', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:36:13 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 10:36:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:36:14 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=74342) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Oct 16 10:36:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sCPHfMhK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=74342) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Oct 16 10:36:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.283s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:36:14 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] <== connect_volume: return (1284ms) {'type': 'block', 'scsi_wwn': '23431393630383938', 'path': '/dev/sdb'} {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:36:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23431393630383938', 'path': '/dev/sdb'} {{(pid=74342) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Oct 16 10:36:14 user nova-compute[74342]: DEBUG nova.objects.instance [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lazy-loading 'flavor' on Instance uuid 8b602175-5dca-4c27-9944-307cafd0ab98 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:36:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] attach device xml: <disk type="block" device="disk">
Oct 16 10:36:14 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:36:14 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 10:36:14 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:36:14 user nova-compute[74342]:   <serial>c3e38539-9625-4cc9-8ef5-90eec6a72cc3</serial>
Oct 16 10:36:14 user nova-compute[74342]: </disk>
Oct 16 10:36:14 user nova-compute[74342]:  {{(pid=74342) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Oct 16 10:36:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] No BDM found with device name vda, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:36:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] No BDM found with device name vdb, not building metadata. {{(pid=74342) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Oct 16 10:36:14 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] No VIF found with MAC fa:16:3e:98:b5:61, not building metadata {{(pid=74342) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Oct 16 10:36:15 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-a1e4aebc-33d8-45df-816e-a70ccd43d2ba tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "8b602175-5dca-4c27-9944-307cafd0ab98" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 17.830s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:36:17 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:36:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:36:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:36:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:36:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:36:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:36:22 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:36:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:36:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:36:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:36:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:36:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:36:27 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:36:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:36:32 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:36:32 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:36:36 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:36:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:36:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:36:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:36:36 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:36:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:36:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:36:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:36:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:36:36 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b602175-5dca-4c27-9944-307cafd0ab98/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:36:37 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b602175-5dca-4c27-9944-307cafd0ab98/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:36:37 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b602175-5dca-4c27-9944-307cafd0ab98/disk --force-share --output=json {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:36:37 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:36:37 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8b602175-5dca-4c27-9944-307cafd0ab98/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=74342) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:36:37 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=74342) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Oct 16 10:36:37 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:36:37 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:36:37 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=8875MB free_disk=24.923145294189453GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:36:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:36:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:36:37 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 7fa98a0b-38b5-4414-a91a-825638eb22d5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:36:37 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Instance 8b602175-5dca-4c27-9944-307cafd0ab98 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=74342) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Oct 16 10:36:37 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:36:37 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:36:37 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Refreshing inventories for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Oct 16 10:36:37 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Updating ProviderTree inventory for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Oct 16 10:36:37 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Updating inventory in ProviderTree for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Oct 16 10:36:37 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Refreshing aggregate associations for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca, aggregates: None {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Oct 16 10:36:37 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Refreshing trait associations for resource provider b5ec9788-0ade-4d36-b3d5-0cad880481ca, traits: COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_VOLUME_EXTEND,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_STORAGE_BUS_SATA,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE2,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_SSSE3,HW_CPU_X86_MMX,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_STORAGE_BUS_IDE,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NODE,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE41,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_DEVICE_TAGGING {{(pid=74342) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Oct 16 10:36:38 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:36:38 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:36:38 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:36:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.380s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:36:39 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:36:39 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:36:40 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:36:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:36:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:36:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:36:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:36:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:36:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:36:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:36:42 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:36:42 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:36:42 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:36:42 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Rebuilding the list of instances to heal {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 10:36:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "refresh_cache-7fa98a0b-38b5-4414-a91a-825638eb22d5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Oct 16 10:36:42 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquired lock "refresh_cache-7fa98a0b-38b5-4414-a91a-825638eb22d5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Oct 16 10:36:42 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Forcefully refreshing network info cache for instance {{(pid=74342) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Oct 16 10:36:42 user nova-compute[74342]: DEBUG nova.objects.instance [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lazy-loading 'info_cache' on Instance uuid 7fa98a0b-38b5-4414-a91a-825638eb22d5 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:36:43 user nova-compute[74342]: DEBUG nova.network.neutron [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Updating instance_info_cache with network_info: [{"id": "e8604c7a-955c-4392-9516-9d857e0b853c", "address": "fa:16:3e:2b:c3:c5", "network": {"id": "8e5b686c-cd9a-4ac1-866b-24bdde0a8f6f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-307409530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de9fb210571447cdb6214d66f66a4d73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8604c7a-95", "ovs_interfaceid": "e8604c7a-955c-4392-9516-9d857e0b853c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:36:43 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Releasing lock "refresh_cache-7fa98a0b-38b5-4414-a91a-825638eb22d5" {{(pid=74342) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Oct 16 10:36:43 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Updated the network info_cache for instance {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9992}}
Oct 16 10:36:43 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:36:43 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:36:45 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:36:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:36:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:36:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:36:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:36:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:36:47 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:36:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:36:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:36:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:36:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:36:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:36:52 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:36:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:36:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:36:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:36:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:36:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:36:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:36:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-dbb83099-0057-4a28-9f70-5371f4061e5d tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:36:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-dbb83099-0057-4a28-9f70-5371f4061e5d tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:36:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-dbb83099-0057-4a28-9f70-5371f4061e5d tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "7fa98a0b-38b5-4414-a91a-825638eb22d5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:36:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-dbb83099-0057-4a28-9f70-5371f4061e5d tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:36:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-dbb83099-0057-4a28-9f70-5371f4061e5d tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:36:57 user nova-compute[74342]: INFO nova.compute.manager [None req-dbb83099-0057-4a28-9f70-5371f4061e5d tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Terminating instance
Oct 16 10:36:57 user nova-compute[74342]: DEBUG nova.compute.manager [None req-dbb83099-0057-4a28-9f70-5371f4061e5d tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 10:36:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:36:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:36:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:36:57 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:36:57 user nova-compute[74342]: DEBUG nova.compute.manager [req-f14de921-90db-4b85-9b86-e32622848e38 req-a692dcaf-12d8-4161-895b-0a29d90d0cca service nova] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Received event network-vif-unplugged-e8604c7a-955c-4392-9516-9d857e0b853c {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:36:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f14de921-90db-4b85-9b86-e32622848e38 req-a692dcaf-12d8-4161-895b-0a29d90d0cca service nova] Acquiring lock "7fa98a0b-38b5-4414-a91a-825638eb22d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:36:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f14de921-90db-4b85-9b86-e32622848e38 req-a692dcaf-12d8-4161-895b-0a29d90d0cca service nova] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:36:57 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-f14de921-90db-4b85-9b86-e32622848e38 req-a692dcaf-12d8-4161-895b-0a29d90d0cca service nova] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:36:57 user nova-compute[74342]: DEBUG nova.compute.manager [req-f14de921-90db-4b85-9b86-e32622848e38 req-a692dcaf-12d8-4161-895b-0a29d90d0cca service nova] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] No waiting events found dispatching network-vif-unplugged-e8604c7a-955c-4392-9516-9d857e0b853c {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:36:57 user nova-compute[74342]: DEBUG nova.compute.manager [req-f14de921-90db-4b85-9b86-e32622848e38 req-a692dcaf-12d8-4161-895b-0a29d90d0cca service nova] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Received event network-vif-unplugged-e8604c7a-955c-4392-9516-9d857e0b853c for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 10:36:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:36:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:36:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:36:58 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Instance destroyed successfully.
Oct 16 10:36:58 user nova-compute[74342]: DEBUG nova.objects.instance [None req-dbb83099-0057-4a28-9f70-5371f4061e5d tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lazy-loading 'resources' on Instance uuid 7fa98a0b-38b5-4414-a91a-825638eb22d5 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:36:58 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-dbb83099-0057-4a28-9f70-5371f4061e5d tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:28:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-234596148',display_name='tempest-SnapshotDataIntegrityTests-server-234596148',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-234596148',id=50,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBECbWVudvJkfaq41Zuv1ODsOv99vUkO98pATFseINH94V1uNDF3kjirNBJCPxc4Hr7dtEiCIXynnmDNEHI/wegS73Bmhe4dzz8a/mdBfYJsHkmaV+ZOGdNnWzHyHTFc21w==',key_name='tempest-keypair-1374655736',keypairs=<?>,launch_index=0,launched_at=2023-10-16T10:28:31Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='de9fb210571447cdb6214d66f66a4d73',ramdisk_id='',reservation_id='r-826rs0g0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1094472811',owner_user_name='tempest-SnapshotDataIntegrityTests-1094472811-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T10:28:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5c28bea56bdf44d8b485e09faa6f6f08',uuid=7fa98a0b-38b5-4414-a91a-825638eb22d5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e8604c7a-955c-4392-9516-9d857e0b853c", "address": "fa:16:3e:2b:c3:c5", "network": {"id": "8e5b686c-cd9a-4ac1-866b-24bdde0a8f6f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-307409530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de9fb210571447cdb6214d66f66a4d73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8604c7a-95", "ovs_interfaceid": "e8604c7a-955c-4392-9516-9d857e0b853c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 10:36:58 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-dbb83099-0057-4a28-9f70-5371f4061e5d tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Converting VIF {"id": "e8604c7a-955c-4392-9516-9d857e0b853c", "address": "fa:16:3e:2b:c3:c5", "network": {"id": "8e5b686c-cd9a-4ac1-866b-24bdde0a8f6f", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-307409530-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "de9fb210571447cdb6214d66f66a4d73", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape8604c7a-95", "ovs_interfaceid": "e8604c7a-955c-4392-9516-9d857e0b853c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:36:58 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-dbb83099-0057-4a28-9f70-5371f4061e5d tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2b:c3:c5,bridge_name='br-int',has_traffic_filtering=True,id=e8604c7a-955c-4392-9516-9d857e0b853c,network=Network(8e5b686c-cd9a-4ac1-866b-24bdde0a8f6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8604c7a-95') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:36:58 user nova-compute[74342]: DEBUG os_vif [None req-dbb83099-0057-4a28-9f70-5371f4061e5d tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:c3:c5,bridge_name='br-int',has_traffic_filtering=True,id=e8604c7a-955c-4392-9516-9d857e0b853c,network=Network(8e5b686c-cd9a-4ac1-866b-24bdde0a8f6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8604c7a-95') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 10:36:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:36:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape8604c7a-95, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:36:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:36:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:36:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:36:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=343e80ed-e36c-4a71-b9bf-6f69e9d7e82a) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:36:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:36:58 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:36:58 user nova-compute[74342]: INFO os_vif [None req-dbb83099-0057-4a28-9f70-5371f4061e5d tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2b:c3:c5,bridge_name='br-int',has_traffic_filtering=True,id=e8604c7a-955c-4392-9516-9d857e0b853c,network=Network(8e5b686c-cd9a-4ac1-866b-24bdde0a8f6f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape8604c7a-95')
Oct 16 10:36:58 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-dbb83099-0057-4a28-9f70-5371f4061e5d tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Deleting instance files /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5_del
Oct 16 10:36:58 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-dbb83099-0057-4a28-9f70-5371f4061e5d tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Deletion of /opt/stack/data/nova/instances/7fa98a0b-38b5-4414-a91a-825638eb22d5_del complete
Oct 16 10:36:58 user nova-compute[74342]: INFO nova.compute.manager [None req-dbb83099-0057-4a28-9f70-5371f4061e5d tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Took 0.88 seconds to destroy the instance on the hypervisor.
Oct 16 10:36:58 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-dbb83099-0057-4a28-9f70-5371f4061e5d tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 10:36:58 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 10:36:58 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 10:36:59 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:36:59 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Took 0.96 seconds to deallocate network for instance.
Oct 16 10:36:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-dbb83099-0057-4a28-9f70-5371f4061e5d tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:36:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-dbb83099-0057-4a28-9f70-5371f4061e5d tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:36:59 user nova-compute[74342]: DEBUG nova.compute.manager [req-8cfde209-d3e2-4499-a85a-d3c609af16f0 req-5957fe8d-7bd4-40e1-92ba-4555d2e00d59 service nova] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Received event network-vif-deleted-e8604c7a-955c-4392-9516-9d857e0b853c {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:36:59 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-dbb83099-0057-4a28-9f70-5371f4061e5d tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:36:59 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-dbb83099-0057-4a28-9f70-5371f4061e5d tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:36:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-dbb83099-0057-4a28-9f70-5371f4061e5d tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.194s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:36:59 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-dbb83099-0057-4a28-9f70-5371f4061e5d tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Deleted allocations for instance 7fa98a0b-38b5-4414-a91a-825638eb22d5
Oct 16 10:36:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-dbb83099-0057-4a28-9f70-5371f4061e5d tempest-SnapshotDataIntegrityTests-1094472811 tempest-SnapshotDataIntegrityTests-1094472811-project-member] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.285s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:36:59 user nova-compute[74342]: DEBUG nova.compute.manager [req-84f99304-00e8-4f67-badb-fa0fb2d9bf9a req-75929168-d76f-47a0-80aa-d5ff30d2fca7 service nova] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Received event network-vif-plugged-e8604c7a-955c-4392-9516-9d857e0b853c {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:36:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-84f99304-00e8-4f67-badb-fa0fb2d9bf9a req-75929168-d76f-47a0-80aa-d5ff30d2fca7 service nova] Acquiring lock "7fa98a0b-38b5-4414-a91a-825638eb22d5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:36:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-84f99304-00e8-4f67-badb-fa0fb2d9bf9a req-75929168-d76f-47a0-80aa-d5ff30d2fca7 service nova] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:36:59 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-84f99304-00e8-4f67-badb-fa0fb2d9bf9a req-75929168-d76f-47a0-80aa-d5ff30d2fca7 service nova] Lock "7fa98a0b-38b5-4414-a91a-825638eb22d5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:36:59 user nova-compute[74342]: DEBUG nova.compute.manager [req-84f99304-00e8-4f67-badb-fa0fb2d9bf9a req-75929168-d76f-47a0-80aa-d5ff30d2fca7 service nova] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] No waiting events found dispatching network-vif-plugged-e8604c7a-955c-4392-9516-9d857e0b853c {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:36:59 user nova-compute[74342]: WARNING nova.compute.manager [req-84f99304-00e8-4f67-badb-fa0fb2d9bf9a req-75929168-d76f-47a0-80aa-d5ff30d2fca7 service nova] [instance: 7fa98a0b-38b5-4414-a91a-825638eb22d5] Received unexpected event network-vif-plugged-e8604c7a-955c-4392-9516-9d857e0b853c for instance with vm_state deleted and task_state None.
Oct 16 10:37:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "8b602175-5dca-4c27-9944-307cafd0ab98" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:37:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "8b602175-5dca-4c27-9944-307cafd0ab98" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:37:02 user nova-compute[74342]: INFO nova.compute.manager [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Detaching volume c3e38539-9625-4cc9-8ef5-90eec6a72cc3
Oct 16 10:37:02 user nova-compute[74342]: INFO nova.virt.block_device [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Attempting to driver detach volume c3e38539-9625-4cc9-8ef5-90eec6a72cc3 from mountpoint /dev/vdb
Oct 16 10:37:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Attempting to detach device vdb from instance 8b602175-5dca-4c27-9944-307cafd0ab98 from the persistent domain config. {{(pid=74342) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Oct 16 10:37:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 10:37:02 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:37:02 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 10:37:02 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:37:02 user nova-compute[74342]:   <serial>c3e38539-9625-4cc9-8ef5-90eec6a72cc3</serial>
Oct 16 10:37:02 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 10:37:02 user nova-compute[74342]: </disk>
Oct 16 10:37:02 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 10:37:02 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Successfully detached device vdb from instance 8b602175-5dca-4c27-9944-307cafd0ab98 from the persistent domain config.
Oct 16 10:37:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8b602175-5dca-4c27-9944-307cafd0ab98 from the live domain config. {{(pid=74342) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Oct 16 10:37:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.guest [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] detach device xml: <disk type="block" device="disk">
Oct 16 10:37:02 user nova-compute[74342]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Oct 16 10:37:02 user nova-compute[74342]:   <source dev="/dev/sdb"/>
Oct 16 10:37:02 user nova-compute[74342]:   <target dev="vdb" bus="virtio"/>
Oct 16 10:37:02 user nova-compute[74342]:   <serial>c3e38539-9625-4cc9-8ef5-90eec6a72cc3</serial>
Oct 16 10:37:02 user nova-compute[74342]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Oct 16 10:37:02 user nova-compute[74342]: </disk>
Oct 16 10:37:02 user nova-compute[74342]:  {{(pid=74342) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Oct 16 10:37:02 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "8b602175-5dca-4c27-9944-307cafd0ab98" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:37:02 user nova-compute[74342]: DEBUG nova.virt.libvirt.driver [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8b602175-5dca-4c27-9944-307cafd0ab98 {{(pid=74342) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Oct 16 10:37:03 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:37:08 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:37:13 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:37:18 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:37:22 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8b602175-5dca-4c27-9944-307cafd0ab98 is timed out.
Oct 16 10:37:22 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Successfully detached device vdb from instance 8b602175-5dca-4c27-9944-307cafd0ab98 from the live domain config.
Oct 16 10:37:22 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sCPHfMhK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:37:22 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:37:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[26286de0-ebb4-4bce-8c13-51e03d7ae20d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Oct 16 10:37:22 user nova-compute[74342]: No targets found.
Oct 16 10:37:22 user nova-compute[74342]: iSNS:
Oct 16 10:37:22 user nova-compute[74342]: No targets found.
Oct 16 10:37:22 user nova-compute[74342]: STATIC:
Oct 16 10:37:22 user nova-compute[74342]: Target: iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3
Oct 16 10:37:22 user nova-compute[74342]:         Portal: 172.16.0.220:3260,-1
Oct 16 10:37:22 user nova-compute[74342]:                 Iface Name: default
Oct 16 10:37:22 user nova-compute[74342]: FIRMWARE:
Oct 16 10:37:22 user nova-compute[74342]: No targets found.
Oct 16 10:37:22 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Oct 16 10:37:22 user nova-compute[74342]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Oct 16 10:37:22 user nova-compute[74342]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=74342) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3', 0)] {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fc5f46f-7bec-41e4-99d3-53edd78477e7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[6685eb8d-6d6f-421a-908e-0ee8fe08d74d]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3 (non-flash)\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3 (non-flash)
Oct 16 10:37:22 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3 (non-flash)
Oct 16 10:37:22 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f2b803d6200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3'): ({'sdb'}, set())}) {{(pid=74342) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Removing single pathed devices sdb {{(pid=74342) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf6b32b6-0138-4c5c-a396-90cca08d0021]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5dba952-543e-4dcf-8fbc-ff2c466be65c]: (4, ('ok\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Flushing IO for device /dev/sdb {{(pid=74342) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4be8da8-52cc-476b-9c6e-3fcb016eada0]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=74342) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[7540a792-39cb-45d7-830f-c1623b6fd8e9]: (4, ('1', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG os_brick.initiator.linuxscsi [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] SCSI volumes sdb have been removed. {{(pid=74342) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3')] {{(pid=74342) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[76abfa4f-bb3c-426d-931f-324cb227c5ee]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3 -p 172.16.0.220:3260 --logout {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[2861ae30-bd4f-411d-8b4a-844cb3cae556]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3, portal: 172.16.0.220,3260]
Oct 16 10:37:22 user nova-compute[74342]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3, portal: 172.16.0.220,3260] successful.
Oct 16 10:37:22 user nova-compute[74342]:  stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:37:22 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3 -p 172.16.0.220:3260 --op delete {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:37:23 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:37:23 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ff3094-6fff-4230-aea3-2014cad4acbc]: (4, ('', '')) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:37:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=74342) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Oct 16 10:37:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.257s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:37:23 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] <== disconnect_volume: return (258ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:37:23 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 10:37:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:37:23 user nova-compute[74342]: DEBUG nova.objects.instance [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lazy-loading 'flavor' on Instance uuid 8b602175-5dca-4c27-9944-307cafd0ab98 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:37:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-c3763666-559b-4185-9929-d02c6e8a840e tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "8b602175-5dca-4c27-9944-307cafd0ab98" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.765s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:37:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "8b602175-5dca-4c27-9944-307cafd0ab98" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.597s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:37:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "8b602175-5dca-4c27-9944-307cafd0ab98-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:37:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "8b602175-5dca-4c27-9944-307cafd0ab98-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:37:23 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "8b602175-5dca-4c27-9944-307cafd0ab98-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:37:23 user nova-compute[74342]: INFO nova.compute.manager [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Terminating instance
Oct 16 10:37:23 user nova-compute[74342]: DEBUG nova.compute.manager [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Start destroying the instance on the hypervisor. {{(pid=74342) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Oct 16 10:37:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:37:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:37:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:37:23 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:37:24 user nova-compute[74342]: DEBUG nova.compute.manager [req-45ec483c-07f8-42c1-85af-4f413c6617bf req-bea9dd45-3269-45a7-8ac6-41ebf1f48d2d service nova] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Received event network-vif-unplugged-5b33d5ef-9594-4f0c-a3ae-55ffc442ded5 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:37:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-45ec483c-07f8-42c1-85af-4f413c6617bf req-bea9dd45-3269-45a7-8ac6-41ebf1f48d2d service nova] Acquiring lock "8b602175-5dca-4c27-9944-307cafd0ab98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:37:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-45ec483c-07f8-42c1-85af-4f413c6617bf req-bea9dd45-3269-45a7-8ac6-41ebf1f48d2d service nova] Lock "8b602175-5dca-4c27-9944-307cafd0ab98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:37:24 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-45ec483c-07f8-42c1-85af-4f413c6617bf req-bea9dd45-3269-45a7-8ac6-41ebf1f48d2d service nova] Lock "8b602175-5dca-4c27-9944-307cafd0ab98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:37:24 user nova-compute[74342]: DEBUG nova.compute.manager [req-45ec483c-07f8-42c1-85af-4f413c6617bf req-bea9dd45-3269-45a7-8ac6-41ebf1f48d2d service nova] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] No waiting events found dispatching network-vif-unplugged-5b33d5ef-9594-4f0c-a3ae-55ffc442ded5 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:37:24 user nova-compute[74342]: DEBUG nova.compute.manager [req-45ec483c-07f8-42c1-85af-4f413c6617bf req-bea9dd45-3269-45a7-8ac6-41ebf1f48d2d service nova] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Received event network-vif-unplugged-5b33d5ef-9594-4f0c-a3ae-55ffc442ded5 for instance with task_state deleting. {{(pid=74342) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10889}}
Oct 16 10:37:24 user nova-compute[74342]: INFO nova.virt.libvirt.driver [-] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Instance destroyed successfully.
Oct 16 10:37:24 user nova-compute[74342]: DEBUG nova.objects.instance [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lazy-loading 'resources' on Instance uuid 8b602175-5dca-4c27-9944-307cafd0ab98 {{(pid=74342) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1152}}
Oct 16 10:37:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.vif [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-10-16T10:34:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1705417551',display_name='tempest-VolumesSnapshotTestJSON-instance-1705417551',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1705417551',id=52,image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaU2cSlGw96OItYnzBITChNecsD76gapatQ9/IWI7zpUGcO1I1w493iohg1nfdwHNTj+2CvgkGKwWa3k6eewWmsvZqyPhxvgMeTKbELooRvz5mDCBZo2jY4mCkZNUn+XQ==',key_name='tempest-keypair-1596973313',keypairs=<?>,launch_index=0,launched_at=2023-10-16T10:34:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='496a10bc096b4983bb728512bb41ac45',ramdisk_id='',reservation_id='r-waag98nn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='01fbac29-34fa-4a9a-a2f8-2f304b74a717',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1850096802',owner_user_name='tempest-VolumesSnapshotTestJSON-1850096802-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-10-16T10:34:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3b08b694b7ec45ab9f208b01ef1c833a',uuid=8b602175-5dca-4c27-9944-307cafd0ab98,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5b33d5ef-9594-4f0c-a3ae-55ffc442ded5", "address": "fa:16:3e:98:b5:61", "network": {"id": "f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1742429158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496a10bc096b4983bb728512bb41ac45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b33d5ef-95", "ovs_interfaceid": "5b33d5ef-9594-4f0c-a3ae-55ffc442ded5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Oct 16 10:37:24 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Converting VIF {"id": "5b33d5ef-9594-4f0c-a3ae-55ffc442ded5", "address": "fa:16:3e:98:b5:61", "network": {"id": "f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1742429158-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "496a10bc096b4983bb728512bb41ac45", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5b33d5ef-95", "ovs_interfaceid": "5b33d5ef-9594-4f0c-a3ae-55ffc442ded5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Oct 16 10:37:24 user nova-compute[74342]: DEBUG nova.network.os_vif_util [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:b5:61,bridge_name='br-int',has_traffic_filtering=True,id=5b33d5ef-9594-4f0c-a3ae-55ffc442ded5,network=Network(f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b33d5ef-95') {{(pid=74342) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Oct 16 10:37:24 user nova-compute[74342]: DEBUG os_vif [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:b5:61,bridge_name='br-int',has_traffic_filtering=True,id=5b33d5ef-9594-4f0c-a3ae-55ffc442ded5,network=Network(f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b33d5ef-95') {{(pid=74342) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Oct 16 10:37:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:37:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5b33d5ef-95, bridge=br-int, if_exists=True) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:37:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:37:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:37:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 26 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:37:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=299e4e04-637d-4f42-b2a5-f41050c40ce0) {{(pid=74342) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Oct 16 10:37:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:37:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:37:24 user nova-compute[74342]: INFO os_vif [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:b5:61,bridge_name='br-int',has_traffic_filtering=True,id=5b33d5ef-9594-4f0c-a3ae-55ffc442ded5,network=Network(f2c2869f-f01c-4e6a-9cfa-fc98c0b71c88),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5b33d5ef-95')
Oct 16 10:37:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] calling os-brick to detach iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Oct 16 10:37:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f2b80298310>, {'target_iqn': 'iqn.2010-10.org.openstack:c3e38539-9625-4cc9-8ef5-90eec6a72cc3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sCPHfMhK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Oct 16 10:37:24 user nova-compute[74342]: WARNING os_brick.initiator.connectors.base [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Oct 16 10:37:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Oct 16 10:37:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Oct 16 10:37:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Oct 16 10:37:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.016s {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Oct 16 10:37:24 user nova-compute[74342]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=85400) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Oct 16 10:37:24 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[36b09d70-f893-48f1-88d7-cd53beff3d4c]: Unexpected error while running command.
Oct 16 10:37:24 user nova-compute[74342]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 16 10:37:24 user nova-compute[74342]: Exit code: 21
Oct 16 10:37:24 user nova-compute[74342]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 16 10:37:24 user nova-compute[74342]: Stderr: '' {{(pid=85400) _process_cmd /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:477}}
Oct 16 10:37:24 user nova-compute[74342]: Traceback (most recent call last):
Oct 16 10:37:24 user nova-compute[74342]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 474, in _process_cmd
Oct 16 10:37:24 user nova-compute[74342]:     ret = func(*f_args, **f_kwargs)
Oct 16 10:37:24 user nova-compute[74342]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Oct 16 10:37:24 user nova-compute[74342]:     return func(*args, **kwargs)
Oct 16 10:37:24 user nova-compute[74342]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Oct 16 10:37:24 user nova-compute[74342]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Oct 16 10:37:24 user nova-compute[74342]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Oct 16 10:37:24 user nova-compute[74342]:     return putils.execute(on_execute=on_execute,
Oct 16 10:37:24 user nova-compute[74342]:   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py", line 438, in execute
Oct 16 10:37:24 user nova-compute[74342]:     raise ProcessExecutionError(exit_code=_returncode,
Oct 16 10:37:24 user nova-compute[74342]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 16 10:37:24 user nova-compute[74342]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 16 10:37:24 user nova-compute[74342]: Exit code: 21
Oct 16 10:37:24 user nova-compute[74342]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 16 10:37:24 user nova-compute[74342]: Stderr: ''
Oct 16 10:37:24 user nova-compute[74342]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b09d70-f893-48f1-88d7-cd53beff3d4c]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=85400) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Oct 16 10:37:24 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 16 10:37:24 user nova-compute[74342]: Command: iscsiadm -m discoverydb -o show -P 1
Oct 16 10:37:24 user nova-compute[74342]: Exit code: 21
Oct 16 10:37:24 user nova-compute[74342]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 16 10:37:24 user nova-compute[74342]: Stderr: ''
Oct 16 10:37:24 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Oct 16 10:37:24 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 217, in _get_ips_iqns_luns
Oct 16 10:37:24 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Oct 16 10:37:24 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 376, in _get_discoverydb_portals
Oct 16 10:37:24 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Oct 16 10:37:24 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py", line 1188, in _run_iscsiadm_bare
Oct 16 10:37:24 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Oct 16 10:37:24 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/executor.py", line 55, in _execute
Oct 16 10:37:24 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Oct 16 10:37:24 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Oct 16 10:37:24 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Oct 16 10:37:24 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Oct 16 10:37:24 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Oct 16 10:37:24 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py", line 215, in remote_call
Oct 16 10:37:24 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Oct 16 10:37:24 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Oct 16 10:37:24 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Oct 16 10:37:24 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Oct 16 10:37:24 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Oct 16 10:37:24 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Oct 16 10:37:24 user nova-compute[74342]: ERROR os_brick.initiator.connectors.iscsi 
Oct 16 10:37:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=74342) _cleanup_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:934}}
Oct 16 10:37:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.base [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.022s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Oct 16 10:37:24 user nova-compute[74342]: DEBUG os_brick.initiator.connectors.iscsi [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] <== disconnect_volume: return (23ms) None {{(pid=74342) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Oct 16 10:37:24 user nova-compute[74342]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Disconnected iSCSI Volume {{(pid=74342) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Oct 16 10:37:24 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Deleting instance files /opt/stack/data/nova/instances/8b602175-5dca-4c27-9944-307cafd0ab98_del
Oct 16 10:37:24 user nova-compute[74342]: INFO nova.virt.libvirt.driver [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Deletion of /opt/stack/data/nova/instances/8b602175-5dca-4c27-9944-307cafd0ab98_del complete
Oct 16 10:37:24 user nova-compute[74342]: INFO nova.compute.manager [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Took 0.87 seconds to destroy the instance on the hypervisor.
Oct 16 10:37:24 user nova-compute[74342]: DEBUG oslo.service.loopingcall [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=74342) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Oct 16 10:37:24 user nova-compute[74342]: DEBUG nova.compute.manager [-] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Deallocating network for instance {{(pid=74342) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Oct 16 10:37:24 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] deallocate_for_instance() {{(pid=74342) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Oct 16 10:37:25 user nova-compute[74342]: DEBUG nova.network.neutron [-] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Updating instance_info_cache with network_info: [] {{(pid=74342) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Oct 16 10:37:25 user nova-compute[74342]: INFO nova.compute.manager [-] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Took 1.15 seconds to deallocate network for instance.
Oct 16 10:37:25 user nova-compute[74342]: DEBUG nova.compute.manager [req-48a5c9b8-dda5-4cee-8db6-4bc0bfb73b14 req-c23c5a8f-c2e1-4ad3-8255-6ef8d191f922 service nova] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Received event network-vif-deleted-5b33d5ef-9594-4f0c-a3ae-55ffc442ded5 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:37:25 user nova-compute[74342]: WARNING nova.volume.cinder [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Attachment 48d2f050-6576-407b-8bf6-54f258699f56 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 48d2f050-6576-407b-8bf6-54f258699f56. (HTTP 404) (Request-ID: req-15935df5-ddc2-4cde-a73d-5a772ae3b120)
Oct 16 10:37:25 user nova-compute[74342]: INFO nova.compute.manager [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Took 0.03 seconds to detach 1 volumes for instance.
Oct 16 10:37:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:37:25 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:37:26 user nova-compute[74342]: DEBUG nova.compute.manager [req-72fed60a-7bc5-4ef5-878c-18994aba3098 req-32637366-482d-4e0c-8436-88ff74c51ab5 service nova] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Received event network-vif-plugged-5b33d5ef-9594-4f0c-a3ae-55ffc442ded5 {{(pid=74342) external_instance_event /opt/stack/nova/nova/compute/manager.py:11111}}
Oct 16 10:37:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-72fed60a-7bc5-4ef5-878c-18994aba3098 req-32637366-482d-4e0c-8436-88ff74c51ab5 service nova] Acquiring lock "8b602175-5dca-4c27-9944-307cafd0ab98-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:37:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-72fed60a-7bc5-4ef5-878c-18994aba3098 req-32637366-482d-4e0c-8436-88ff74c51ab5 service nova] Lock "8b602175-5dca-4c27-9944-307cafd0ab98-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:37:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [req-72fed60a-7bc5-4ef5-878c-18994aba3098 req-32637366-482d-4e0c-8436-88ff74c51ab5 service nova] Lock "8b602175-5dca-4c27-9944-307cafd0ab98-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:37:26 user nova-compute[74342]: DEBUG nova.compute.manager [req-72fed60a-7bc5-4ef5-878c-18994aba3098 req-32637366-482d-4e0c-8436-88ff74c51ab5 service nova] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] No waiting events found dispatching network-vif-plugged-5b33d5ef-9594-4f0c-a3ae-55ffc442ded5 {{(pid=74342) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Oct 16 10:37:26 user nova-compute[74342]: WARNING nova.compute.manager [req-72fed60a-7bc5-4ef5-878c-18994aba3098 req-32637366-482d-4e0c-8436-88ff74c51ab5 service nova] [instance: 8b602175-5dca-4c27-9944-307cafd0ab98] Received unexpected event network-vif-plugged-5b33d5ef-9594-4f0c-a3ae-55ffc442ded5 for instance with vm_state deleted and task_state None.
Oct 16 10:37:26 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:37:26 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:37:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.476s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:37:26 user nova-compute[74342]: INFO nova.scheduler.client.report [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Deleted allocations for instance 8b602175-5dca-4c27-9944-307cafd0ab98
Oct 16 10:37:26 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-5681128d-e8c9-4562-b53b-5660a62f2663 tempest-VolumesSnapshotTestJSON-1850096802 tempest-VolumesSnapshotTestJSON-1850096802-project-member] Lock "8b602175-5dca-4c27-9944-307cafd0ab98" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.703s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:37:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:37:33 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:37:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:37:36 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:37:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:37:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:37:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:37:36 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:37:36 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:37:36 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:37:36 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=9113MB free_disk=24.97797393798828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:37:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:37:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:37:36 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:37:36 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:37:36 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:37:36 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:37:36 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:37:36 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:37:38 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:37:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:37:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:37:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:37:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:37:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:37:43 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:37:43 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:37:43 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Didn't find any instances for network info cache update. {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 10:37:43 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:37:43 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:37:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:37:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:37:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:37:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:37:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:37:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:37:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:37:51 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:37:54 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:37:54 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:37:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:37:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:37:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:37:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:37:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:37:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:38:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:38:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:38:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:38:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:38:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:38:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:38:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:38:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:38:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:38:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:38:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:38:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:38:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:38:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:38:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:38:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:38:33 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:38:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:38:37 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:38:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:38:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:38:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:38:37 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:38:37 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:38:37 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:38:37 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=9198MB free_disk=24.975841522216797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:38:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:38:37 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:38:38 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:38:38 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:38:38 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:38:38 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:38:38 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:38:38 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.352s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:38:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:38:40 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:38:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:38:42 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:38:42 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:38:43 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:38:44 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:38:44 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:38:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:38:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:38:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=74342) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Oct 16 10:38:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:38:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=74342) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Oct 16 10:38:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:38:45 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:38:45 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:38:45 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Rebuilding the list of instances to heal {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 10:38:45 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Didn't find any instances for network info cache update. {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 10:38:49 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:38:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:38:54 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:38:59 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:39:04 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:39:09 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:39:14 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:39:19 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:39:24 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:39:29 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:39:31 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:39:33 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:39:33 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:39:34 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:39:39 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:39:39 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager.update_available_resource {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:39:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:39:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:39:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:39:39 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Auditing locally available compute resources for user (node: user) {{(pid=74342) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Oct 16 10:39:39 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:39:39 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:39:39 user nova-compute[74342]: WARNING nova.virt.libvirt.driver [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Oct 16 10:39:39 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Hypervisor/Node resource view: name=user free_ram=9315MB free_disk=24.96359634399414GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=74342) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Oct 16 10:39:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Oct 16 10:39:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Oct 16 10:39:39 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Oct 16 10:39:39 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=74342) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Oct 16 10:39:39 user nova-compute[74342]: DEBUG nova.compute.provider_tree [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed in ProviderTree for provider: b5ec9788-0ade-4d36-b3d5-0cad880481ca {{(pid=74342) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Oct 16 10:39:39 user nova-compute[74342]: DEBUG nova.scheduler.client.report [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Inventory has not changed for provider b5ec9788-0ade-4d36-b3d5-0cad880481ca based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=74342) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Oct 16 10:39:39 user nova-compute[74342]: DEBUG nova.compute.resource_tracker [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Compute_service record updated for user:user {{(pid=74342) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Oct 16 10:39:39 user nova-compute[74342]: DEBUG oslo_concurrency.lockutils [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.131s {{(pid=74342) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Oct 16 10:39:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:39:41 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:39:43 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:39:44 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:39:44 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:39:44 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 28 {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Oct 16 10:39:45 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:39:45 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Starting heal instance info cache {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9921}}
Oct 16 10:39:45 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Rebuilding the list of instances to heal {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9925}}
Oct 16 10:39:45 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Didn't find any instances for network info cache update. {{(pid=74342) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10007}}
Oct 16 10:39:45 user nova-compute[74342]: DEBUG oslo_service.periodic_task [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=74342) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Oct 16 10:39:45 user nova-compute[74342]: DEBUG nova.compute.manager [None req-fb0f393f-1c27-4b26-9b7f-ea5b4167a570 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=74342) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10540}}
Oct 16 10:39:49 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Oct 16 10:39:54 user nova-compute[74342]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=74342) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}